Chainer向けChannel Pruningフレームワークの設計と実装

•

2 j'aime•4,179 vues

tomohiro kato

https://github.com/DeNA/ChainerPruner https://chainer.connpass.com/event/106292/

Logiciels

© DeNA Co., Ltd.
Chaienr
Channel Pruning
December 15, 2018
Tomohiro Kato
AI System Dept.
DeNA Co., Ltd.

© DeNA Co., Ltd.
n u o PV
n ) d d
n rRpR h D C )
n ( A 18 8 l cg a st
n ) 2 8 e nyiMLNm T I
n (728 D 1 01 D 8
n )8 8 7e A 8 I
n ) 2 8 e nyi ( /
n A 01
4

© DeNA Co., Ltd.
n CV
5
https://www.slideshare.net/ShotaSuzuki2/mlops-shibuyasynapse-4-125602323
https://dena.ai/work6/

© DeNA Co., Ltd.
n Deep Learning …
HW
n Channel Pruning
ChainerMeetup →
6

© DeNA Co., Ltd.
Channel Pruning
n Channel Pruning
Deep Learning
Weight CPU/GPU /
n Optuna Pruning ChainerPruningExtension
7

© DeNA Co., Ltd.
n ChainerCV ResNet50 channel pruning
8
MacBook Pro CPU, Chainer v5.1.0

© DeNA Co., Ltd.
ChainerPruner
n https://github.com/DeNA/ChainerPruner
n Channel Pruning
n Channel Pruning
n Under development
10

© DeNA Co., Ltd.
ChainerPruner
n Pruning
Channel Pruning
n Pruning
Channel Pruning
11

© DeNA Co., Ltd.
Dynamic Pruning
n Pruning
Weight
n Pruning
Weight shape
1/0 0
Iteration
n Pruning load
:benri:
12

© DeNA Co., Ltd.
Mask and Rebuild
n Weight -step
Mask: Weight
Rebuild: Weight
n Mask
L2 N-%
chainerpruner.Mask
13

© DeNA Co., Ltd.
Rebuild mechanism
n Channel Pruning
n Conv – BN – FC Conv Pruning Bn FC
Bn, FC input channel Conv output channel update
n
n Conv - BN - Pool - ConvDW – FC Link Function
ChainerPruner
n
14

© DeNA Co., Ltd.
Serializers
n Pruning Weight
n Link Pruning Weight
16

© DeNA Co., Ltd.
Utility
n
https://github.com/belltailjp/chainer_computational_cost
wrapper
n pruning
n / /
17

© DeNA Co., Ltd.
n ChainerPruner
https://github.com/DeNA/ChainerPruner
Channel Pruning
n Future work
ChainerX support
Pruning
Reporter tensorboardX
Chainer
18

Contenu connexe

Similaire à Chainer向けChannel Pruningフレームワークの設計と実装

Effectively Migrating to Cassandra from a Relational Database

Todd McGrath

Slides for the Webinar, presented on March 6, 2019 For the webinar video visit https://www.altinity.com/ Extracting business insight from massive pools of machine-generated data is the central analytic problem of the digital era. ClickHouse data warehouse addresses it with sub-second SQL query response on petabyte-scale data sets. In this talk we'll discuss the features that make ClickHouse increasingly popular, show you how to install it, and teach you enough about how ClickHouse works so you can try it out on real problems of your own. We'll have cool demos (of course) and gladly answer your questions at the end. Speaker Bio: Robert Hodges is CEO of Altinity, which offers enterprise support for ClickHouse. He has over three decades of experience in data management spanning 20 different DBMS types. ClickHouse is his current favorite. ;)

A Fast Intro to Fast Query with ClickHouse, by Robert Hodges

Altinity Ltd

Run Simulations and Then Become An Inventor (Best Paper Award in CDNLive Taiw...

Nansen Chen

Improving Python and Spark Performance and Interoperability with Apache Arrow

Julien Le Dem

Case Study: Large Scale Deployment for Machine Learning with Highspeed Storage

Kota Tsuyuzaki

Apache Spark has become a popular and successful way for Python programming to parallelize and scale up data processing. In many use cases though, a PySpark job can perform worse than an equivalent job written in Scala. It is also costly to push and pull data between the user’s Python environment and the Spark master. Apache Arrow-based interconnection between the various big data tools (SQL, UDFs, machine learning, big data frameworks, etc.) enables you to use them together seamlessly and efficiently, without overhead. When collocated on the same processing node, read-only shared memory and IPC avoid communication overhead. When remote, scatter-gather I/O sends the memory representation directly to the socket avoiding serialization costs.

Improving Python and Spark Performance and Interoperability with Apache Arrow...

Databricks

Amora: A mobile remote assistant

gsroma

SpringOne Platform 2017報告会メインプロジェクトのアップデート

Takuya Iwatsuka

Eastman Chemical Company introduces SEIGA

AVEVA Group plc

Aveva_E3D.pptx

RamaKrishnanG16

One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018

Gleb Otochkin

ETA Padtron Sdn.Bhd. - Enterprise Programming - Tools

Yuvarani Loganathan

Continuous Delivery and Automated Operations on k8s with keptn

Andreas Grabner

Nano Dimension’s DragonFly LDM™ System is a one-stop solution for agile hardware development and innovative circuit design across a wide array of industries. It empowers companies to securely control entire development cycles through in-house additive manufacturing of PCBs and non-planar electronics with speed and precision, while reducing R&D costs. With it’s Lights-Out Digital Manufacturing (LDM) printing technology, this is the industry’s only comprehensive manufacturing printing platform for round-the-clock 3D printing of electronic circuitry.

Nano Dimension Presentation

RedChip Companies, Inc.

With the release of Cisco DNA Center version 1.2, it’s now possible to extend the benefits of Cisco Software-Defined Access to your extended enterprise—including the growing number of IoT devices being added across your network. Learn how to extend the agility and simplicity of intent-based networking across your distributed campus, factory floor, or carpeted IoT environment. Resources: Watch the related TechWiseTV episode: http://cs.co/9009DsSFU TechWiseTV: http://cs.co/9009DzrjN

TechWiseTV Workshop: Extending Intent-Based Networking to IoT

Robb Boyd

In machine learning, training large models on massive amount of data usually improved results. Our customers report however that training such models and deploying them is either operationally prohibitive or outright impossible for them. Amazon AI Algorithms is designed to solve this problem. It is a collection of distributed streaming ML algorithms that scale to any amount of data. They are fast and efficient because they distribute across CPU.GPU machines and share a collective distributed state via a highly-optimized parameter server. They scale to an infinite amount of data because they operate in the streaming model. This means they require only one pass over the data and never increase their resources consumption allowing training to be paused resumed and snapshotted and even for algorithms to consume kinesis streams directly providing an "always on" training mechanism. They are production ready. Trained models are automatically containerized and usable in production using Amazon SageMaker hosting. Finally, we provide a convenient SDK which allows scientists to create new algorithms which operate in this model and enjoy all the benefits above.

Speed up your Machine Learning workflows with built-in algorithms - Tel Aviv ...

Amazon Web Services

Speed up your Machine Learning workflows with build-in algorithms

Julien SIMON

NTTドコモ様導入事例 OpenStack Summit 2015 Tokyo 講演「After One year of OpenStack Cloud...

VirtualTech Japan Inc.

21555577938.ppt

HarshitSharma443772

Pitch v2.2

LeapMind Inc

Similaire à Chainer向けChannel Pruningフレームワークの設計と実装 (20)

Effectively Migrating to Cassandra from a Relational Database

A Fast Intro to Fast Query with ClickHouse, by Robert Hodges

Run Simulations and Then Become An Inventor (Best Paper Award in CDNLive Taiw...

Improving Python and Spark Performance and Interoperability with Apache Arrow

Case Study: Large Scale Deployment for Machine Learning with Highspeed Storage

Improving Python and Spark Performance and Interoperability with Apache Arrow...

Amora: A mobile remote assistant

SpringOne Platform 2017報告会メインプロジェクトのアップデート

Eastman Chemical Company introduces SEIGA

Aveva_E3D.pptx

One bridge to connect them all. Oracle GoldenGate for Big Data.UKOUG Tech 2018

ETA Padtron Sdn.Bhd. - Enterprise Programming - Tools

Continuous Delivery and Automated Operations on k8s with keptn

Nano Dimension Presentation

TechWiseTV Workshop: Extending Intent-Based Networking to IoT

Speed up your Machine Learning workflows with built-in algorithms - Tel Aviv ...

Speed up your Machine Learning workflows with build-in algorithms

NTTドコモ様導入事例 OpenStack Summit 2015 Tokyo 講演「After One year of OpenStack Cloud...

21555577938.ppt

Pitch v2.2

Dernier

In the past six months, the AI landscape has undergone a massive transformation, ushering in a new era of productivity with the latest in Large Language Models (LLMs) and AI technology. This deep dive unlocks how to: Create CustomGPT Models: No coding needed to tailor AI for your unique projects. Integrate your own data, including PDFs and Excel sheets, making information handling a breeze. Plus, discover how to call your own actions/integrations for even more personalized utility. Navigate Advanced Prompting: Overcome AI's memory limits and utilize Retrieval-Augmented Generation for accessing your personalized data, streamlining how you interact with AI. Stay Ahead with AI Trends: Peek into the evolving world of LLMs, featuring newcomers like Google Gemini, Anthropic Claude, Open Sora, and Twitter Grok, and understand what their advancements mean for your productivity. Witness Real-Life Transformations: Through examples and prompt demonstrations, see firsthand how these AI strategies revolutionize routine tasks, from data analysis to content creation. Learn to leverage image output and input for advanced practical use cases, adding a new dimension to your productivity toolkit. No previous coding or AI experience is needed for this talk. Stay ahead in the fast-evolving world of work. Embrace the AI revolution and transform your workflow with advanced LLM techniques. Join us to ensure you're not left behind in the productivity race.

AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques

VictorSzoltysek

%in Soweto+277-882-255-28 abortion pills for sale in soweto

masabamasaba

In today's dynamic e-commerce landscape, the payment gateway emerges as a linchpin, ensuring smooth and secure transactions between buyers and sellers. In this discourse, we delve into the meticulous process of devising test cases tailored for scrutinizing payment gateways. Crafting precise test cases for payment gateways is a quintessential responsibility for testers operating within the service industry. This article meticulously explores pivotal scenarios integral to how to test payment gateways, coupled with essential guidelines for drafting effective test cases.

Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf

kalichargn70th171

WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...

WSO2

%in tembisa+277-882-255-28 abortion pills for sale in tembisa

masabamasaba

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

WSO2

Craft an AI & Machine Learning Pitch with our Editable Professional PowerPoint Template. Ignite your AI & Machine Learning pitch with our cutting-edge PowerPoint template tailored for the industry. Perfect for AI conferences, investor presentations, sales pitches to tech-focused companies, training sessions, and educational programs. - 20+ editable slides: Get a variety of options to choose from for your presentation. - Time-saving solution: Download, replace text/images with a few clicks. - User-friendly customization: Easy to use and personalize. - Modern and attractive design: Captivating visuals, sleek layout. - Tailored to your requirements: Fully alterable for customization. - Well-organized slides: Complete control over content. - Thematic specificity: Reflects healthcare industry with relevant graphics. - Showcase your business idea: Communicate value proposition effectively.

AI & Machine Learning Presentation Template

Presentation.STUDIO

The fast-paced world of Agile development just got a turbo boost! Dive into this engaging talk on "Innovation at Speed: ChatGPT & the AI Transformation in Agile Development." Over the last few months, AI, including notable tools like Google Bard and Microsoft Co-Pilot, has been leveraged to supercharge Agile workflows. In this session, attendees will get an overview of the current AI landscape and its impact on development. They will learn why AI is the game-changer needed to embrace in the Agile lifecycle, offering that elusive X factor to multiply productivity. Real-world examples will be presented, and the challenges of implementing AI tools like ChatGPT within corporate environments will be discussed.

Harnessing ChatGPT - Elevating Productivity in Today's Agile Environment

VictorSzoltysek

Software Quality Assurance Interview Questions

Arshad QA

The title is not connected to what is inside

shinachiaurasa2

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal.

%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...

masabamasaba

%in Midrand+277-882-255-28 abortion pills for sale in midrand

masabamasaba

Conference: Engage2024 in Antwerp Type: Workshop Speakers: Florian Vogler, Henning Kunz, Christoph Adler Title: Navigating the Future with The Hitchhiker's Guide to Notes and Domino 14 Abstract: Embark on an exhilarating journey with industry trailblazers Florian Vogler, Henning Kunz, and Christoph Adler in this not-to-be-missed workshop at the forefront of the tech universe. Get ready for a thrilling kick-off as we navigate the current state of the HCL universe, setting the stage for an exploration of the groundbreaking Notes and Domino 14. Discover the latest enhancements and revolutionary features that will redefine your experience. In this interactive session, unlock a treasure trove of tips and tricks to elevate your utilization of version 14, both with and without the game-changing panagenda MarvelClient. Brace yourself for also diving into Nomad, Nomad Web, and VoltMX, expanding your horizons in the expansive HCL landscape. Be a part of this exclusive opportunity to stay ahead in the ever-evolving world of HCL technologies. Your journey to mastering Notes and Domino 14 begins here. And remember, in the spirit of intergalactic exploration, don't forget to bring your towel!

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

panagenda

Investing in AI transformation today The modern business advantage: Uncovering deep insights with AI Organizations around the world have come to recognize AI as the transformative technology that enables them to gain real business advantage. AI’s ability to organize vast quantities of data allows those who implement it to uncover deep business insights, augment human expertise, drive operational efficiency, transform their products, and better serve their customers

Microsoft AI Transformation Partner Playbook.pdf

Willy Marroquin (WillyDevNET)

%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview

masabamasaba

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in Tembisa ● Abortion Pills For Sale in Tembisa ● Tembisa 🏥🚑!! Abortion Clinic Near Me Cost, Price, Women's Clinic Near Me, Abortion Clinic Near, Abortion Doctors Near me, Abortion Services Near Me, Abortion Pills Over The Counter, Abortion Pill Doctors' Offices, Abortion Clinics, Abortion Places Near Me, Cheap Abortion Places Near Me, Medical Abortion & Surgical Abortion, approved cyctotec pills and womb cleaning pills too plus all the instructions needed This Discrete women’s Termination Clinic offers same day services that are safe and pain free, we use approved pills and we clean the womb so that no side effects are present. Our main goal is that of preventing unintended pregnancies and unwanted births every day to enable more women to have children by choice, not chance. We offer Terminations by Pill and The Morning After Pill.” Our Private VIP Abortion Service offers the ultimate in privacy, efficiency and discretion. we do safe and same day termination and we do also womb cleaning as well its done from 1 week up to 28 weeks. We do delivery of our services world wide SAFE ABORTION CLINICS/PILLS ON SALE WE DO DELIVERY OF PILLS ALSO Abortion clinic at very low costs, 100% Guaranteed and it’s safe, pain free and a same day service. It Is A 45 Minutes Procedure, we use tested abortion pills and we do womb cleaning as well. Alternatively the medical abortion pill and womb cleansing !!!

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...

Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of Winnipeg back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal. Attraction Spells

%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...

masabamasaba

Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...

SelfMade bd

WSO2CON2024 - It's time to go Platformless

WSO2

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...

masabamasaba

Dernier (20)

AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques

%in Soweto+277-882-255-28 abortion pills for sale in soweto

Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf

WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...

%in tembisa+277-882-255-28 abortion pills for sale in tembisa

WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation

AI & Machine Learning Presentation Template

Harnessing ChatGPT - Elevating Productivity in Today's Agile Environment

Software Quality Assurance Interview Questions

The title is not connected to what is inside

%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...

%in Midrand+277-882-255-28 abortion pills for sale in midrand

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

Microsoft AI Transformation Partner Playbook.pdf

%in Hazyview+277-882-255-28 abortion pills for sale in Hazyview

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...

%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...

Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...

WSO2CON2024 - It's time to go Platformless

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...

Chainer向けChannel Pruningフレームワークの設計と実装

4. © DeNA Co., Ltd. n u o PV n ) d d n rRpR h D C ) n ( A 18 8 l cg a st n ) 2 8 e nyiMLNm T I n (728 D 1 01 D 8 n )8 8 7e A 8 I n ) 2 8 e nyi ( / n A 01 4

5. © DeNA Co., Ltd. n CV 5 https://www.slideshare.net/ShotaSuzuki2/mlops-shibuyasynapse-4-125602323 https://dena.ai/work6/

7. © DeNA Co., Ltd. Channel Pruning n Channel Pruning Deep Learning Weight CPU/GPU / n Optuna Pruning ChainerPruningExtension 7

10. © DeNA Co., Ltd. ChainerPruner n https://github.com/DeNA/ChainerPruner n Channel Pruning n Channel Pruning n Under development 10

14. © DeNA Co., Ltd. Rebuild mechanism n Channel Pruning n Conv – BN – FC Conv Pruning Bn FC Bn, FC input channel Conv output channel update n n Conv - BN - Pool - ConvDW – FC Link Function ChainerPruner n 14

18. © DeNA Co., Ltd. n ChainerPruner https://github.com/DeNA/ChainerPruner Channel Pruning n Future work ChainerX support Pruning Reporter tensorboardX Chainer 18

Chainer向けChannel Pruningフレームワークの設計と実装

Recommandé

Recommandé

Contenu connexe

Similaire à Chainer向けChannel Pruningフレームワークの設計と実装

Similaire à Chainer向けChannel Pruningフレームワークの設計と実装 (20)

Dernier

Dernier (20)

Chainer向けChannel Pruningフレームワークの設計と実装