Google Dev Summit Extended Seoul - TensorFlow: Tensorboard & Keras

•

34 j'aime•6,972 vues

Taegyun Jeon

Ingénierie

Taegyun Jeon
TensorFlow Dev Summit Extended Seoul / 2017.02.22
R&D Center, Satrec Initiative
TensorFlow:
TensorBoard & Keras
GDG Meetup in February

Contents
 Integrating Keras & TensorFlow: The Keras Workflow,
Expanded
▫ Speaker: Francois Chollet
 Hands-on TensorBoard
▫ Speaker: Dandelion Mané
▫ Code & Slide: https://goo.gl/San2uR
 All contents are provided from TensorFlow Dev Summit 2017
(https://events.withgoogle.com/tensorflow-dev-summit/)
Page 2[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras

Keras
 An API spec for building deep learning models across many
platforms
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 3

Keras의 인기 비결?
 간편함
 간결함
 TF의 잦은 API 변경
 연구자와 개발자의
의사소통 도구
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 4

tf.keras
 Keras는 결국 TensorFlow의 품으로!
 TensorFlow layers = Keras layers
 Keras Model
▫ Sequence model and functional model API
 TensorFlow 기능과 통합 가능
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 5
https://www.tensorflow.org/api_docs/python/tf/contrib/learn/Experiment

Keras 사용자들에게 어떤 일들이?
 TensorFlow와 Keras사이에서 고민하지 않으셔도 됩니다.
 TF와 Keras의 장단점을 파악해서 섞어서 쓰세요.
 Distributed Training, Cloud ML, Hyperparameter setting,
TF-Serving
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 6
https://blog.keras.io/keras-as-a-simplified-interface-to-tensorflow-tutorial.html

Keras Example: Video QA
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 7

Keras Example: Video QA
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 8

Keras Example: Video QA
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 9

Keras Example: Video QA
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 10

Keras Example: Video QA
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 11

Keras Example: Video QA
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 12

[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 13

Keras Example: Video QA
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 14

Keras Example: Visual VQA
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 15

More Examples
 Keras Blog
▫ https://blog.keras.io/
 Keras API (keras.applications)
▫ https://keras.io/applications/
 Keras Example Directories
▫ https://github.com/fchollet/keras/tree/master/examples
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 16

Keras: Summary
 TF 사용자: 손쉬운 high-level api 사용 가능
 Keras 사용자: 모델만 keras로 만들고 이후 운영은 TF로 가능
 버전 변경 계획
▫ tf.contrib.keras (TF 1.1 / 올해 3월 중)
▫ tf.keras (TF 1.2)
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 17

TensorBoard
 TensorBoard를 이용해서 얻는 장점
▫ Debug: 내부를 알기 힘든 딥러닝 모델을 눈으로 확인
▫ Hyperparameter Tuning
▫ Visualize inference results
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 18

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 19

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 20

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 21

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 22

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 23

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 24

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 25

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 26
엄청 복잡해보이네요

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 27

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 28

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 29

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 30

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 31
이제 레이어별로
깔끔해졌습니다.

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 32
이전과 비교해봐도
눈에 잘 들어옵니다

TensorBoard: MNIST Example
 tf.summary.scalar
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 33
 tf.summary.image
 tf.summary.audio  tf.summary.histogram

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 34

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 35

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 36

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 37
정확도가 엉망이군요!

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 38
Cross-entropy도 뭔가
이상하죠?

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 39
Convolution layer가
변하지 않았음을
알 수 있습니다.

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 40
Histogram도 역시 마
찬가지군요

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 41

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 42

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 43
이제 제대로
학습이 되는군요

TensorBoard: MNIST Example
 Hyperparameter search
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 44

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 45
다양한 run을 기록

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 46
Hyperparameter를 찾을땐
epoch을 조금만 설정해서
초기 성능만 보고
ckpt 관리 및 추가학습

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 47

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 48

TensorBoard: MNIST Example
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 49

TensorBoard
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 50

TensorBoard: Summary
 Debug
▫ name_scope 정의와 tensor의 name 붙이기를 생활화
▫ Summary 기능을 활용
• Scalar, Image, Audio, Histogram
 Hyperparameter search
▫ 다양한 run을 짧게 돌려보는 것을 권장
▫ 파라미터 뿐만 아니라, 모델 형태에도 적용 가능
 Embedding visualization
▫ 표현하기 힘든 내용은 가시화!
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 51

Q & A
Any Questions?
[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 52

Contenu connexe

Tendances

Introduction to Apache Tajo: Future of Data Warehouse

Jihoon Son

Google's Dremel

Maria Stylianou

Hadoop Architecture in Depth

Syed Hadoop

Improve Presto Architectural Decisions with Shadow Cache

Alluxio, Inc.

Toronto meetup 20190917

Bill Liu

Strata NYC 2015: Sketching Big Data with Spark: randomized algorithms for lar...

Databricks

Data Science Stack with MongoDB and RStudio

Winston Chen

This slide was presented at the SK Telecom T Developer Forum. It contains the brief evaluation results of the query execution performance of Tajo on Swift. I conducted two kinds of experiments; The first experiment was to compare the performance of Tajo with on another distributed storage, i.e., HDFS. And the second experiment was the scalability test of Swift. Interestingly, the scan performance on Swift is slower more than two times than that on HDFS. In addition, the task scheduling time on Swift is much greater than that on HDFS, which means the query initialization cost is very high.

Apache Tajo on Swift: Bringing SQL to the OpenStack World

Jihoon Son

Lightning Talk: MongoDB Migration Strategies

MongoDB

SchemEX - Creating the Yellow Pages for the Linked Open Data Cloud

Ansgar Scherp

HTrace is a new Apache incubator project which makes it much easier to diagnose and detect performance problems in HBase. It provides a unified view of the performance of requests, following them from their origin in the HBase client, through the HBase region servers, and finally into HDFS. System administrators can use a central web interface to query and view aggregate performance information for the whole cluster. This talk will cover the motivations for creating HTrace, its design, and some examples of how HTrace can help diagnose real-world HBase problems.

HBaseCon 2015: Solving HBase Performance Problems with Apache HTrace

HBaseCon

This talk will go over how to build an end-to-end data processing system in Python, from data ingest, to data analytics, to machine learning, to user presentation. Developments in old and new tools have made this particularly possible today. The talk in particular will talk about Airflow for process workflows, PySpark for data processing, Python data science libraries for machine learning and advanced analytics, and building agile microservices in Python. System architects, software engineers, data scientists, and business leaders can all benefit from attending the talk. They should learn how to build more agile data processing systems and take away some ideas on how their data systems could be simpler and more powerful.

End-to-end Big Data Projects with Python - StampedeCon Big Data Conference 2017

StampedeCon

MongoDB-Migration-Strategies

andyjwoodard

RubiX

Shubham Tagra

Big data in the cloud

Ben Sullins

Query optimization in Apache Tajo

Jihoon Son

Deep dive into deeplearn.js

Kai Sasaki

Scripts that Scale with F# and mbrace.io: Nothing beats interactive scripting for productive data exploration and rapid prototyping: grab data, run code, and iterate based on feedback. However, that story starts to break down once you need to process large datasets or expensive computations. Your local machine becomes the bottleneck, and your are left with a slow and unresponsive environment. In this talk, we will demonstrate on live examples how you can have your cake and eat it, too, using mbrace.io, a free, open-source engine for scalable cloud programming. Using a simple programming model, you can keep working from your favorite scripting environment, and execute code interactively against a cluster on the Azure cloud. We will discuss the relevance of F# and mbrace in a data science and machine learning context, from parallelizing code and data processing in a functional style, to leveraging F# type providers to consume data or even run R packages.

Mathias Brandewinder, Software Engineer & Data Scientist, Clear Lines Consult...

MLconf

Xephon K A Time series database with multiple backends

University of California, Santa Cruz

As simple as Apache Spark

Data Science Warsaw

Tendances (20)

Introduction to Apache Tajo: Future of Data Warehouse

Google's Dremel

Hadoop Architecture in Depth

Improve Presto Architectural Decisions with Shadow Cache

Toronto meetup 20190917

Strata NYC 2015: Sketching Big Data with Spark: randomized algorithms for lar...

Data Science Stack with MongoDB and RStudio

Apache Tajo on Swift: Bringing SQL to the OpenStack World

Lightning Talk: MongoDB Migration Strategies

SchemEX - Creating the Yellow Pages for the Linked Open Data Cloud

HBaseCon 2015: Solving HBase Performance Problems with Apache HTrace

End-to-end Big Data Projects with Python - StampedeCon Big Data Conference 2017

MongoDB-Migration-Strategies

RubiX

Big data in the cloud

Query optimization in Apache Tajo

Deep dive into deeplearn.js

Mathias Brandewinder, Software Engineer & Data Scientist, Clear Lines Consult...

Xephon K A Time series database with multiple backends

As simple as Apache Spark

En vedette

Lecture5 Expert Systems And Artificial Intelligence

Kodok Ngorex

Introduction to CLIPS Expert System

Motaz Saad

Expert Systems

osmancikk

Expert Systems

sadeenedian08

Electricity price forecasting with Recurrent Neural Networks

Taegyun Jeon

텐서플로우 설치도 했고 튜토리얼도 봤고 기초 예제도 짜봤다면 TensorFlow KR Meetup 2016

Taehoon Kim

En vedette (6)

Lecture5 Expert Systems And Artificial Intelligence

Introduction to CLIPS Expert System

Expert Systems

Electricity price forecasting with Recurrent Neural Networks

텐서플로우 설치도 했고 튜토리얼도 봤고 기초 예제도 짜봤다면 TensorFlow KR Meetup 2016

Similaire à Google Dev Summit Extended Seoul - TensorFlow: Tensorboard & Keras

This Edureka TensorFlow Tutorial (Blog: https://goo.gl/HTE7uB) will help you in understanding various important basics of TensorFlow. It also includes a use-case in which we will create a model that will differentiate between a rock and a mine using TensorFlow. Below are the topics covered in this tutorial: 1. What are Tensors? 2. What is TensorFlow? 3. TensorFlow Code-basics 4. Graph Visualization 5. TensorFlow Data structures 6. Use-Case Naval Mine Identifier (NMI)

TensorFlow Tutorial | Deep Learning Using TensorFlow | TensorFlow Tutorial Py...

Edureka!

Anthony Hsu, Jonathan Hung, and Keqiu Hu offer an overview of TensorFlow on YARN (TonY), a framework to natively run TensorFlow on Hadoop. TonY enables running TensorFlow distributed training as a new type of Hadoop application. Its native Hadoop connector, together with other features, aims to run TensorFlow jobs as reliably and flexibly as other applications on Hadoop. Video: https://youtu.be/sIfnsU-5jHM

TonY: Native support of TensorFlow on Hadoop

Anthony Hsu

Container orchestration: the cold war - Giulio De Donato - Codemotion Rome 2017

Codemotion

Why LaTeX

Jaspreet Sarao

Callbacks part2

Alireza AkhavanPour

Tensorflow in production with AWS Lambda

Fabian Dubois

http://pipeline.io Title PipelineAI Distributed Spark ML + Tensorflow AI + GPU Workshop *A GPU-based cloud instance will be provided to each attendee as part of this event Highlights We will each build an end-to-end, continuous Tensorflow AI model training and deployment pipeline on our own GPU-based cloud instance. At the end, we will combine our cloud instances to create the LARGEST Distributed Tensorflow AI Training and Serving Cluster in the WORLD! Pre-requisites Just a modern browser, internet connection, and a good night's sleep! We'll provide the rest. Agenda Spark ML TensorFlow AI Storing and Serving Models with HDFS Trade-offs of CPU vs. *GPU, Scale Up vs. Scale Out CUDA + cuDNN GPU Development Overview TensorFlow Model Checkpointing, Saving, Exporting, and Importing Distributed TensorFlow AI Model Training (Distributed Tensorflow) TensorFlow's Accelerated Linear Algebra Framework (XLA) TensorFlow's Just-in-Time (JIT) Compiler, Ahead of Time (AOT) Compiler Centralized Logging and Visualizing of Distributed TensorFlow Training (Tensorboard) Distributed Tensorflow AI Model Serving/Predicting (TensorFlow Serving) Centralized Logging and Metrics Collection (Prometheus, Grafana) Continuous TensorFlow AI Model Deployment (TensorFlow, Airflow) Hybrid Cross-Cloud and On-Premise Deployments (Kubernetes) High-Performance and Fault-Tolerant Micro-services (NetflixOSS) Bio Chris Fregly is Founder and Research Engineer at PipelineIO, a Streaming Machine Learning and Artificial Intelligence Startup based in San Francisco. He is also an Apache Spark Contributor, a Netflix Open Source Committer, founder of the Global Advanced Spark and TensorFlow Meetup, author of the O’Reilly Training and Video Series titled, "High Performance TensorFlow in Production." Previously, Chris was a Distributed Systems Engineer at Netflix, a Data Solutions Engineer at Databricks, and a Founding Member and Principal Engineer at the IBM Spark Technology Center in San Francisco. Github Repo https://github.com/fluxcapacitor/pipeline Video https://youtu.be/oNf3I1fVmg8

High Performance Distributed TensorFlow with GPUs - NYC Workshop - July 9 2017

Chris Fregly

이 발표에서는 TensorFlow의 지난 1년을 간단하게 돌아보고, TensorFlow의 차기 로드맵에 따라 개발 및 도입될 예정인 여러 기능들을 소개합니다. 또한 2017년 및 2018년의 머신러닝 프레임워크 개발 트렌드와 방향에 대한 이야기도 함께 합니다. In this talk, I look back the TensorFlow development over the past year. Then discusses the overall development direction of machine learning frameworks, with an introduction to features that will be added to TensorFlow later on.

The Flow of TensorFlow

Jeongkyu Shin

Terraform AWS modules and some best-practices - May 2019

Anton Babenko

GitHub as a Landing Page

Pronovix

One of the challenges faced at enterprise SEO level is often the legacy platforms and tech stacks that you inherit. Finding a cost-effective way of implementing international SEO best practice is often a barrier to internationalisation. Edge technology is creating new opportunities to optimise websites independently of the inherited technological barriers. In this session, SALT.agency’s Dan Taylor will explore their findings from implementing Hreflang using cutting edge technology to remove these barriers.

TechSEO Boost 2018: Implementing Hreflang on Legacy Tech Stacks Using Service...

Catalyst

DevOps-Redefining your IT Strategy-28thJan15

Edureka!

OpenStack Trove Update - Juno, Kilo and Beyond

OpenStack_Online

Overview of TensorFlow For Natural Language Processing

ananth

Docker + Tenserflow + GOlang - Golang singapore Meetup

sangam biradar

Terraform 0.12 + Terragrunt

Anton Babenko

In recent releases, TensorFlow has been enhanced for distributed learning and HDFS access. Outside of the Google cloud, however, users still needed a dedicated cluster for TensorFlow applications. There are several community projects wiring TensorFlow onto Apache Spark clusters. Unfortunately, they are limited to support synchronous distributed learning only, and don’t allow TensorFlow servers to communicate with each other directly. In this talk, we will introduce a new framework, TensorFlowOnSpark, for scalable TensorFlow learning, which will be open sourced in Q1 2017. This new framework enables easy experimentation for algorithm designs, and supports scalable training & inferencing on Spark clusters. It supports all TensorFlow functionalities including synchronous & asynchronous learning, model & data parallelism, and TensorBoard. It provides architectural flexibility for data ingestion to TensorFlow and network protocols for server-to-server communication. With a few lines of code changes, an existing TensorFlow algorithm can be transformed into a scalable application.

TensorFlowOnSpark: Scalable TensorFlow Learning on Spark Clusters

DataWorks Summit

Basics of LaTeX

Jaspreet Sarao

http://pipeline.ai Title PipelineAI Distributed Spark ML + Tensorflow AI + GPU Workshop *A GPU-based cloud instance will be provided to each attendee as part of this event Highlights We will each build an end-to-end, continuous Tensorflow AI model training and deployment pipeline on our own GPU-based cloud instance. At the end, we will combine our cloud instances to create the LARGEST Distributed Tensorflow AI Training and Serving Cluster in the WORLD! Agenda Spark ML Tensorflow AI Storing and Serving Models with HDFS Trade-offs of CPU vs. *GPU, Scale Up vs. Scale Out CUDA + cuDNN GPU Development Overview Tensorflow Model Checkpointing, Saving, Exporting, and Importing Distributed Tensorflow AI Model Training (Distributed Tensorflow) Centralized Logging and Visualizing of Distributed Tensorflow Training (Tensorboard) Distributed Tensorflow AI Model Serving/Predicting (Tensorflow Serving) Centralized Logging and Metrics Collection (Prometheus, Grafana) Continuous Tensorflow AI Model Deployment (Tensorflow, Airflow) Hybrid Cross-Cloud and On-Premise Deployments (Kubernetes) High-Performance and Fault-Tolerant Microsservices using Request Batching and Circuit Breakers (NetflixOSS) Github Repo https://github.com/fluxcapacitor/pipeline

High Performance TensorFlow in Production -- Sydney ML / AI Train Workshop @ ...

Chris Fregly

Webinar: DevOps - Redefining your IT Strategy

Edureka!

Similaire à Google Dev Summit Extended Seoul - TensorFlow: Tensorboard & Keras (20)

TensorFlow Tutorial | Deep Learning Using TensorFlow | TensorFlow Tutorial Py...

TonY: Native support of TensorFlow on Hadoop

Container orchestration: the cold war - Giulio De Donato - Codemotion Rome 2017

Why LaTeX

Callbacks part2

Tensorflow in production with AWS Lambda

High Performance Distributed TensorFlow with GPUs - NYC Workshop - July 9 2017

The Flow of TensorFlow

Terraform AWS modules and some best-practices - May 2019

GitHub as a Landing Page

TechSEO Boost 2018: Implementing Hreflang on Legacy Tech Stacks Using Service...

DevOps-Redefining your IT Strategy-28thJan15

OpenStack Trove Update - Juno, Kilo and Beyond

Overview of TensorFlow For Natural Language Processing

Docker + Tenserflow + GOlang - Golang singapore Meetup

Terraform 0.12 + Terragrunt

TensorFlowOnSpark: Scalable TensorFlow Learning on Spark Clusters

Basics of LaTeX

High Performance TensorFlow in Production -- Sydney ML / AI Train Workshop @ ...

Webinar: DevOps - Redefining your IT Strategy

Plus de Taegyun Jeon

TensorFlow-KR 3rd meetup - Lightning Talk for SI Analytics

Taegyun Jeon

TensorFlow Dev Summit 2018 Extended: TensorFlow Eager Execution

Taegyun Jeon

[OSGeo-KR Tech Workshop] Deep Learning for Single Image Super-Resolution

Taegyun Jeon

[PR12] PR-063: Peephole predicting network performance before training

Taegyun Jeon

GDG DevFest Xiamen 2017

Taegyun Jeon

[PR12] PR-050: Convolutional LSTM Network: A Machine Learning Approach for Pr...

Taegyun Jeon

GDG DevFest Seoul 2017: Codelab - Time Series Analysis for Kaggle using Tenso...

Taegyun Jeon

[PR12] PR-036 Learning to Remember Rare Events

Taegyun Jeon

[대전AI포럼] 위성영상 분석 기술 개발 현황 소개

Taegyun Jeon

PR-026: Notes for CVPR Machine Learning Session Paper 1: Borrowing Treasures From the Wealthy: Deep Transfer Learning Through Selective Joint Fine-Tuning, https://arxiv.org/abs/1702.08690 Paper 2: The More You Know: Using Knowledge Graphs for Image Classification, https://arxiv.org/abs/1612.04844 Paper 3: On Compressing Deep Models by Low Rank and Sparse Decomposition, http://openaccess.thecvf.com/content_cvpr_2017/papers/Yu_On_Compressing_Deep_CVPR_2017_paper.pdf

[PR12] PR-026: Notes for CVPR Machine Learning Sessions

Taegyun Jeon

[PR12] You Only Look Once (YOLO): Unified Real-Time Object Detection

Taegyun Jeon

[PR12] image super resolution using deep convolutional networks

Taegyun Jeon

TensorFlow KR 2nd Meetup - Lightening talk (Satrec Initiative)

Taegyun Jeon

인공지능: 변화와 능력개발

Taegyun Jeon

Plus de Taegyun Jeon (14)

TensorFlow-KR 3rd meetup - Lightning Talk for SI Analytics

TensorFlow Dev Summit 2018 Extended: TensorFlow Eager Execution

[OSGeo-KR Tech Workshop] Deep Learning for Single Image Super-Resolution

[PR12] PR-063: Peephole predicting network performance before training

GDG DevFest Xiamen 2017

[PR12] PR-050: Convolutional LSTM Network: A Machine Learning Approach for Pr...

GDG DevFest Seoul 2017: Codelab - Time Series Analysis for Kaggle using Tenso...

[PR12] PR-036 Learning to Remember Rare Events

[대전AI포럼] 위성영상 분석 기술 개발 현황 소개

[PR12] PR-026: Notes for CVPR Machine Learning Sessions

[PR12] You Only Look Once (YOLO): Unified Real-Time Object Detection

[PR12] image super resolution using deep convolutional networks

TensorFlow KR 2nd Meetup - Lightening talk (Satrec Initiative)

인공지능: 변화와 능력개발

Dernier

Engineering Drawing focus on projection of planes

RAJNEESHKUMAR341697

LECTURE 01 Introduction to Computers Computers in Society Components of a Computer Types of Computers Definition: “A computer is an electronic device that manipulates information, or data. It has the ability to store, retrieve, and process data” The word "computer" is derived from the Latin word "computare," which means "to calculate" Computers are used for Businesses Communication Entertainment Education Medical Field

Computer Lecture 01.pptxIntroduction to Computers

MairaAshraf6

Wadi Rum luxhotel lodge Analysis case study.pptx

NadaHaitham1

GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE

selvakumar948

HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx

SCMS School of Architecture

Model Call Girl Services in Delhi reach out to us at 🔝 9953056974🔝✔️✔️ Our agency presents a selection of young, charming call girls available for bookings at Oyo Hotels. Experience high-class escort services at pocket-friendly rates, with our female escorts exuding both beauty and a delightful personality, ready to meet your desires. Whether it's Housewives, College girls, Russian girls, Muslim girls, or any other preference, we offer a diverse range of options to cater to your tastes. We provide both in- call and out-call services for your convenience. Our in-call location in Delhi ensures cleanliness, hygiene, and 100% safety, while our out-call services offer doorstep delivery for added ease. We value your time and money, hence we kindly request pic collectors, time-passers, and bargain hunters to refrain from contacting us. Our services feature various packages at competitive rates: One shot: ₹2000/in-call, ₹5000/out-call Two shots with one girl: ₹3500 /in-call, ₱6000/out-call Body to body massage with sex: ₱3000/in-call Full night for one person: ₱7000/in-call, ₱10000/out-call Full night for more than 1 person : Contact us at 🔝 9953056974🔝. for details Operating 24/7, we serve various locations in Delhi, including Green Park, Lajpat Nagar, Saket, and Hauz Khas near metro stations. For premium call girl services in Delhi 🔝 9953056974🔝. Thank you for considering us

Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7

9953056974 Low Rate Call Girls In Saket, Delhi NCR

Introduction to Serverless with AWS Lambda

Omar Fathy

Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRLS IN bhubaneswar ESCORT SERVICE❤CALL GIRL No Advance Pay 💋💋 Book Now +91-9777949614 Discover Bhubaneswar Finest Call GirlsY ou're heading to Bhubaneswar for business or pleasure and want to experience the city to the fullest. What better way than in the company of a beautiful, intelligent companion to show you around town? Look no further than Bhubaneswar's finest Call Girls. These lovely ladies know all the hot spots and hidden gems that only locals are privy to. From the top restaurants and bars to the most stunning sights, they'll ensure you make unforgettable memories.

Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...

Call Girls Mumbai

From customer value engagements to hands-on production support, our Services span across every stage of our customers digital transformation journey, to help ensure that every customer is successful in their adoption of our solutions. • Implementation, Upgrade, Migration, and Maintenance Services • On-Premises and On-Cloud • COTS Training Services; On-Site and Virtual • Software Support Services; Legacy and 3DEXPERIENCE • Value Engagement & Blueprinting • Specialized Consulting and Support Services • Customized Training Services • Automation and Configuration Services • Technical Resource Augmentation Services • Project Management • Know-how Training (mentoring) and Resource Augmentation

Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...

Arindam Chakraborty, Ph.D., P.E. (CA, TX)

The purpose of Integrated Test Rig is to assess performance of Fuel Cooled Oil Cooler (FCOC), HP Pump & Oil Pump prior to fitment on Aero Engine. The design of rig is such that it can cater to individual testing of individual LRU or integrated testing of all the LRU’s installed together (in combination). The pumps under test shall be mounted directly on the high-speed electric motor flange through adapter quill shaft assembly. Variable speed drives shall be provided for all the pumps under testing. The rig shall cater for real time monitoring and recording of performance parameters. KEY FEATURES Key features of this Rig are as follows: - 1. It has separate power packs for both the fluids i.e. ATF Power pack for ATF Fluid, OX Power Pack for OX-27 Oil. 2. This Rig is designed for high temperature Application. It works on 200 deg. Celsius. 3. Two Dedicated heating systems have been integrated with this Rig to raise the temperature of OX-27 Oil. 4. In both Power Packs insulated tanks are being used, which is good for safe operation and safety of operator. 5. This rig is designed in such a way, that it’s OX power pack is in its left side, ATF Power pack is in right Side and test bed is in Centre. 6. A big Test bed have been provided for smooth testing of UUT’s. 7. All piping is being insulated for safe operation and maintenance. 8. It comprises with DAQ System. 9. This rig can test several components at a time, together or separately. Application All the UUT’s are mounted on HTFE-25 Engine after successful performance testing of those. Application of this Rig are as follows: - 1. One of its application is to test LP Pump of HTFE-25. It is designed for functional testing of LP Pump. a. Free Flow Test b. Load Test 2. It is used to test HP Pump of HTFE-25. It is designed for functional testing of HP Pump. a. Free Flow Test b. Load Test 3. It is used to test Oil Pump of HTFE-25. It is designed for functional testing of Oil Pump. 4. It is used to test FCOC of HTFE-25.

Integrated Test Rig For HTFE-25 - Neometrix

Neometrix_Engineering_Pvt_Ltd

Computer Networks Basics of Network Devices

ChandrakantDivate1

PE 459 LECTURE 2- natural gas basic concepts and properties

sarkmank1

Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service

meghakumariji156

1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf

AldoGarca30

Design For Accessibility: Getting it right from the start

Quintin Balsdon

data_management_and _data_science_cheat_sheet.pdf

JiananWang21

Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx

MuhammadAsimMuhammad6

Motoring and generation Armature circuit equation for motoring and generation, Types of field excitations - separately excited, shunt and series. Open circuit characteristic of separately excited DC generator, back EMF with armature reaction, voltage build-up in a shunt generator, critical field resistance and critical speed. V-I characteristics and torque-speed characteristics of separately excited shunt and series motors. Speed control through armature voltage. Losses, load testing and back-to-back testing of DC machines

DC MACHINE-Motoring and generation, Armature circuit equation

BhangaleSonal

A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx

maisarahman1

Verification of thevenin's theorem for BEEE Lab (1).pptx

chumtiyababu

Dernier (20)

Engineering Drawing focus on projection of planes

Computer Lecture 01.pptxIntroduction to Computers

Wadi Rum luxhotel lodge Analysis case study.pptx

GEAR TRAIN- BASIC CONCEPTS AND WORKING PRINCIPLE

HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx

Call Girls in South Ex (delhi) call me [🔝9953056974🔝] escort service 24X7

Introduction to Serverless with AWS Lambda

Bhubaneswar🌹Call Girls Bhubaneswar ❤Komal 9777949614 💟 Full Trusted CALL GIRL...

Navigating Complexity: The Role of Trusted Partners and VIAS3D in Dassault Sy...

Integrated Test Rig For HTFE-25 - Neometrix

Computer Networks Basics of Network Devices

PE 459 LECTURE 2- natural gas basic concepts and properties

Tamil Call Girls Bhayandar WhatsApp +91-9930687706, Best Service

1_Introduction + EAM Vocabulary + how to navigate in EAM.pdf

Design For Accessibility: Getting it right from the start

data_management_and _data_science_cheat_sheet.pdf

Orlando’s Arnold Palmer Hospital Layout Strategy-1.pptx

DC MACHINE-Motoring and generation, Armature circuit equation

A CASE STUDY ON CERAMIC INDUSTRY OF BANGLADESH.pptx

Verification of thevenin's theorem for BEEE Lab (1).pptx

Google Dev Summit Extended Seoul - TensorFlow: Tensorboard & Keras

1. Taegyun Jeon TensorFlow Dev Summit Extended Seoul / 2017.02.22 R&D Center, Satrec Initiative TensorFlow: TensorBoard & Keras GDG Meetup in February

2. Contents  Integrating Keras & TensorFlow: The Keras Workflow, Expanded ▫ Speaker: Francois Chollet  Hands-on TensorBoard ▫ Speaker: Dandelion Mané ▫ Code & Slide: https://goo.gl/San2uR  All contents are provided from TensorFlow Dev Summit 2017 (https://events.withgoogle.com/tensorflow-dev-summit/) Page 2[TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras

3. Keras  An API spec for building deep learning models across many platforms [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 3

4. Keras의 인기 비결?  간편함  간결함  TF의 잦은 API 변경  연구자와 개발자의 의사소통 도구 [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 4

5. tf.keras  Keras는 결국 TensorFlow의 품으로!  TensorFlow layers = Keras layers  Keras Model ▫ Sequence model and functional model API  TensorFlow 기능과 통합 가능 [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 5 https://www.tensorflow.org/api_docs/python/tf/contrib/learn/Experiment

6. Keras 사용자들에게 어떤 일들이?  TensorFlow와 Keras사이에서 고민하지 않으셔도 됩니다.  TF와 Keras의 장단점을 파악해서 섞어서 쓰세요.  Distributed Training, Cloud ML, Hyperparameter setting, TF-Serving [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 6 https://blog.keras.io/keras-as-a-simplified-interface-to-tensorflow-tutorial.html

7. Keras Example: Video QA [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 7

8. Keras Example: Video QA [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 8

9. Keras Example: Video QA [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 9

10. Keras Example: Video QA [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 10

11. Keras Example: Video QA [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 11

12. Keras Example: Video QA [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 12

13. [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 13

14. Keras Example: Video QA [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 14

15. Keras Example: Visual VQA [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 15

16. More Examples  Keras Blog ▫ https://blog.keras.io/  Keras API (keras.applications) ▫ https://keras.io/applications/  Keras Example Directories ▫ https://github.com/fchollet/keras/tree/master/examples [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 16

17. Keras: Summary  TF 사용자: 손쉬운 high-level api 사용 가능  Keras 사용자: 모델만 keras로 만들고 이후 운영은 TF로 가능  버전 변경 계획 ▫ tf.contrib.keras (TF 1.1 / 올해 3월 중) ▫ tf.keras (TF 1.2) [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 17

18. TensorBoard  TensorBoard를 이용해서 얻는 장점 ▫ Debug: 내부를 알기 힘든 딥러닝 모델을 눈으로 확인 ▫ Hyperparameter Tuning ▫ Visualize inference results [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 18

19. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 19

20. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 20

21. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 21

22. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 22

23. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 23

24. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 24

25. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 25

26. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 26 엄청 복잡해보이네요

27. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 27

28. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 28

29. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 29

30. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 30

31. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 31 이제 레이어별로 깔끔해졌습니다.

32. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 32 이전과 비교해봐도 눈에 잘 들어옵니다

33. TensorBoard: MNIST Example  tf.summary.scalar [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 33  tf.summary.image  tf.summary.audio  tf.summary.histogram

34. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 34

35. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 35

36. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 36

37. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 37 정확도가 엉망이군요!

38. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 38 Cross-entropy도 뭔가 이상하죠?

39. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 39 Convolution layer가 변하지 않았음을 알 수 있습니다.

40. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 40 Histogram도 역시 마 찬가지군요

41. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 41

42. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 42

43. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 43 이제 제대로 학습이 되는군요

44. TensorBoard: MNIST Example  Hyperparameter search [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 44

45. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 45 다양한 run을 기록

46. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 46 Hyperparameter를 찾을땐 epoch을 조금만 설정해서 초기 성능만 보고 ckpt 관리 및 추가학습

47. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 47

48. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 48

49. TensorBoard: MNIST Example [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 49

50. TensorBoard [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 50

51. TensorBoard: Summary  Debug ▫ name_scope 정의와 tensor의 name 붙이기를 생활화 ▫ Summary 기능을 활용 • Scalar, Image, Audio, Histogram  Hyperparameter search ▫ 다양한 run을 짧게 돌려보는 것을 권장 ▫ 파라미터 뿐만 아니라, 모델 형태에도 적용 가능  Embedding visualization ▫ 표현하기 힘든 내용은 가시화! [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 51

52. Q & A Any Questions? [TensorFlow Dev Summit Extended] TensorFlow: TensorBoard & Keras Page 52

Google Dev Summit Extended Seoul - TensorFlow: Tensorboard & Keras

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (6)

Similaire à Google Dev Summit Extended Seoul - TensorFlow: Tensorboard & Keras

Similaire à Google Dev Summit Extended Seoul - TensorFlow: Tensorboard & Keras (20)

Plus de Taegyun Jeon

Plus de Taegyun Jeon (14)

Dernier

Dernier (20)

Google Dev Summit Extended Seoul - TensorFlow: Tensorboard & Keras