SlideShare une entreprise Scribd logo
1  sur  22
Télécharger pour lire hors ligne
Built smart service
on GCP
GliaStudio - AI Video Creation Platform
David Chen, CEO
201810
GliaCloud is a technology company
empowering every individual to use and
enjoy Artificial Intelligence and Big Data in
their daily lives.
Founded in 2015, our flagship product,
GliaStudio, is an AI video creation platform
that allows media industry to embrace the
rich video content with ease.
GliaCloud
Founder
Our CEO David Chen graduated from NCTU AI Lab in
Taiwan and has several AI related publications on
International journals. Start to use Google Cloud since
2008 and become one of the Google Cloud Developer
Experts (GDE) since 2014.
Before GliaCloud, David co-founded a startup doing
real-time bidding advertising platform and fully
focused on performance advertising. He then feels
that the current AI technology applications is quite
limited and would like to explore the possibility for
more innovations. That’s why he founded GliaCloud.
AI Video Revolution
Script Produce Voiceover Edit Export Video
Current Solution: Time consuming and labor intensive. Difficult to scale up.
Content Video
GliaStudio: Use AI to generate videos right from your contents in seconds.
Core Technology
Natural
Language
Process
Image
Recognition
Videolize
Analyze
1.NLP algorithm will go over the content and
summarize to scripts.
2.Apply Machine Learning to recognize the
corresponding image and clips.
3.Programmatic compose all material into
ready to use videos.
4.Analyze user behavior and optimize the
video output.
Our Smart Service
on GCP
Smart Brain & Smart Body
Why Micro-Service
Micro-Service
小國寡民。
使有什伯之器而不用,使民重死而不遠徙。
雖有舟輿,無所乘之,雖有甲兵,無所陳之。
使人復結繩而用之,甘其食,美其服,安其居,樂其俗。
鄰國相望,雞犬之聲相聞,民至老死,不相往來。
Source:老子道德經第八十章
Micro-Service
A properly implemented microservices-based application can achieve
the following goals:
• Define strong contracts between the various microservices.
• Allow for independent deployment cycles, including rollback.
• Facilitate concurrent, A/B release testing on subsystems.
• Minimize test automation and quality-assurance overhead.
• Improve clarity of logging and monitoring.
• Provide fine-grained cost accounting.
• Increase overall application scalability and reliability.
Source:		https://cloud.google.com/appengine/docs/standard/python/microservices-on-app-engine
Use GCP
•Why GCP? Cloud Native
Video Production x 10
1000 daily à 18000 daily
with almost the same cost
•Setup time 30sec à 3sec
•Image Size 5GB à 1.3GB
•Memory Usage 8GB à 1GB
Migrate to GCP (2017/12 ~)
Phase 1:
use GKE
Phase 2:
use gRPC and Cloud Endpoint
Cloud Native
Include:
• DevOps
• Continuous Delivery
• MicroServices
• Agile Infrastructure
• 康威定律(Conways Law)
Goal:
• Build for Scale
• Focus on Code, instead of machine
• Version Control
• Reproduce
• (Docker)
• Continuous XXX
• Early detection of early treatment
Cloud Native
Stack
•Unify	ML algorithm,	dataset	management,	training	and	testing...
[GBrain]
•GliaStudio and	other	service
[Application]
•Unify dev/prod	env for	micro-services	python-applications
•Protocol	&	APIs	format,	common	packages,	design	patterns,	logging	&	notifications,	...
•Based	on	gRPC	+	Cloud	Endpoint
[GEnv]
•Handle	common	env setup
Docker
•Unify env for	micro-service	deployment	
•security,	common	image	(ffmpeg),	os,	other	service	(db,	cache,	…)
[G8s]	à KNative,	Istio
•Handle	common	DevOps	tasks
•deployment,	networking,	scale	and	recover		
K8S	(GKE)
•GCP
VM
PAAS / FAAS
Micro-service
Phase 1
Phase 2
Phase 3
G8S
Build GAE on GKE
Why:
• Configure/deploy are painful
• Configure 1 deployment vs configure 1X deployment
• How to keep everything sync?
G8S
Design
• Resource Definition:
• gstudio-master-0-1-20-5-7665985cf9-
bjdwg
• Application: a service
• Role: master / worker / admin / …
• Version: release number (git tag)
• Instance: machine
• Domain: 0-1-20-5.gstudio-master.xxxx.com
Feature:
• Continues integration / deployment /
release
• Resource allocation
• CPU, Memory, Auto Scale
• External IP (external-dns)
Cluster
Cluster
G8S
Stackdriver Monitoring Logging Trace
Error
Reporting
App
Engine
Cloud
Functions
Container
Registry
Cloud Source
Repositories
Release	SDK
Batch Processing
Container Engine
Static Node
Version	Control
Deploy
Moniter
Batch Processing
Container Engine
Preemptible Node
G8S - CLI
➜ src git:(fix-460-permissions) ✗ source ../venv/bin/activate
(venv) ➜ src git:(fix-460-permissions) ✗ g8
g8 version 0.2.28
Type: Main
String form: <src.g8.Main object at 0x10cf2ca10>
File: ~/repos/gstudio/venv/lib/python2.7/site-packages/src/g8.py
Usage: g8 -
g8 - application
g8 - backbone
g8 - build
g8 - debug
g8 - delete
g8 - deploy
g8 - dry
g8 - image-url
g8 - project
g8 - promote
g8 - pyfmt
g8 - release
g8 - scale
g8 - version
Based	on	Google	Fire
GENV
Cloud
Endpoints
GQueue
Cloud Endpoint
Media Storage
Cloud Storage
Meta Data & Workflow
Cloud SQL
Meta Data & Workflow
Cloud Datastore
Media Processing
Container Engine
Autoscaling
Asset Mgmt & Sharing
Container Engine
Autoscaling
Cloud Load
Balancing
Cloud Network
W/ Edge Cache
GENV
• Logging
• Stack Driver Logging, Error Report
• Cache
• Storage
• Cloud Storage
• RPC
• django Restful, gRPC & Cloud
Endpoint
• Type
• Attrs / Schematic / Enum
• Common Design Pattern
• Singleton / Factory
• Utility
• Test
Based on Django and Python 2 / 3
GENV - GQUEUE
Based	on	Google	Pipeline	API
Feature:
DAG for micro-service. class RecordVideo(Pipe):
def run(self, video, fps=25):
…
clips = []
# MAP
for screen in screens:
clip = yield RecordScreen(screen, fps)
clips.append(clip)
screens = yield List(*screens)
clips = yield List(*clips)
# REDUCE
yield Concat(video['audio'], screens, clips)
API
GBrain
Data Sources
Machine Learning
Model
Language Model
Container Engine
Behavior Model
Container Engine
Vision Model
Container Engine
Information
Cloud Storage
Behavior Data
Cloud SQL
Analytics
BigQuery
ETL
Cloud Dataflow
Transform Data
Normalized Data
Cloud Storage
Combined Sources
Hosted Models
Cloud Machine Learning
Customize Models
GPU
API Management
Cloud Endpoints
Google
Speech API
Google
Translation API
Stored Model
Cloud Storage
Combined Sources
Model
Enrich	your	life	with	AI.
https://gliacloud.com/

Contenu connexe

Tendances

OpenACC Monthly Highlights February 2019
OpenACC Monthly Highlights February 2019OpenACC Monthly Highlights February 2019
OpenACC Monthly Highlights February 2019NVIDIA
 
Hardening Your CI/CD Pipelines with GitOps and Continuous Security
Hardening Your CI/CD Pipelines with GitOps and Continuous SecurityHardening Your CI/CD Pipelines with GitOps and Continuous Security
Hardening Your CI/CD Pipelines with GitOps and Continuous SecurityWeaveworks
 
Paolo Kreth - Persistence layers for microservices – the converged database a...
Paolo Kreth - Persistence layers for microservices – the converged database a...Paolo Kreth - Persistence layers for microservices – the converged database a...
Paolo Kreth - Persistence layers for microservices – the converged database a...matteo mazzeri
 
Spring Cloud Kubernetes - Ryan Baxter
Spring Cloud Kubernetes - Ryan BaxterSpring Cloud Kubernetes - Ryan Baxter
Spring Cloud Kubernetes - Ryan BaxterVMware Tanzu
 
CUDA Sessions You Won't Want to Miss at GTC 2019
CUDA Sessions You Won't Want to Miss at GTC 2019CUDA Sessions You Won't Want to Miss at GTC 2019
CUDA Sessions You Won't Want to Miss at GTC 2019NVIDIA
 
Workshop Azure DevOps Repos
Workshop Azure DevOps ReposWorkshop Azure DevOps Repos
Workshop Azure DevOps ReposNorberto Enomoto
 
PKS Networking with NSX-T: You Focus on your App, We'll Take Care of the Rest!
PKS Networking with NSX-T: You Focus on your App, We'll Take Care of the Rest!PKS Networking with NSX-T: You Focus on your App, We'll Take Care of the Rest!
PKS Networking with NSX-T: You Focus on your App, We'll Take Care of the Rest!VMware Tanzu
 
Cloud Native Transformation (Alexis Richardson) - Continuous Lifecycle 2018 ...
 Cloud Native Transformation (Alexis Richardson) - Continuous Lifecycle 2018 ... Cloud Native Transformation (Alexis Richardson) - Continuous Lifecycle 2018 ...
Cloud Native Transformation (Alexis Richardson) - Continuous Lifecycle 2018 ...Weaveworks
 
Polyglot on the JVM with Graal (Japanese)
Polyglot on the JVM with Graal (Japanese)Polyglot on the JVM with Graal (Japanese)
Polyglot on the JVM with Graal (Japanese)Logico
 
Maria Guseva - The solution of merge hell in monorepo
Maria Guseva - The solution of merge hell in monorepoMaria Guseva - The solution of merge hell in monorepo
Maria Guseva - The solution of merge hell in monorepomatteo mazzeri
 
Spooky House Studios: Game development for smartwatches. Challenges and solut...
Spooky House Studios: Game development for smartwatches. Challenges and solut...Spooky House Studios: Game development for smartwatches. Challenges and solut...
Spooky House Studios: Game development for smartwatches. Challenges and solut...DevGAMM Conference
 
Running database infrastructure on containers
Running database infrastructure on containersRunning database infrastructure on containers
Running database infrastructure on containersMariaDB plc
 
Visual Studio로 Kubernetes 사용하기
Visual Studio로 Kubernetes 사용하기Visual Studio로 Kubernetes 사용하기
Visual Studio로 Kubernetes 사용하기충섭 김
 
Continuous Security for GitOps
Continuous Security for GitOpsContinuous Security for GitOps
Continuous Security for GitOpsWeaveworks
 
GitOps, Driving NGN Operations Teams 211127 #kcdgt 2021
GitOps, Driving NGN Operations Teams 211127 #kcdgt 2021GitOps, Driving NGN Operations Teams 211127 #kcdgt 2021
GitOps, Driving NGN Operations Teams 211127 #kcdgt 2021William Caban
 
GitOps for Helm Users by Scott Rigby
GitOps for Helm Users by Scott RigbyGitOps for Helm Users by Scott Rigby
GitOps for Helm Users by Scott RigbyWeaveworks
 
CUDA DLI Training Courses at GTC 2019
CUDA DLI Training Courses at GTC 2019CUDA DLI Training Courses at GTC 2019
CUDA DLI Training Courses at GTC 2019NVIDIA
 
REALITY iOSアプリを支える開発効率化
REALITY iOSアプリを支える開発効率化REALITY iOSアプリを支える開発効率化
REALITY iOSアプリを支える開発効率化gree_tech
 
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaSOverpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaSJ On The Beach
 

Tendances (20)

OpenACC Monthly Highlights February 2019
OpenACC Monthly Highlights February 2019OpenACC Monthly Highlights February 2019
OpenACC Monthly Highlights February 2019
 
Hardening Your CI/CD Pipelines with GitOps and Continuous Security
Hardening Your CI/CD Pipelines with GitOps and Continuous SecurityHardening Your CI/CD Pipelines with GitOps and Continuous Security
Hardening Your CI/CD Pipelines with GitOps and Continuous Security
 
Paolo Kreth - Persistence layers for microservices – the converged database a...
Paolo Kreth - Persistence layers for microservices – the converged database a...Paolo Kreth - Persistence layers for microservices – the converged database a...
Paolo Kreth - Persistence layers for microservices – the converged database a...
 
Spring Cloud Kubernetes - Ryan Baxter
Spring Cloud Kubernetes - Ryan BaxterSpring Cloud Kubernetes - Ryan Baxter
Spring Cloud Kubernetes - Ryan Baxter
 
CUDA Sessions You Won't Want to Miss at GTC 2019
CUDA Sessions You Won't Want to Miss at GTC 2019CUDA Sessions You Won't Want to Miss at GTC 2019
CUDA Sessions You Won't Want to Miss at GTC 2019
 
Node-RED Installer, Standalone Installer using Electron
Node-RED Installer, Standalone Installer using ElectronNode-RED Installer, Standalone Installer using Electron
Node-RED Installer, Standalone Installer using Electron
 
Workshop Azure DevOps Repos
Workshop Azure DevOps ReposWorkshop Azure DevOps Repos
Workshop Azure DevOps Repos
 
PKS Networking with NSX-T: You Focus on your App, We'll Take Care of the Rest!
PKS Networking with NSX-T: You Focus on your App, We'll Take Care of the Rest!PKS Networking with NSX-T: You Focus on your App, We'll Take Care of the Rest!
PKS Networking with NSX-T: You Focus on your App, We'll Take Care of the Rest!
 
Cloud Native Transformation (Alexis Richardson) - Continuous Lifecycle 2018 ...
 Cloud Native Transformation (Alexis Richardson) - Continuous Lifecycle 2018 ... Cloud Native Transformation (Alexis Richardson) - Continuous Lifecycle 2018 ...
Cloud Native Transformation (Alexis Richardson) - Continuous Lifecycle 2018 ...
 
Polyglot on the JVM with Graal (Japanese)
Polyglot on the JVM with Graal (Japanese)Polyglot on the JVM with Graal (Japanese)
Polyglot on the JVM with Graal (Japanese)
 
Maria Guseva - The solution of merge hell in monorepo
Maria Guseva - The solution of merge hell in monorepoMaria Guseva - The solution of merge hell in monorepo
Maria Guseva - The solution of merge hell in monorepo
 
Spooky House Studios: Game development for smartwatches. Challenges and solut...
Spooky House Studios: Game development for smartwatches. Challenges and solut...Spooky House Studios: Game development for smartwatches. Challenges and solut...
Spooky House Studios: Game development for smartwatches. Challenges and solut...
 
Running database infrastructure on containers
Running database infrastructure on containersRunning database infrastructure on containers
Running database infrastructure on containers
 
Visual Studio로 Kubernetes 사용하기
Visual Studio로 Kubernetes 사용하기Visual Studio로 Kubernetes 사용하기
Visual Studio로 Kubernetes 사용하기
 
Continuous Security for GitOps
Continuous Security for GitOpsContinuous Security for GitOps
Continuous Security for GitOps
 
GitOps, Driving NGN Operations Teams 211127 #kcdgt 2021
GitOps, Driving NGN Operations Teams 211127 #kcdgt 2021GitOps, Driving NGN Operations Teams 211127 #kcdgt 2021
GitOps, Driving NGN Operations Teams 211127 #kcdgt 2021
 
GitOps for Helm Users by Scott Rigby
GitOps for Helm Users by Scott RigbyGitOps for Helm Users by Scott Rigby
GitOps for Helm Users by Scott Rigby
 
CUDA DLI Training Courses at GTC 2019
CUDA DLI Training Courses at GTC 2019CUDA DLI Training Courses at GTC 2019
CUDA DLI Training Courses at GTC 2019
 
REALITY iOSアプリを支える開発効率化
REALITY iOSアプリを支える開発効率化REALITY iOSアプリを支える開発効率化
REALITY iOSアプリを支える開発効率化
 
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaSOverpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
 

Similaire à Build Smart Service on GCP - Google DevFest 2018 Taiwan

GCP Meetup #3 - Approaches to Cloud Native Architectures
GCP Meetup #3 - Approaches to Cloud Native ArchitecturesGCP Meetup #3 - Approaches to Cloud Native Architectures
GCP Meetup #3 - Approaches to Cloud Native Architecturesnine
 
Powerup & GCP | Workshop on Google Kubernetes Engine
Powerup & GCP | Workshop on Google Kubernetes EnginePowerup & GCP | Workshop on Google Kubernetes Engine
Powerup & GCP | Workshop on Google Kubernetes EnginePowerup
 
GCP - Continuous Integration and Delivery into Kubernetes with GitHub, Travis...
GCP - Continuous Integration and Delivery into Kubernetes with GitHub, Travis...GCP - Continuous Integration and Delivery into Kubernetes with GitHub, Travis...
GCP - Continuous Integration and Delivery into Kubernetes with GitHub, Travis...Oleg Shalygin
 
How google cloud platform can benefit devops?
How google cloud platform can benefit devops?How google cloud platform can benefit devops?
How google cloud platform can benefit devops?VishnuAnji
 
CI/CD on Google Cloud Platform
CI/CD on Google Cloud PlatformCI/CD on Google Cloud Platform
CI/CD on Google Cloud PlatformDevOps Indonesia
 
Webinar: End to End Security & Operations with Chainguard and Weave GitOps
Webinar: End to End Security & Operations with Chainguard and Weave GitOpsWebinar: End to End Security & Operations with Chainguard and Weave GitOps
Webinar: End to End Security & Operations with Chainguard and Weave GitOpsWeaveworks
 
gitopsthekubernetesway-201026090439.pdf
gitopsthekubernetesway-201026090439.pdfgitopsthekubernetesway-201026090439.pdf
gitopsthekubernetesway-201026090439.pdfsaraichiba2
 
Gitops: the kubernetes way
Gitops: the kubernetes wayGitops: the kubernetes way
Gitops: the kubernetes waysparkfabrik
 
Deploy 22 microservices from scratch in 30 mins with GitOps
Deploy 22 microservices from scratch in 30 mins with GitOpsDeploy 22 microservices from scratch in 30 mins with GitOps
Deploy 22 microservices from scratch in 30 mins with GitOpsOpsta
 
Securing Your App Deployments with Tunnels, OIDC, RBAC, and Progressive Deliv...
Securing Your App Deployments with Tunnels, OIDC, RBAC, and Progressive Deliv...Securing Your App Deployments with Tunnels, OIDC, RBAC, and Progressive Deliv...
Securing Your App Deployments with Tunnels, OIDC, RBAC, and Progressive Deliv...Weaveworks
 
Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...
Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...
Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...Vietnam Open Infrastructure User Group
 
Ultimate Guide to Microservice Architecture on Kubernetes
Ultimate Guide to Microservice Architecture on KubernetesUltimate Guide to Microservice Architecture on Kubernetes
Ultimate Guide to Microservice Architecture on Kuberneteskloia
 
Free GitOps Workshop (with Intro to Kubernetes & GitOps)
Free GitOps Workshop (with Intro to Kubernetes & GitOps)Free GitOps Workshop (with Intro to Kubernetes & GitOps)
Free GitOps Workshop (with Intro to Kubernetes & GitOps)Weaveworks
 
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...GoGrid Cloud Hosting
 
Webinar: Capabilities, Confidence and Community – What Flux GA Means for You
Webinar: Capabilities, Confidence and Community – What Flux GA Means for YouWebinar: Capabilities, Confidence and Community – What Flux GA Means for You
Webinar: Capabilities, Confidence and Community – What Flux GA Means for YouWeaveworks
 
Shift Deployment Security Left with Weave GitOps & Upbound’s Universal Crossp...
Shift Deployment Security Left with Weave GitOps & Upbound’s Universal Crossp...Shift Deployment Security Left with Weave GitOps & Upbound’s Universal Crossp...
Shift Deployment Security Left with Weave GitOps & Upbound’s Universal Crossp...Weaveworks
 
Modern Web Cloud Architecture based on Google Technologies
Modern Web Cloud Architecture based on Google TechnologiesModern Web Cloud Architecture based on Google Technologies
Modern Web Cloud Architecture based on Google TechnologiesMichael Ludwig
 
Google Developers Summit Tokyo - Google Cloud Platform で知る Google クラウドの「Googl...
Google Developers Summit Tokyo - Google Cloud Platform で知る Google クラウドの「Googl...Google Developers Summit Tokyo - Google Cloud Platform で知る Google クラウドの「Googl...
Google Developers Summit Tokyo - Google Cloud Platform で知る Google クラウドの「Googl...Google Cloud Platform - Japan
 

Similaire à Build Smart Service on GCP - Google DevFest 2018 Taiwan (20)

GCP Meetup #3 - Approaches to Cloud Native Architectures
GCP Meetup #3 - Approaches to Cloud Native ArchitecturesGCP Meetup #3 - Approaches to Cloud Native Architectures
GCP Meetup #3 - Approaches to Cloud Native Architectures
 
Powerup & GCP | Workshop on Google Kubernetes Engine
Powerup & GCP | Workshop on Google Kubernetes EnginePowerup & GCP | Workshop on Google Kubernetes Engine
Powerup & GCP | Workshop on Google Kubernetes Engine
 
GCP - Continuous Integration and Delivery into Kubernetes with GitHub, Travis...
GCP - Continuous Integration and Delivery into Kubernetes with GitHub, Travis...GCP - Continuous Integration and Delivery into Kubernetes with GitHub, Travis...
GCP - Continuous Integration and Delivery into Kubernetes with GitHub, Travis...
 
How google cloud platform can benefit devops?
How google cloud platform can benefit devops?How google cloud platform can benefit devops?
How google cloud platform can benefit devops?
 
CI/CD on Google Cloud Platform
CI/CD on Google Cloud PlatformCI/CD on Google Cloud Platform
CI/CD on Google Cloud Platform
 
Webinar: End to End Security & Operations with Chainguard and Weave GitOps
Webinar: End to End Security & Operations with Chainguard and Weave GitOpsWebinar: End to End Security & Operations with Chainguard and Weave GitOps
Webinar: End to End Security & Operations with Chainguard and Weave GitOps
 
gitopsthekubernetesway-201026090439.pdf
gitopsthekubernetesway-201026090439.pdfgitopsthekubernetesway-201026090439.pdf
gitopsthekubernetesway-201026090439.pdf
 
Gitops: the kubernetes way
Gitops: the kubernetes wayGitops: the kubernetes way
Gitops: the kubernetes way
 
Deploy 22 microservices from scratch in 30 mins with GitOps
Deploy 22 microservices from scratch in 30 mins with GitOpsDeploy 22 microservices from scratch in 30 mins with GitOps
Deploy 22 microservices from scratch in 30 mins with GitOps
 
Securing Your App Deployments with Tunnels, OIDC, RBAC, and Progressive Deliv...
Securing Your App Deployments with Tunnels, OIDC, RBAC, and Progressive Deliv...Securing Your App Deployments with Tunnels, OIDC, RBAC, and Progressive Deliv...
Securing Your App Deployments with Tunnels, OIDC, RBAC, and Progressive Deliv...
 
Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...
Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...
Room 2 - 4 - Juncheng Anthony Lin - Redhat - A Practical Approach to Traditio...
 
gopaddle-meetup
gopaddle-meetupgopaddle-meetup
gopaddle-meetup
 
Ultimate Guide to Microservice Architecture on Kubernetes
Ultimate Guide to Microservice Architecture on KubernetesUltimate Guide to Microservice Architecture on Kubernetes
Ultimate Guide to Microservice Architecture on Kubernetes
 
Free GitOps Workshop (with Intro to Kubernetes & GitOps)
Free GitOps Workshop (with Intro to Kubernetes & GitOps)Free GitOps Workshop (with Intro to Kubernetes & GitOps)
Free GitOps Workshop (with Intro to Kubernetes & GitOps)
 
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
GoGrid 3.0 Webinar: Complex Infrastructure Made Easy - Learn About the GoGrid...
 
Balaji Resume
Balaji ResumeBalaji Resume
Balaji Resume
 
Webinar: Capabilities, Confidence and Community – What Flux GA Means for You
Webinar: Capabilities, Confidence and Community – What Flux GA Means for YouWebinar: Capabilities, Confidence and Community – What Flux GA Means for You
Webinar: Capabilities, Confidence and Community – What Flux GA Means for You
 
Shift Deployment Security Left with Weave GitOps & Upbound’s Universal Crossp...
Shift Deployment Security Left with Weave GitOps & Upbound’s Universal Crossp...Shift Deployment Security Left with Weave GitOps & Upbound’s Universal Crossp...
Shift Deployment Security Left with Weave GitOps & Upbound’s Universal Crossp...
 
Modern Web Cloud Architecture based on Google Technologies
Modern Web Cloud Architecture based on Google TechnologiesModern Web Cloud Architecture based on Google Technologies
Modern Web Cloud Architecture based on Google Technologies
 
Google Developers Summit Tokyo - Google Cloud Platform で知る Google クラウドの「Googl...
Google Developers Summit Tokyo - Google Cloud Platform で知る Google クラウドの「Googl...Google Developers Summit Tokyo - Google Cloud Platform で知る Google クラウドの「Googl...
Google Developers Summit Tokyo - Google Cloud Platform で知る Google クラウドの「Googl...
 

Plus de David Chen

python small tools for CI and team cooperation
python small tools for CI and team cooperationpython small tools for CI and team cooperation
python small tools for CI and team cooperationDavid Chen
 
Tops for Lean Startup
Tops for Lean StartupTops for Lean Startup
Tops for Lean StartupDavid Chen
 
Case study of Google Cloud Platform
Case study of Google Cloud PlatformCase study of Google Cloud Platform
Case study of Google Cloud PlatformDavid Chen
 
Talk in Google fest 2013
Talk in Google fest 2013Talk in Google fest 2013
Talk in Google fest 2013David Chen
 
AppEngine Performance Tuning
AppEngine Performance TuningAppEngine Performance Tuning
AppEngine Performance TuningDavid Chen
 
doT.py - a python template engine.
doT.py - a python template engine.doT.py - a python template engine.
doT.py - a python template engine.David Chen
 
Final presentation for mobile strategy
Final presentation for mobile strategyFinal presentation for mobile strategy
Final presentation for mobile strategyDavid Chen
 
Gam Documentation
Gam DocumentationGam Documentation
Gam DocumentationDavid Chen
 
Gam Documentation
Gam DocumentationGam Documentation
Gam DocumentationDavid Chen
 

Plus de David Chen (12)

python small tools for CI and team cooperation
python small tools for CI and team cooperationpython small tools for CI and team cooperation
python small tools for CI and team cooperation
 
Big datalab
Big datalabBig datalab
Big datalab
 
Tops for Lean Startup
Tops for Lean StartupTops for Lean Startup
Tops for Lean Startup
 
Case study of Google Cloud Platform
Case study of Google Cloud PlatformCase study of Google Cloud Platform
Case study of Google Cloud Platform
 
Talk in Google fest 2013
Talk in Google fest 2013Talk in Google fest 2013
Talk in Google fest 2013
 
AppEngine Performance Tuning
AppEngine Performance TuningAppEngine Performance Tuning
AppEngine Performance Tuning
 
doT.py - a python template engine.
doT.py - a python template engine.doT.py - a python template engine.
doT.py - a python template engine.
 
Final presentation for mobile strategy
Final presentation for mobile strategyFinal presentation for mobile strategy
Final presentation for mobile strategy
 
長庚大學
長庚大學長庚大學
長庚大學
 
GAM Slide
GAM SlideGAM Slide
GAM Slide
 
Gam Documentation
Gam DocumentationGam Documentation
Gam Documentation
 
Gam Documentation
Gam DocumentationGam Documentation
Gam Documentation
 

Dernier

FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfMarinCaroMartnezBerg
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysismanisha194592
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改atducpo
 
Ukraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSUkraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSAishani27
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxolyaivanovalion
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023ymrp368
 
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiSuhani Kapoor
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...Suhani Kapoor
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxolyaivanovalion
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxJohnnyPlasten
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionfulawalesam
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxolyaivanovalion
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystSamantha Rae Coolbeth
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationshipsccctableauusergroup
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxStephen266013
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxolyaivanovalion
 

Dernier (20)

FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
 
Ukraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICSUkraine War presentation: KNOW THE BASICS
Ukraine War presentation: KNOW THE BASICS
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 
Data-Analysis for Chicago Crime Data 2023
Data-Analysis for Chicago Crime Data  2023Data-Analysis for Chicago Crime Data  2023
Data-Analysis for Chicago Crime Data 2023
 
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service AmravatiVIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
VIP Call Girls in Amravati Aarohi 8250192130 Independent Escort Service Amravati
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
 
Week-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interactionWeek-01-2.ppt BBB human Computer interaction
Week-01-2.ppt BBB human Computer interaction
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data Analyst
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
 
B2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docxB2 Creative Industry Response Evaluation.docx
B2 Creative Industry Response Evaluation.docx
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 

Build Smart Service on GCP - Google DevFest 2018 Taiwan

  • 1. Built smart service on GCP GliaStudio - AI Video Creation Platform David Chen, CEO 201810
  • 2. GliaCloud is a technology company empowering every individual to use and enjoy Artificial Intelligence and Big Data in their daily lives. Founded in 2015, our flagship product, GliaStudio, is an AI video creation platform that allows media industry to embrace the rich video content with ease. GliaCloud
  • 3. Founder Our CEO David Chen graduated from NCTU AI Lab in Taiwan and has several AI related publications on International journals. Start to use Google Cloud since 2008 and become one of the Google Cloud Developer Experts (GDE) since 2014. Before GliaCloud, David co-founded a startup doing real-time bidding advertising platform and fully focused on performance advertising. He then feels that the current AI technology applications is quite limited and would like to explore the possibility for more innovations. That’s why he founded GliaCloud.
  • 4. AI Video Revolution Script Produce Voiceover Edit Export Video Current Solution: Time consuming and labor intensive. Difficult to scale up. Content Video GliaStudio: Use AI to generate videos right from your contents in seconds.
  • 5. Core Technology Natural Language Process Image Recognition Videolize Analyze 1.NLP algorithm will go over the content and summarize to scripts. 2.Apply Machine Learning to recognize the corresponding image and clips. 3.Programmatic compose all material into ready to use videos. 4.Analyze user behavior and optimize the video output.
  • 6. Our Smart Service on GCP Smart Brain & Smart Body
  • 9. Micro-Service A properly implemented microservices-based application can achieve the following goals: • Define strong contracts between the various microservices. • Allow for independent deployment cycles, including rollback. • Facilitate concurrent, A/B release testing on subsystems. • Minimize test automation and quality-assurance overhead. • Improve clarity of logging and monitoring. • Provide fine-grained cost accounting. • Increase overall application scalability and reliability. Source: https://cloud.google.com/appengine/docs/standard/python/microservices-on-app-engine
  • 10. Use GCP •Why GCP? Cloud Native Video Production x 10 1000 daily à 18000 daily with almost the same cost •Setup time 30sec à 3sec •Image Size 5GB à 1.3GB •Memory Usage 8GB à 1GB Migrate to GCP (2017/12 ~) Phase 1: use GKE Phase 2: use gRPC and Cloud Endpoint
  • 11. Cloud Native Include: • DevOps • Continuous Delivery • MicroServices • Agile Infrastructure • 康威定律(Conways Law)
  • 12. Goal: • Build for Scale • Focus on Code, instead of machine • Version Control • Reproduce • (Docker) • Continuous XXX • Early detection of early treatment Cloud Native
  • 13. Stack •Unify ML algorithm, dataset management, training and testing... [GBrain] •GliaStudio and other service [Application] •Unify dev/prod env for micro-services python-applications •Protocol & APIs format, common packages, design patterns, logging & notifications, ... •Based on gRPC + Cloud Endpoint [GEnv] •Handle common env setup Docker •Unify env for micro-service deployment •security, common image (ffmpeg), os, other service (db, cache, …) [G8s] à KNative, Istio •Handle common DevOps tasks •deployment, networking, scale and recover K8S (GKE) •GCP VM PAAS / FAAS Micro-service Phase 1 Phase 2 Phase 3
  • 14. G8S Build GAE on GKE Why: • Configure/deploy are painful • Configure 1 deployment vs configure 1X deployment • How to keep everything sync?
  • 15. G8S Design • Resource Definition: • gstudio-master-0-1-20-5-7665985cf9- bjdwg • Application: a service • Role: master / worker / admin / … • Version: release number (git tag) • Instance: machine • Domain: 0-1-20-5.gstudio-master.xxxx.com Feature: • Continues integration / deployment / release • Resource allocation • CPU, Memory, Auto Scale • External IP (external-dns)
  • 16. Cluster Cluster G8S Stackdriver Monitoring Logging Trace Error Reporting App Engine Cloud Functions Container Registry Cloud Source Repositories Release SDK Batch Processing Container Engine Static Node Version Control Deploy Moniter Batch Processing Container Engine Preemptible Node
  • 17. G8S - CLI ➜ src git:(fix-460-permissions) ✗ source ../venv/bin/activate (venv) ➜ src git:(fix-460-permissions) ✗ g8 g8 version 0.2.28 Type: Main String form: <src.g8.Main object at 0x10cf2ca10> File: ~/repos/gstudio/venv/lib/python2.7/site-packages/src/g8.py Usage: g8 - g8 - application g8 - backbone g8 - build g8 - debug g8 - delete g8 - deploy g8 - dry g8 - image-url g8 - project g8 - promote g8 - pyfmt g8 - release g8 - scale g8 - version Based on Google Fire
  • 18. GENV Cloud Endpoints GQueue Cloud Endpoint Media Storage Cloud Storage Meta Data & Workflow Cloud SQL Meta Data & Workflow Cloud Datastore Media Processing Container Engine Autoscaling Asset Mgmt & Sharing Container Engine Autoscaling Cloud Load Balancing Cloud Network W/ Edge Cache
  • 19. GENV • Logging • Stack Driver Logging, Error Report • Cache • Storage • Cloud Storage • RPC • django Restful, gRPC & Cloud Endpoint • Type • Attrs / Schematic / Enum • Common Design Pattern • Singleton / Factory • Utility • Test Based on Django and Python 2 / 3
  • 20. GENV - GQUEUE Based on Google Pipeline API Feature: DAG for micro-service. class RecordVideo(Pipe): def run(self, video, fps=25): … clips = [] # MAP for screen in screens: clip = yield RecordScreen(screen, fps) clips.append(clip) screens = yield List(*screens) clips = yield List(*clips) # REDUCE yield Concat(video['audio'], screens, clips)
  • 21. API GBrain Data Sources Machine Learning Model Language Model Container Engine Behavior Model Container Engine Vision Model Container Engine Information Cloud Storage Behavior Data Cloud SQL Analytics BigQuery ETL Cloud Dataflow Transform Data Normalized Data Cloud Storage Combined Sources Hosted Models Cloud Machine Learning Customize Models GPU API Management Cloud Endpoints Google Speech API Google Translation API Stored Model Cloud Storage Combined Sources Model