SlideShare une entreprise Scribd logo
1  sur  47
Varun Kumar
Senior Consultant,
Cloud Engineering
Background
Varun Kumar is a Senior Consultant with Deloitte SEA & AWS APN Ambassador. He is a
cloud professional over 8 plus years of diversified experience in DevOps.
• Varun is also a Research Scholar, published three research papers, including IEEE. His
research area & topic was virtualization and Hypervisors.
• He is a Technical Blogger, wrote many blogs about AWS cloud, DevOps. DevSecOps,
MLOps and in general cloud computing topics.
• He is a professional cloud trainer, delivered many training across the globe and share
his knowledge toward community which includes collage students, fresher's and
Corporate professionals.
Please find more details:
• https://www.linkedin.com/in/vkmanik/
• https://medium.com/@varunmanik1
• https://www.facebook.com/cloudvirtualization/
• https://twitter.com/varunkmanik/
• https://www.youtube.com/channel/UCcuMPYJ4Osax4528rgqQWrw
Qualifications and Professional Affiliations
Qualification:
• Master Degree in Computer Science.
Professional Certificate:
• AWS Certified Solutions Architect - Professional
• AWS Certified Developer – Associate
• AWS Certified SysOps - Associate
• AWS Certified Solution Architect – Associate
• AWS Certified Practitioner
• Red Hat Certificate of Expertise in Ansible Automation
Notable Recent Experiences
• Cloud migration lead at a large media company based in South East Asia, providing ongoing
consulting, improvement feedback, and cloud expertise to this team for implementation of
DevOps practices and migration of their CRM/billing systems to cloud.
• Building DevOps, DevSecOps, MLOps capabilities and Automation labs within the organization
by implementing various tools for Continuous Integration (CI), Continuous Deployment (CD)
and Continuous Assessment (CA) for multiple accounts.
• Lead the automation team, Automate daily Cloud tasks in DevOps Tools, Create & configure
automation of AWS resources with DevOps best practice to enhance the CICD (Continuous
Integration and Continuous Delivery) process for the organization.
• Built the DevOps, DevSecOps, DevFinOps practice within the organization and enabled a
DevOps champion in every product team, leading to cohesive standards and capabilities in
these areas.
Index
- Introduction of Machine learning
• Using Jupyter Notebook 15 min
• AWS SageMaker 15 min
• Sentiment analysis 15 min
• Break 10 min
- Overview of a Use case
• Model Deployment 15 min
• Examining deployed model performance 10 min
- Setup New Project Copilot
• Setup and Run the Build CI/CD Pipeline 15 min
• Setup the Release Pipeline 15 min
• Break 10 min
• Test Build and Release Pipelines 15 min
• Testing the deployed solution 15 min
What is ML….?
• What are the different types in machine learning?
• What are the different algorithms available for developing machine learning models?
• What tools are available for developing these models?
• What are the programming language choices?
• What platforms support development and deployment of Machine Learning applications?
• How to quickly upgrade your skills in this important area?
Applications of Machines Learning
Machine Learning is the most rapidly growing technology and according to researchers we are in the
golden year of AI and ML. It is used to solve many real-world complex problems which cannot be
solved with traditional approach. Following are some real-world applications of ML −
• Emotion analysis
• Sentiment analysis
• Error detection and prevention
Applications of Machines Learning
• Weather forecasting and prediction
• Stock market analysis and forecasting
• Speech synthesis
• Speech recognition
• Customer segmentation
• Object recognition
• Fraud detection
• Fraud prevention
• Recommendation of products to customer in online shopping
Types of Machine Learning
Machine Learning
Supervised
Learning
Unsupervised
Learning
Reinforcement
Learning
Deep Learning
Deep Reinforcement
Learning
Algorithms for Supervised Learning
There are several algorithms available for supervised learning. Some of the widely used algorithms of
supervised learning are as shown below :
• k-Nearest Neighbours
• Decision Trees
• Naive Bayes
• Logistic Regression
• Support Vector Machine
Sentiment Analysis by Amazon Comprehend
Analyze text in real time by using built-in or custom models. With built-in models, you can recognize
entities, extract key phrases, detect dominant languages, detect PII, determine sentiment, or analyze
syntax. With custom models, you can detect entities that you define, or you can classify documents
using your own categories or labels.
Amazon Comprehend LAB
LAB
AWS Sagemaker
SageMaker Studio, a machine learning Integrated Development Environment (IDE) for building, training, and
debugging models, tracking experiments, deploying models, and monitoring their performance.
AWS Sagemaker Components
SageMaker Benefits and features
• Labeling raw data with active learning
• Highly accurate training datasets
• Fully-managed notebook instances
• Highly-optimized machine learning algorithms
• One-click training
• Deployment without engineering effort
AWS SageMaker LAB
LAB
Jupyter Notebook
• Jupyter Lab
• Note book Creation
• File Option
• Code vs Markdown
• File Upload down load
Machine Learning Use case
• Machine Learning (and in mathematics) there are often three values that interests us:
Mean - The average value
Median - The mid point value
Mode - The most common value
• Random Data Distributions
• Linear Regression
• Polynomial Regression
LAB
Artificial Neural Networks
Deep Learning uses ANN
Applications
Deep Learning has shown a lot of success in several areas of machine learning applications.
Self-driving Cars − The autonomous self-driving cars use deep learning techniques. They generally adapt to
the ever changing traffic situations and get better and better at driving over a period of time.
Speech Recognition − Another interesting application of Deep Learning is speech recognition. All of us use
several mobile apps today that are capable of recognizing our speech. Apple’s Siri, Amazon’s Alexa, Microsoft’s
Cortena and Google’s Assistant – all these use deep learning techniques.
Mobile Apps − We use several web-based and mobile apps for organizing our photos. Face detection, face ID,
face tagging, identifying objects in an image – all these use deep learning.
ML Platform & tools
Language Choice
• Python
• R
• Matlab
• Octave
• Julia
• C++
• C
IDEs
• AWS Sagemaker
• R Studio
• Pycharm
• iPython/Jupyter Notebook
• Julia
• Spyder
• Anaconda
• Rodeo
• Google –Colab
Platforms
• Amazon
• IBM
• Microsoft Azure
• Google Cloud
• Mlflow
Question & Answers….?
Break…..!
Micro Services Deployment by AWS
Copilot
Part 2
DevOps
What is Copilot…?
• The AWS Copilot command-line interface (CLI) provides application-first, high-level commands to simplify
modeling, creating, releasing, and managing production-ready containerized applications on Amazon ECS
from a local development environment.
• Provisioned with application templates, infrastructure as code, and CI/CD pipeline options, the AWS
Copilot CLI aligns with application workflows that support modern application best practices.
AWS ECS Copilot
(Auto Pilot Mode: Infra Creation and DevOps Deployment)
Copilot Building Block
Copilot CLI
Services Environment Application Pipelines Manifest
File
AWS DevOps Tools
Open Source DevOps Tools
Docker Basics
Docker Basic
1. Create EC2 Instance
2. Install Docker
3. Pull centos:centos6
4. Create index.html
5. Create Dockerfile
6. Build Docker image
Services
• Creating a Service
• Choosing a Service Type
• Load Balanced Web
Service
• Backend Service
• Config and the Manifest
• Deploying a Service
• Digging into your Service
• What's in your service?
• What's your service
status?
• Where are my service
Environment
• Creating an Environment
• Deploying a Service
• Environment Infrastructure
• VPC and Networking
• Load Balancers and DNS
• Customize your Environment
• Digging into your Environment
• What's in your environment?
Application
• Creating an App
• Additional App Configurations
• App Infrastructure
• ECR Repositories
• Release Infrastructure
• Digging into your App
• What's in my application?
AWS Infrastructure
• AWS VPC
• Subnets
• Security Group
• ECS Cluster
• ECS Service
• Fargate task
• Service Discovery
• ECR Repositories
• Application Load balancer
• ACM Certs
Pipeline
• Pipeline structure
• GitHub Source
• Build Stage
• Deploy Stages
• Creating a Pipeline in 3 steps
• Preparing the pipeline structure.
• Committing the generated buildspec.yml.
• Creating the actual CodePipeline.
Final Deployment Test and Validation
1. Push the new version of code in code
commit
2. It will automatically deploy the new
task with new version
3. At last you can run the DNS ALB on
your browser
Break…!
LAB
Command
Application
• app init
• app ls
• app show
• app delete
Environment
• env init
• env ls
• env show
• env delete
Services
• svc init
• svc ls
• svc show
• svc logs
• svc status
• svc package
• svc deploy
• svc delete
• task run
Pipeline
• pipeline init
• pipeline update
• pipeline show
• pipeline status
• pipeline delete
• deploy
Thanks…..!
Please find more details:
• https://www.linkedin.com/in/vkmanik/
• https://medium.com/@varunmanik1
• https://www.facebook.com/cloudvirtualization/
• https://twitter.com/varunkmanik/
• https://www.youtube.com/channel/UCcuMPYJ4Osax4
528rgqQWrw
Canada DevOps Summit 2020 Presentation Nov_03_2020

Contenu connexe

Tendances

AWS Certification Lessons and Tips, AWS Meetup Lehi - April 2016
AWS Certification Lessons and Tips, AWS Meetup Lehi - April 2016AWS Certification Lessons and Tips, AWS Meetup Lehi - April 2016
AWS Certification Lessons and Tips, AWS Meetup Lehi - April 2016Dan Neff
 
Application Delivery Patterns for Developers - Technical 401
Application Delivery Patterns for Developers - Technical 401Application Delivery Patterns for Developers - Technical 401
Application Delivery Patterns for Developers - Technical 401Amazon Web Services
 
Microservices Architecture for Content Management Systems using AWS Lambda an...
Microservices Architecture for Content Management Systems using AWS Lambda an...Microservices Architecture for Content Management Systems using AWS Lambda an...
Microservices Architecture for Content Management Systems using AWS Lambda an...Mitoc Group
 
Swayam_resume
Swayam_resumeSwayam_resume
Swayam_resumesomupanda
 
Hybrid Mobile Development with Apache Cordova and Java EE 7 (JavaOne 2014)
Hybrid Mobile Development with Apache Cordova and Java EE 7 (JavaOne 2014)Hybrid Mobile Development with Apache Cordova and Java EE 7 (JavaOne 2014)
Hybrid Mobile Development with Apache Cordova and Java EE 7 (JavaOne 2014)Ryan Cuprak
 
Enforcing Your Security Policy at Scale - Technical 301
Enforcing Your Security Policy at Scale - Technical 301Enforcing Your Security Policy at Scale - Technical 301
Enforcing Your Security Policy at Scale - Technical 301Amazon Web Services
 
Microservices Architecture for Web Applications using Serverless Computing wi...
Microservices Architecture for Web Applications using Serverless Computing wi...Microservices Architecture for Web Applications using Serverless Computing wi...
Microservices Architecture for Web Applications using Serverless Computing wi...Mitoc Group
 
Cloud development professional_training_module_1603813251908
Cloud development professional_training_module_1603813251908Cloud development professional_training_module_1603813251908
Cloud development professional_training_module_1603813251908prasennabhai
 
Building a DevOps Culture in Public Sector | AWS Public Sector Summit 2017
Building a DevOps Culture in Public Sector | AWS Public Sector Summit 2017Building a DevOps Culture in Public Sector | AWS Public Sector Summit 2017
Building a DevOps Culture in Public Sector | AWS Public Sector Summit 2017Amazon Web Services
 
ADF Essentials (KScope14)
ADF Essentials (KScope14)ADF Essentials (KScope14)
ADF Essentials (KScope14)Luc Bors
 
Summer training presentation on "CORE JAVA".
Summer training presentation on "CORE JAVA".Summer training presentation on "CORE JAVA".
Summer training presentation on "CORE JAVA".SudhanshuVijay3
 
Smaller is Better - Exploiting Microservice Architectures on AWS - Technical 201
Smaller is Better - Exploiting Microservice Architectures on AWS - Technical 201Smaller is Better - Exploiting Microservice Architectures on AWS - Technical 201
Smaller is Better - Exploiting Microservice Architectures on AWS - Technical 201Amazon Web Services
 
Can We Make Maps from Videos? ~From AI Algorithm to Engineering for Continuou...
Can We Make Maps from Videos? ~From AI Algorithm to Engineering for Continuou...Can We Make Maps from Videos? ~From AI Algorithm to Engineering for Continuou...
Can We Make Maps from Videos? ~From AI Algorithm to Engineering for Continuou...DeNA
 
Lunch && Learn DevHub - 6 Things to Learn to become an AWS Genius
Lunch && Learn DevHub - 6 Things to Learn to become an AWS GeniusLunch && Learn DevHub - 6 Things to Learn to become an AWS Genius
Lunch && Learn DevHub - 6 Things to Learn to become an AWS GeniusAndrew Brown
 
Scale Machine Learning from zero to millions of users (April 2020)
Scale Machine Learning from zero to millions of users (April 2020)Scale Machine Learning from zero to millions of users (April 2020)
Scale Machine Learning from zero to millions of users (April 2020)Julien SIMON
 
Aws-What You Need to Know_Simon Elisha
Aws-What You Need to Know_Simon ElishaAws-What You Need to Know_Simon Elisha
Aws-What You Need to Know_Simon ElishaHelen Rogers
 
Industrial Training Report on Java Technology.
Industrial Training Report on Java Technology.Industrial Training Report on Java Technology.
Industrial Training Report on Java Technology.Ritesh Kumar Bhanu
 

Tendances (20)

AWS Certification Lessons and Tips, AWS Meetup Lehi - April 2016
AWS Certification Lessons and Tips, AWS Meetup Lehi - April 2016AWS Certification Lessons and Tips, AWS Meetup Lehi - April 2016
AWS Certification Lessons and Tips, AWS Meetup Lehi - April 2016
 
Application Delivery Patterns for Developers - Technical 401
Application Delivery Patterns for Developers - Technical 401Application Delivery Patterns for Developers - Technical 401
Application Delivery Patterns for Developers - Technical 401
 
Microservices Architecture for Content Management Systems using AWS Lambda an...
Microservices Architecture for Content Management Systems using AWS Lambda an...Microservices Architecture for Content Management Systems using AWS Lambda an...
Microservices Architecture for Content Management Systems using AWS Lambda an...
 
Swayam_resume
Swayam_resumeSwayam_resume
Swayam_resume
 
Hybrid Mobile Development with Apache Cordova and Java EE 7 (JavaOne 2014)
Hybrid Mobile Development with Apache Cordova and Java EE 7 (JavaOne 2014)Hybrid Mobile Development with Apache Cordova and Java EE 7 (JavaOne 2014)
Hybrid Mobile Development with Apache Cordova and Java EE 7 (JavaOne 2014)
 
Enforcing Your Security Policy at Scale - Technical 301
Enforcing Your Security Policy at Scale - Technical 301Enforcing Your Security Policy at Scale - Technical 301
Enforcing Your Security Policy at Scale - Technical 301
 
Microservices Architecture for Web Applications using Serverless Computing wi...
Microservices Architecture for Web Applications using Serverless Computing wi...Microservices Architecture for Web Applications using Serverless Computing wi...
Microservices Architecture for Web Applications using Serverless Computing wi...
 
Cloud development professional_training_module_1603813251908
Cloud development professional_training_module_1603813251908Cloud development professional_training_module_1603813251908
Cloud development professional_training_module_1603813251908
 
Building a DevOps Culture in Public Sector | AWS Public Sector Summit 2017
Building a DevOps Culture in Public Sector | AWS Public Sector Summit 2017Building a DevOps Culture in Public Sector | AWS Public Sector Summit 2017
Building a DevOps Culture in Public Sector | AWS Public Sector Summit 2017
 
React Native Workshop
React Native WorkshopReact Native Workshop
React Native Workshop
 
ADF Essentials (KScope14)
ADF Essentials (KScope14)ADF Essentials (KScope14)
ADF Essentials (KScope14)
 
Summer training presentation on "CORE JAVA".
Summer training presentation on "CORE JAVA".Summer training presentation on "CORE JAVA".
Summer training presentation on "CORE JAVA".
 
Smaller is Better - Exploiting Microservice Architectures on AWS - Technical 201
Smaller is Better - Exploiting Microservice Architectures on AWS - Technical 201Smaller is Better - Exploiting Microservice Architectures on AWS - Technical 201
Smaller is Better - Exploiting Microservice Architectures on AWS - Technical 201
 
Getting to MVP on AWS
Getting to MVP on AWSGetting to MVP on AWS
Getting to MVP on AWS
 
Introduction to Core Java Programming
Introduction to Core Java ProgrammingIntroduction to Core Java Programming
Introduction to Core Java Programming
 
Can We Make Maps from Videos? ~From AI Algorithm to Engineering for Continuou...
Can We Make Maps from Videos? ~From AI Algorithm to Engineering for Continuou...Can We Make Maps from Videos? ~From AI Algorithm to Engineering for Continuou...
Can We Make Maps from Videos? ~From AI Algorithm to Engineering for Continuou...
 
Lunch && Learn DevHub - 6 Things to Learn to become an AWS Genius
Lunch && Learn DevHub - 6 Things to Learn to become an AWS GeniusLunch && Learn DevHub - 6 Things to Learn to become an AWS Genius
Lunch && Learn DevHub - 6 Things to Learn to become an AWS Genius
 
Scale Machine Learning from zero to millions of users (April 2020)
Scale Machine Learning from zero to millions of users (April 2020)Scale Machine Learning from zero to millions of users (April 2020)
Scale Machine Learning from zero to millions of users (April 2020)
 
Aws-What You Need to Know_Simon Elisha
Aws-What You Need to Know_Simon ElishaAws-What You Need to Know_Simon Elisha
Aws-What You Need to Know_Simon Elisha
 
Industrial Training Report on Java Technology.
Industrial Training Report on Java Technology.Industrial Training Report on Java Technology.
Industrial Training Report on Java Technology.
 

Similaire à Canada DevOps Summit 2020 Presentation Nov_03_2020

AWS Kochi User Group Presentation
AWS  Kochi User Group PresentationAWS  Kochi User Group Presentation
AWS Kochi User Group PresentationVarun Manik
 
Aws User Group Singapore Presentation Oct-21-2020
Aws User Group Singapore Presentation Oct-21-2020Aws User Group Singapore Presentation Oct-21-2020
Aws User Group Singapore Presentation Oct-21-2020Varun Manik
 
SRV312 DevOps on AWS: Building Systems to Deliver Faster
SRV312 DevOps on AWS: Building Systems to Deliver FasterSRV312 DevOps on AWS: Building Systems to Deliver Faster
SRV312 DevOps on AWS: Building Systems to Deliver FasterAmazon Web Services
 
DevOps for Machine Learning overview en-us
DevOps for Machine Learning overview en-usDevOps for Machine Learning overview en-us
DevOps for Machine Learning overview en-useltonrodriguez11
 
My personal story from azure it pro to azure dev ops
My personal story from azure it pro to azure dev opsMy personal story from azure it pro to azure dev ops
My personal story from azure it pro to azure dev opsnj-azure
 
Aws amity university_presentation_oct-31-2020
Aws amity university_presentation_oct-31-2020Aws amity university_presentation_oct-31-2020
Aws amity university_presentation_oct-31-2020Varun Manik
 
AWS ECS Copilot DevOps Presentation
AWS ECS Copilot DevOps PresentationAWS ECS Copilot DevOps Presentation
AWS ECS Copilot DevOps PresentationVarun Manik
 
DevOps on AWS - Building Systems to Deliver Faster
DevOps on AWS - Building Systems to Deliver FasterDevOps on AWS - Building Systems to Deliver Faster
DevOps on AWS - Building Systems to Deliver FasterAmazon Web Services
 
Application Lifecycle Management
Application Lifecycle ManagementApplication Lifecycle Management
Application Lifecycle ManagementAmazon Web Services
 
Aws Amity University Presentation Mar-10-2022
Aws Amity University Presentation Mar-10-2022Aws Amity University Presentation Mar-10-2022
Aws Amity University Presentation Mar-10-2022Varun Manik
 
Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...
Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...
Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...Ed Sattar
 
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsDevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsAmazon Web Services
 
Getting Started With Continuous Delivery on AWS - AWS April 2016 Webinar Series
Getting Started With Continuous Delivery on AWS - AWS April 2016 Webinar SeriesGetting Started With Continuous Delivery on AWS - AWS April 2016 Webinar Series
Getting Started With Continuous Delivery on AWS - AWS April 2016 Webinar SeriesAmazon Web Services
 
selenium_course_content.pdf
selenium_course_content.pdfselenium_course_content.pdf
selenium_course_content.pdfaswinisowmiya
 
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer Tools
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer ToolsA Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer Tools
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer ToolsAmazon Web Services
 
Dev ops on aws deep dive on continuous delivery - Toronto
Dev ops on aws deep dive on continuous delivery - TorontoDev ops on aws deep dive on continuous delivery - Toronto
Dev ops on aws deep dive on continuous delivery - TorontoAmazon Web Services
 
DevOps On AWS - Deep Dive on Continuous Delivery
DevOps On AWS - Deep Dive on Continuous DeliveryDevOps On AWS - Deep Dive on Continuous Delivery
DevOps On AWS - Deep Dive on Continuous DeliveryMikhail Prudnikov
 
DevOps on AWS: DevOps Day San Francisco
DevOps on AWS: DevOps Day San FranciscoDevOps on AWS: DevOps Day San Francisco
DevOps on AWS: DevOps Day San FranciscoAmazon Web Services
 

Similaire à Canada DevOps Summit 2020 Presentation Nov_03_2020 (20)

AWS Kochi User Group Presentation
AWS  Kochi User Group PresentationAWS  Kochi User Group Presentation
AWS Kochi User Group Presentation
 
Aws User Group Singapore Presentation Oct-21-2020
Aws User Group Singapore Presentation Oct-21-2020Aws User Group Singapore Presentation Oct-21-2020
Aws User Group Singapore Presentation Oct-21-2020
 
SRV312 DevOps on AWS: Building Systems to Deliver Faster
SRV312 DevOps on AWS: Building Systems to Deliver FasterSRV312 DevOps on AWS: Building Systems to Deliver Faster
SRV312 DevOps on AWS: Building Systems to Deliver Faster
 
DevOps for Machine Learning overview en-us
DevOps for Machine Learning overview en-usDevOps for Machine Learning overview en-us
DevOps for Machine Learning overview en-us
 
My personal story from azure it pro to azure dev ops
My personal story from azure it pro to azure dev opsMy personal story from azure it pro to azure dev ops
My personal story from azure it pro to azure dev ops
 
Aws amity university_presentation_oct-31-2020
Aws amity university_presentation_oct-31-2020Aws amity university_presentation_oct-31-2020
Aws amity university_presentation_oct-31-2020
 
AWS ECS Copilot DevOps Presentation
AWS ECS Copilot DevOps PresentationAWS ECS Copilot DevOps Presentation
AWS ECS Copilot DevOps Presentation
 
DevOps on AWS - Building Systems to Deliver Faster
DevOps on AWS - Building Systems to Deliver FasterDevOps on AWS - Building Systems to Deliver Faster
DevOps on AWS - Building Systems to Deliver Faster
 
Application Lifecycle Management
Application Lifecycle ManagementApplication Lifecycle Management
Application Lifecycle Management
 
Aws Amity University Presentation Mar-10-2022
Aws Amity University Presentation Mar-10-2022Aws Amity University Presentation Mar-10-2022
Aws Amity University Presentation Mar-10-2022
 
Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...
Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...
Cloud Based Cognitive Learning & IT Project Performance Platform (CLIPP Platf...
 
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer ToolsDevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
DevOps on AWS: Deep Dive on Continuous Delivery and the AWS Developer Tools
 
Md Zahir Uddin
Md Zahir UddinMd Zahir Uddin
Md Zahir Uddin
 
Getting Started With Continuous Delivery on AWS - AWS April 2016 Webinar Series
Getting Started With Continuous Delivery on AWS - AWS April 2016 Webinar SeriesGetting Started With Continuous Delivery on AWS - AWS April 2016 Webinar Series
Getting Started With Continuous Delivery on AWS - AWS April 2016 Webinar Series
 
selenium_course_content.pdf
selenium_course_content.pdfselenium_course_content.pdf
selenium_course_content.pdf
 
MLOps in action
MLOps in actionMLOps in action
MLOps in action
 
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer Tools
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer ToolsA Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer Tools
A Tale of Two Pizzas: Accelerating Software Delivery with AWS Developer Tools
 
Dev ops on aws deep dive on continuous delivery - Toronto
Dev ops on aws deep dive on continuous delivery - TorontoDev ops on aws deep dive on continuous delivery - Toronto
Dev ops on aws deep dive on continuous delivery - Toronto
 
DevOps On AWS - Deep Dive on Continuous Delivery
DevOps On AWS - Deep Dive on Continuous DeliveryDevOps On AWS - Deep Dive on Continuous Delivery
DevOps On AWS - Deep Dive on Continuous Delivery
 
DevOps on AWS: DevOps Day San Francisco
DevOps on AWS: DevOps Day San FranciscoDevOps on AWS: DevOps Day San Francisco
DevOps on AWS: DevOps Day San Francisco
 

Dernier

From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 

Dernier (20)

From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 

Canada DevOps Summit 2020 Presentation Nov_03_2020

  • 1.
  • 2.
  • 3. Varun Kumar Senior Consultant, Cloud Engineering Background Varun Kumar is a Senior Consultant with Deloitte SEA & AWS APN Ambassador. He is a cloud professional over 8 plus years of diversified experience in DevOps. • Varun is also a Research Scholar, published three research papers, including IEEE. His research area & topic was virtualization and Hypervisors. • He is a Technical Blogger, wrote many blogs about AWS cloud, DevOps. DevSecOps, MLOps and in general cloud computing topics. • He is a professional cloud trainer, delivered many training across the globe and share his knowledge toward community which includes collage students, fresher's and Corporate professionals. Please find more details: • https://www.linkedin.com/in/vkmanik/ • https://medium.com/@varunmanik1 • https://www.facebook.com/cloudvirtualization/ • https://twitter.com/varunkmanik/ • https://www.youtube.com/channel/UCcuMPYJ4Osax4528rgqQWrw
  • 4. Qualifications and Professional Affiliations Qualification: • Master Degree in Computer Science. Professional Certificate: • AWS Certified Solutions Architect - Professional • AWS Certified Developer – Associate • AWS Certified SysOps - Associate • AWS Certified Solution Architect – Associate • AWS Certified Practitioner • Red Hat Certificate of Expertise in Ansible Automation
  • 5. Notable Recent Experiences • Cloud migration lead at a large media company based in South East Asia, providing ongoing consulting, improvement feedback, and cloud expertise to this team for implementation of DevOps practices and migration of their CRM/billing systems to cloud. • Building DevOps, DevSecOps, MLOps capabilities and Automation labs within the organization by implementing various tools for Continuous Integration (CI), Continuous Deployment (CD) and Continuous Assessment (CA) for multiple accounts. • Lead the automation team, Automate daily Cloud tasks in DevOps Tools, Create & configure automation of AWS resources with DevOps best practice to enhance the CICD (Continuous Integration and Continuous Delivery) process for the organization. • Built the DevOps, DevSecOps, DevFinOps practice within the organization and enabled a DevOps champion in every product team, leading to cohesive standards and capabilities in these areas.
  • 6. Index - Introduction of Machine learning • Using Jupyter Notebook 15 min • AWS SageMaker 15 min • Sentiment analysis 15 min • Break 10 min - Overview of a Use case • Model Deployment 15 min • Examining deployed model performance 10 min - Setup New Project Copilot • Setup and Run the Build CI/CD Pipeline 15 min • Setup the Release Pipeline 15 min • Break 10 min • Test Build and Release Pipelines 15 min • Testing the deployed solution 15 min
  • 7. What is ML….? • What are the different types in machine learning? • What are the different algorithms available for developing machine learning models? • What tools are available for developing these models? • What are the programming language choices? • What platforms support development and deployment of Machine Learning applications? • How to quickly upgrade your skills in this important area?
  • 8. Applications of Machines Learning Machine Learning is the most rapidly growing technology and according to researchers we are in the golden year of AI and ML. It is used to solve many real-world complex problems which cannot be solved with traditional approach. Following are some real-world applications of ML − • Emotion analysis • Sentiment analysis • Error detection and prevention
  • 9. Applications of Machines Learning • Weather forecasting and prediction • Stock market analysis and forecasting • Speech synthesis • Speech recognition • Customer segmentation • Object recognition • Fraud detection • Fraud prevention • Recommendation of products to customer in online shopping
  • 10. Types of Machine Learning Machine Learning Supervised Learning Unsupervised Learning Reinforcement Learning Deep Learning Deep Reinforcement Learning
  • 11. Algorithms for Supervised Learning There are several algorithms available for supervised learning. Some of the widely used algorithms of supervised learning are as shown below : • k-Nearest Neighbours • Decision Trees • Naive Bayes • Logistic Regression • Support Vector Machine
  • 12. Sentiment Analysis by Amazon Comprehend Analyze text in real time by using built-in or custom models. With built-in models, you can recognize entities, extract key phrases, detect dominant languages, detect PII, determine sentiment, or analyze syntax. With custom models, you can detect entities that you define, or you can classify documents using your own categories or labels.
  • 13.
  • 15. LAB
  • 16. AWS Sagemaker SageMaker Studio, a machine learning Integrated Development Environment (IDE) for building, training, and debugging models, tracking experiments, deploying models, and monitoring their performance.
  • 18. SageMaker Benefits and features • Labeling raw data with active learning • Highly accurate training datasets • Fully-managed notebook instances • Highly-optimized machine learning algorithms • One-click training • Deployment without engineering effort
  • 20. LAB
  • 21. Jupyter Notebook • Jupyter Lab • Note book Creation • File Option • Code vs Markdown • File Upload down load
  • 22. Machine Learning Use case • Machine Learning (and in mathematics) there are often three values that interests us: Mean - The average value Median - The mid point value Mode - The most common value • Random Data Distributions • Linear Regression • Polynomial Regression
  • 23. LAB
  • 25. Deep Learning uses ANN Applications Deep Learning has shown a lot of success in several areas of machine learning applications. Self-driving Cars − The autonomous self-driving cars use deep learning techniques. They generally adapt to the ever changing traffic situations and get better and better at driving over a period of time. Speech Recognition − Another interesting application of Deep Learning is speech recognition. All of us use several mobile apps today that are capable of recognizing our speech. Apple’s Siri, Amazon’s Alexa, Microsoft’s Cortena and Google’s Assistant – all these use deep learning techniques. Mobile Apps − We use several web-based and mobile apps for organizing our photos. Face detection, face ID, face tagging, identifying objects in an image – all these use deep learning.
  • 26. ML Platform & tools Language Choice • Python • R • Matlab • Octave • Julia • C++ • C IDEs • AWS Sagemaker • R Studio • Pycharm • iPython/Jupyter Notebook • Julia • Spyder • Anaconda • Rodeo • Google –Colab Platforms • Amazon • IBM • Microsoft Azure • Google Cloud • Mlflow
  • 29. Micro Services Deployment by AWS Copilot Part 2 DevOps
  • 30. What is Copilot…? • The AWS Copilot command-line interface (CLI) provides application-first, high-level commands to simplify modeling, creating, releasing, and managing production-ready containerized applications on Amazon ECS from a local development environment. • Provisioned with application templates, infrastructure as code, and CI/CD pipeline options, the AWS Copilot CLI aligns with application workflows that support modern application best practices.
  • 31. AWS ECS Copilot (Auto Pilot Mode: Infra Creation and DevOps Deployment)
  • 32. Copilot Building Block Copilot CLI Services Environment Application Pipelines Manifest File
  • 35. Docker Basics Docker Basic 1. Create EC2 Instance 2. Install Docker 3. Pull centos:centos6 4. Create index.html 5. Create Dockerfile 6. Build Docker image
  • 36. Services • Creating a Service • Choosing a Service Type • Load Balanced Web Service • Backend Service • Config and the Manifest • Deploying a Service • Digging into your Service • What's in your service? • What's your service status? • Where are my service
  • 37. Environment • Creating an Environment • Deploying a Service • Environment Infrastructure • VPC and Networking • Load Balancers and DNS • Customize your Environment • Digging into your Environment • What's in your environment?
  • 38. Application • Creating an App • Additional App Configurations • App Infrastructure • ECR Repositories • Release Infrastructure • Digging into your App • What's in my application?
  • 39. AWS Infrastructure • AWS VPC • Subnets • Security Group • ECS Cluster • ECS Service • Fargate task • Service Discovery • ECR Repositories • Application Load balancer • ACM Certs
  • 40. Pipeline • Pipeline structure • GitHub Source • Build Stage • Deploy Stages • Creating a Pipeline in 3 steps • Preparing the pipeline structure. • Committing the generated buildspec.yml. • Creating the actual CodePipeline.
  • 41.
  • 42. Final Deployment Test and Validation 1. Push the new version of code in code commit 2. It will automatically deploy the new task with new version 3. At last you can run the DNS ALB on your browser
  • 44. LAB
  • 45. Command Application • app init • app ls • app show • app delete Environment • env init • env ls • env show • env delete Services • svc init • svc ls • svc show • svc logs • svc status • svc package • svc deploy • svc delete • task run Pipeline • pipeline init • pipeline update • pipeline show • pipeline status • pipeline delete • deploy
  • 46. Thanks…..! Please find more details: • https://www.linkedin.com/in/vkmanik/ • https://medium.com/@varunmanik1 • https://www.facebook.com/cloudvirtualization/ • https://twitter.com/varunkmanik/ • https://www.youtube.com/channel/UCcuMPYJ4Osax4 528rgqQWrw