Adopting DevOps that scales with your needs can be challenging, especially for larger enterprises. Since the perfect DevOps strategy varies for each organization, VirtusaPolaris has devised an approach for enterprise-wide DevOps adoption across three stages – Build, Deploy, and Manage. When NewsCorp realized they needed to modernize their IT infrastructure to stay ahead of a changing media landscape, they tapped VirtusaPolaris for assistance with Cloud Transformation including an Application Portfolio Assessment, migrating applications to the cloud, and DevOps adoption. While migrating applications, VirtusaPolaris helped NewsCorp define, design, and implement a DevOps model on AWS, then run and manage that environment efficiently, using a number of AWS services such as Amazon VPC, Amazon EC2, AWS Elastic Load Balancing (ELB), and more.
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
Adopting DevOps at Scale on AWS with VirtusaPolaris
1. Adopting DevOps at Scale on
AWS with VirtusaPolaris
James Forrester, Principal Solutions Architect, AWS
Aarti Sahni, Senior Director – Technology, VirtusaPolaris
Jim Pressler, Associate Director – Technology, VirtusaPolaris
Shaown Nandi, CIO, Dow Jones (a News Corp company)
2. Agenda
1. AWS DevOps Solution Overview
2. Challenges, solutions and pillars of DevOps adoption at Enterprise
scale
3. VirtusaPolaris DevOps Pipeline Approach
4. News Corp DevOps Success Story
5. Questions
3. DevOps on the AWS Cloud
James Forrester, Principal Solutions Architect, AWS
4. Traditional Development Models are Obsolete
Business is increasingly software-driven
End-users expect both continuous improvement and stability from
applications
IT needs to be able to provision infrastructure as rapidly as developers
demand it
An organization’s pace of innovation is largely constrained by their
ability to develop applications
5. Increase
Business agility
Application stability
Ability to meet customer
demand
Time spent on innovation
Security
Decrease
Length of development cycles
Time to market
Deployment failures and
rollbacks
Time to recover upon failure
Operational overhead
DevOps Can Help
DevOps practices enable companies to innovate at a higher velocity
for customers
6. Infrastructure
as Code
Microservices Logging and
Monitoring
Continuous Integration/
Continuous Delivery
DevOps on AWS
AWS provides on-demand infrastructure resources and tooling built to
enable common DevOps practices
7. Provision the server, storage, and networking capacity you
need on demand
Deploy independently, as a single service, or a group of
services
Make configuration changes repeatable and standardized
Build custom templates to provision resources in a controlled
and predictable way
Use version control to keep track of all changes made to your
infrastructure and application stack
Infrastructure as Code
Replace traditional infrastructure provisioning and management with
code-based techniques
8. Build services around the business capabilities you require
Scale up and down as required with virtually no notice
Make configuration code changes repeatable and
standardized
API-driven model enables management of infrastructure
with language typically used in application code
Free developers from manually configuring operating
systems, system applications, and server software
Microservices
Build applications as a set of small services that communicates with other
services through APIs
9. Maintain visibility and auditability of activity in your
application infrastructure
Assess how application and infrastructure performance
impact end-user experience
Gain insight into the root causes of problems or
unexpected changes
Support services that must be available 24/7 as a result of
continuous integration/ continuous delivery
Create alerts based on thresholds you define
Logging and Monitoring
Capture, categorize, and analyze data and logs generated by applications
and infrastructure
10. Model and visualize your own custom release workflow
Automate deployments of new code
Improve developer productivity and deliver updates faster
Find and address bugs quicker with more frequent and
comprehensive testing
Store anything from source code to binaries using existing
Git tools
Continuous Integration and Continuous Delivery
Rapidly and reliably build, test, and deploy your applications, while
improving quality and reducing time to market.
11. Get started quickly
and pay as you go
Automate systems
operations
Scale without
infrastructure constraints
Improve visibility
and security
Leverage fully
managed services
Benefits of DevOps on AWS
12. Adopting DevOps at
Enterprise Scale
Aarti Sahni, Senior Director – Technology, VirtusaPolaris
Jim Pressler, Associate Director – Technology, VirtusaPolaris
14. Top Challenges for Large Scale Enterprise in Adopting DevOps
and Solutions to Overcome Them
Adapted from - DevOps and the Cloud: Chef and AWS
Challenge: Manual deployment processes
Take long time to setup new systems of software
Solution: Automation
Define application deployment in code for
complete environments
Challenge: Legacy systems and tools
Inflexible, hard-to-change hardware and software
Challenge: Organizational silos
Unwieldy divisions of responsibility
Solution: Dynamic infrastructure
Transform to disposable consumption based
on infra in the cloud
Solution: Increase co-operation and trust
Increase collaborations between developers
and operations
15. Challenge: Compliance bottlenecks
Compliance bottleneck at the end of a project
Challenge: Lack of visibility in to tools and
workloads Disparate tools adoption by different
teams
Solution: Compliance at velocity
Integration of compliance into the workflow
using automated tests
Solution: Increase visibility in to the tools
and workloads Harness the visual approach
through workflows and dashboards
Challenge: Infrequent, large releases
Fear of deployment due to risk to SLAs
Solution: Continuous delivery of
infrastructure and applications Agile and safe
delivery through automated release pipeline
Adapted from - DevOps and the Cloud: Chef and AWS
Top Challenges for Large Scale Enterprise in Adopting DevOps
and Solutions to Overcome Them
16. These Four Pillars are Necessary to Support Effective DevOps with
End-to-end Orchestration of all Pipeline Stages and Workflows
Leadership
Collaboration
Fail fast, Fail often
Culture
Security
Self-Healing
Compliance
Resiliency
Lean
Automation
Holistic
Value Stream
People
Process
Technology
Measurement
Agile and Resilient IT
20. Automation
Key areas of DevOps utilized
Configuration
Management
Regular
Integration
Automated
Monitoring &
Health Checks
Infrastructure
as Code
VirtusaPolaris DevOps Pipeline Approach and Blue Print Offers the
Flexibility Needed with Fast Paced Change in Tools and Technology
21. Scenario 1: DevOps Solution for Highly-scalable and Reliable Web
Applications in Cloud
22. Service1 Build
Artifacts/DockerFile
Service2 Build
Artifacts/DockerFile
Service3 Build
Artifacts/DockerFile
Service4 Build
Artifacts/DockerFile
Service1 Image Service2 Image
Service3 image Service4 Image
GitHub
Docker Hub
Pull Docker Images
Git Clone Repo
Docker Compose
Kubernetes
AWS ECS
Docker Engine
REST API
Docker Host
Service Container
Service Container
Service Container
Scenario 2: DevOps Solution to Deploy Microservices
Using Containers
Docker Host
Service Container
Service Container
Service Container
25. Cloud Transformation Journey
Save $100 Million annually
Reduce from 50 data
centers globally to 6
75% of computational
power in the Cloud
Audacious goals set in
FY14 by News Corp
60%
Dow Jones cloud compute
400%
Increase in AWS instances
26. Dow Jones DevOps Journey to the Cloud With VirtusaPolaris
and AWS
Challenges Build DevOps
pipeline/Tools
muscle
Preparation
Dev Ops Assessment
Transition to
Dev Ops
mindset / culture
Cloud of the
Future
Cloud/AWS skillsets
AWS training
Benefits
27. Dow Jones Faced Many of the Same Challenges asAny Large
Enterprise Resulting in Slowing Down Cloud Transformation
Lack of a cohesive approach to cloud deployment strategy due to
Organization silos
Manual application deployments lacking agility and resiliency due
to less or no automation of many legacy apps
Longer release cycles that in turn increased the time to market
Lack of visibility of tools at enterprise level
Lack of unified DevOps pipeline with flexibility to support any LOB
specific use cases
Infrastructure provisioning as bottleneck due to manual processes
Compliance bottleneck towards the far end slowing down
releases further
28. Dow Jones DevOps Journey with VirtusaPolaris
Mindset / Culture
Ideas Generation
Dev Ops Assessment
Review current
practices/SDLC/App design
Create DevOps based
solution ideas &
interate
New Landing Zone (AWS
Account per BU, Application
Build and Deploy Automation)
On boarded several
business units
Several LOB application
have moved to the new
landing zone. Jenkins based
CI/CD. Terra-form templates.
Training-Cloud
Skillsets
Early 2017Early 2016
29. VirtusaPolaris laid the foundation of DevOps Pillars and applied winning
strategies to accelerate Dow Jones’AWS Cloud transformation journey
VirtusaPolaris crafted a unified DevOps pipeline leveraging powerful combination of Jenkins, AWS CloudFormation and Terraform harnessing the visual
approach through workflows and dashboards. Standardized and automated the Infrastructure as a Code accelerating the development cycles
30. Benefits Realized
Improved business
agility to roll out new
services with the help
of end-to-end
infrastructure and
application delivery
automation
Accelerated cloud
adoption by ensuring
a unified deployment
strategy across
different infrastructure
environments
Significantly reduced
total cost of
ownership by
providing enterprise
wide solutions and re-
usable templates and
repeatable process
using DevOps
pipelines
Increased visibility in
to the workloads with
different dashboards
(CloudFormation,
Jenkins, CloudHealth
etc.)
Enhanced usability
of the workflow by
leveraging Terraform
which was easily
readable and auditable
Reduced operational
cost by implementing
a disposable and
consumption based
infrastructure model
using CloudFormation,
Terraform and Jenkins
deployment workflow
While the Initiative is Ongoing, the Transformation Towards
DevOps is Already Delivering Positive Results to the Business
and to IT
31. While the Initiative is Ongoing, the Transformation Towards
DevOps is Already Delivering Positive Results to the Business
and to IT
Code Commit
Integration
Deployment
QA/Staging
Deployment Prod
Before DevOps Adoption
Random
Monthly
Monthly
Quarterly
After DevOps Adoption*
100s a day
3 times a day
Every 2 weeks
Every 2 weeks
* Per Product team
32. Questions?
For more information please visit: http://www.virtusapolaris.com/
Aarti Sahni | Senior Director, Technology, VirtusaPolaris
asahni@virtusapolaris.com
Jim Pressler | Associate Director, Technology, VirtusaPolaris
jpressler@virtusapolaris.com
Shaown Nandi | Chief Information Officer, Dow Jones
shaown@dowjones.com
Notes de l'éditeur
‘’’’
‘
]]]]]]http://www.slideshare.net/MarcHornbeek/engineering-devops-to-meet-business-goals slide 5
Test Driven Development (TDD) (DevOps toolkit chapter 2)