Submit Search
Upload
Open Source Recipes for Chef Deployments of Hadoop
•
4 likes
•
4,446 views
DataWorks Summit
Follow
Technology
Self Improvement
Report
Share
Report
Share
1 of 21
Recommended
Slides from my presentation at #ChefConf 2013 Big Data meets Configuration Management. Edmunds.com's first foray into Hadoop is a tale of challenges, discovery, and ultimately triumph. This is the story of how Edmunds.com leveraged Chef - and its community - to build a fully automated Hadoop cluster in the face of looming project deadlines.
Building Hadoop with Chef
Building Hadoop with Chef
John Martin
Dennis Matotek, Technical Lead Platforms at Experian Hitwise Australia, gave an excellent presentation on setting up puppet using vagrant, puppet and testing, including a full demo of rspec-puppet and Jenkins.
PuppetCamp SEA 1 - Using Vagrant, Puppet, Testing & Hadoop
PuppetCamp SEA 1 - Using Vagrant, Puppet, Testing & Hadoop
Walter Heck
Roman Shaposhnik of Cloudera and the Apache Software Foundation talks on "Delopying Hadoop-Based Bigdata Environments: [Tall] Tales from the Frontier" at Puppet Camp Silicon Valley 2012.
Deploying Hadoop-Based Bigdata Environments
Deploying Hadoop-Based Bigdata Environments
Puppet
Roman Shaposhnik: Director of Open Source, Pivotal; Committer, Apache Hadoop; Founder, Apache Bigtop Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex.
Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex
Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex
Apache Apex
The Deploying OpenStack with Chef section of the OpenStack Workshop from Velocity 2011
Velocity 2011 Chef OpenStack Workshop
Velocity 2011 Chef OpenStack Workshop
Chef Software, Inc.
Introduction to DevOps with Chef.
Chef: Smart infrastructure automation
Chef: Smart infrastructure automation
Johannes H. P. Skov Frandsen
Chef Fundamentals Training Series Module 1: Overview of Chef
Chef Fundamentals Training Series Module 1: Overview of Chef
Chef Software, Inc.
Part 6 of a 6 part series introducing you to the fundamentals of Chef. This session includes an introducing Community Cookbooks and some additional resources. After viewing this webinar you will be able to: - Find, preview, and download cookbooks from the Chef Community site - Use knife to work with the Community Site API - Download, extract, examine and implement cookbooks from the Community site Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=ovTIeS3kx4g&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Community Cookbooks & further resources - Fundamentals Webinar Series Part 6
Community Cookbooks & further resources - Fundamentals Webinar Series Part 6
Chef
Recommended
Slides from my presentation at #ChefConf 2013 Big Data meets Configuration Management. Edmunds.com's first foray into Hadoop is a tale of challenges, discovery, and ultimately triumph. This is the story of how Edmunds.com leveraged Chef - and its community - to build a fully automated Hadoop cluster in the face of looming project deadlines.
Building Hadoop with Chef
Building Hadoop with Chef
John Martin
Dennis Matotek, Technical Lead Platforms at Experian Hitwise Australia, gave an excellent presentation on setting up puppet using vagrant, puppet and testing, including a full demo of rspec-puppet and Jenkins.
PuppetCamp SEA 1 - Using Vagrant, Puppet, Testing & Hadoop
PuppetCamp SEA 1 - Using Vagrant, Puppet, Testing & Hadoop
Walter Heck
Roman Shaposhnik of Cloudera and the Apache Software Foundation talks on "Delopying Hadoop-Based Bigdata Environments: [Tall] Tales from the Frontier" at Puppet Camp Silicon Valley 2012.
Deploying Hadoop-Based Bigdata Environments
Deploying Hadoop-Based Bigdata Environments
Puppet
Roman Shaposhnik: Director of Open Source, Pivotal; Committer, Apache Hadoop; Founder, Apache Bigtop Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex.
Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex
Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex
Apache Apex
The Deploying OpenStack with Chef section of the OpenStack Workshop from Velocity 2011
Velocity 2011 Chef OpenStack Workshop
Velocity 2011 Chef OpenStack Workshop
Chef Software, Inc.
Introduction to DevOps with Chef.
Chef: Smart infrastructure automation
Chef: Smart infrastructure automation
Johannes H. P. Skov Frandsen
Chef Fundamentals Training Series Module 1: Overview of Chef
Chef Fundamentals Training Series Module 1: Overview of Chef
Chef Software, Inc.
Part 6 of a 6 part series introducing you to the fundamentals of Chef. This session includes an introducing Community Cookbooks and some additional resources. After viewing this webinar you will be able to: - Find, preview, and download cookbooks from the Chef Community site - Use knife to work with the Community Site API - Download, extract, examine and implement cookbooks from the Community site Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=ovTIeS3kx4g&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Community Cookbooks & further resources - Fundamentals Webinar Series Part 6
Community Cookbooks & further resources - Fundamentals Webinar Series Part 6
Chef
Chef Fundamentals Training Series Module 4: The Chef Client Run and Expanding...
Chef Fundamentals Training Series Module 4: The Chef Client Run and Expanding...
Chef Software, Inc.
Chef Fundamentals Training Series Module 2: Workstation Setup
Chef Fundamentals Training Series Module 2: Workstation Setup
Chef Fundamentals Training Series Module 2: Workstation Setup
Chef Software, Inc.
Environments - Fundamentals Webinar Series Week 5
Environments - Fundamentals Webinar Series Week 5
Chef
Part 2 of a 6 part series introducing you to the fundamentals of Chef. This session includes: * Node Setup * Chef Resources and Recipes After viewing this webinar you will be able to: - Login to the node in your Chef Training Lab - Install Chef nodes using "knife bootstrap" - Explain how knife bootstrap configures a node to use the - Organization created in the previous section - Explain the basic configuration needed to run chef-client - Describe in detail what a cookbook is - Create a new cookbook - Explain what a recipe is - Describe how to use the package, service, and template - resources - Upload a cookbook to the Chef Server - Explain what a run list is, and how to set it for a node - via knife - Explain the output of a chef-client run Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=S5lHUpzoCYo&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Node setup, resource, and recipes - Fundamentals Webinar Series Part 2
Node setup, resource, and recipes - Fundamentals Webinar Series Part 2
Chef
When most people talk about automating infrastructure, they focus on things like consistency, scalability, and flexibility. While fine goals, we recently converted several projects to Chef for both systems AND application deployment, and found that, with a little work, these tools could also help you enable better software quality assurance, load modeling, and even improve resource allocation. By sharing cookbooks across projects, we were able to standardize practices and eliminate arbitrary differences, while using parameterization to perfectly isolate the special needs of each project. This allowed us to transfer knowledge among staff much more quickly. Pulling in and parameterizing application state – database contents, website assets, uploaded content – allowed us to spin up new environments with as much or as little state as needed. Integrating with Vagrant and Jenkins, we were then able to use chef to treat the entire image – system and application – as a test fixture. As each engineer (ops or dev) has visibility into the whole stack, we can more easily move people between dev and ops, or between projects.
The unintended benefits of Chef
The unintended benefits of Chef
Chef Software, Inc.
Slides from 09-12-2013 Opscode webinar on using Chef to automate your VMware infrastructure.
Opscode Webinar: Managing Your VMware Infrastructure with Chef
Opscode Webinar: Managing Your VMware Infrastructure with Chef
Chef Software, Inc.
Part 4 of a 6 part series introducing you to the fundamentals of Chef. This session includes an introducing Data Bags & Data Bag Items After viewing this webinar you will be able to: - Use Data Bags for data-driven recipes - Use multiple recipes for a node's run list Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=fS_yrFNSL9w&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Common configuration with Data Bags - Fundamentals Webinar Series Part 4
Common configuration with Data Bags - Fundamentals Webinar Series Part 4
Chef
Ansible slides of a talk during 1st Bitnami Bootcamp on September 2014
Automated Deployment and Configuration Engines. Ansible
Automated Deployment and Configuration Engines. Ansible
Alberto Molina Coballes
Part 3 of a 6 part series introducing you to the fundamentals of Chef. This session includes: * Node object * Chef roles After viewing this webinar you will be able to: - Explain what the node object represents in Chef - Show details about a node - Describe what node attributes are - Retrieve a node attribute - Describe where and how attributes are set - Explain the attribute merge order and precedence rules - Declare an attribute with a recipe and set its value - Explain what Roles are, and how they are used to provide -larity - Discuss the Role JSON DSL - Explain how merge order affects the precedence hierarchy Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=nQogf89hgnM&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Node object and roles - Fundamentals Webinar Series Part 3
Node object and roles - Fundamentals Webinar Series Part 3
Chef
Members of the Chef for OpenStack community had a meetup on the last day of the Spring 2013 OpenStack Summit to coordinate and plan further Grizzly work. These are our notes, we'll report back at the Fall 2013 OpenStack Summit what we accomplished.
Chef for OpenStack: Grizzly Roadmap
Chef for OpenStack: Grizzly Roadmap
Matt Ray
Chef Fundamentals Training Series Module 3: Setting up Nodes and Cookbook Authoring
Chef Fundamentals Training Series Module 3: Setting up Nodes and Cookbook Aut...
Chef Fundamentals Training Series Module 3: Setting up Nodes and Cookbook Aut...
Chef Software, Inc.
These are the slides from the January 22 and 24, 2013 Chef for OpenStack Hack Days in Boston and New York City. The slides were slightly updated between the 2 days, so I've only uploaded the more recent set.
Boston/NYC Chef for OpenStack Hack Days
Boston/NYC Chef for OpenStack Hack Days
Matt Ray
Austin OpenStack Meetup December 2012 presentation. The first part of the session was Chef for OpenStack, the second was Q&A about AT&T's OpenStack private cloud deployments to multiple data centers.
Chef for OpenStack December 2012
Chef for OpenStack December 2012
Matt Ray
Overview of current Chef for OpenStack ecosystem at the OpenStack Spring Summit 2013.
Chef for OpenStack: OpenStack Spring Summit 2013
Chef for OpenStack: OpenStack Spring Summit 2013
Matt Ray
The session at the Atlanta 2014 OpenStack Summit is for those already familiar with Chef and interested in deploying and managing OpenStack. We cover the state of the deploying OpenStack with Chef and deploying infrastructure on top of OpenStack with Chef. The second half of the talk is a deep-dive walkthrough of the Vagrant deployment, the instructions are here: http://bit.ly/ATLChef http://openstacksummitmay2014atlanta.sched.org/event/39587e0e47a20323c6389e136c954ecf
Atlanta OpenStack 2014 Chef for OpenStack Deployment Workshop
Atlanta OpenStack 2014 Chef for OpenStack Deployment Workshop
Matt Ray
At Ninefold we've spent 3+ years with Chef. We've built a PaaS with Chef and we manage our internal systems with it. In this presentation we explore the design decisions we needed to make in order to build the platform. It highlights the things we've learned along the way that weren't exactly obvious when we started.
Building a PaaS using Chef
Building a PaaS using Chef
Shaun Domingo
Slides for Chef Fundamentals Training Series Module 6: Roles, Environments, Community Cookbooks, and Other Resources.
Chef Fundamentals Training Series Module 6: Roles, Environments, Community Co...
Chef Fundamentals Training Series Module 6: Roles, Environments, Community Co...
Chef Software, Inc.
These slides are containing a brief intro to chef software and will let you know the power of chef, and how to use it and make deployment automatic.
Introduction to Chef
Introduction to Chef
Knoldus Inc.
This is a presentation I gave for an O'Reilly webinar on the 6th of August, 2014
Automating your infrastructure with Chef
Automating your infrastructure with Chef
John Ewart
A brief overview of Chef-Zero and using local mode to configure your infrastructure with Chef.
Chef-Zero & Local Mode
Chef-Zero & Local Mode
Michael Goetz
Practical introduction to dev ops with chef
Practical introduction to dev ops with chef
LeanDog
A presentation I gave at the 2013 Salishan High Speed Computing conference. With 2 hours' notice :)
Introduction to Chef
Introduction to Chef
kevsmith
More Related Content
What's hot
Chef Fundamentals Training Series Module 4: The Chef Client Run and Expanding...
Chef Fundamentals Training Series Module 4: The Chef Client Run and Expanding...
Chef Software, Inc.
Chef Fundamentals Training Series Module 2: Workstation Setup
Chef Fundamentals Training Series Module 2: Workstation Setup
Chef Fundamentals Training Series Module 2: Workstation Setup
Chef Software, Inc.
Environments - Fundamentals Webinar Series Week 5
Environments - Fundamentals Webinar Series Week 5
Chef
Part 2 of a 6 part series introducing you to the fundamentals of Chef. This session includes: * Node Setup * Chef Resources and Recipes After viewing this webinar you will be able to: - Login to the node in your Chef Training Lab - Install Chef nodes using "knife bootstrap" - Explain how knife bootstrap configures a node to use the - Organization created in the previous section - Explain the basic configuration needed to run chef-client - Describe in detail what a cookbook is - Create a new cookbook - Explain what a recipe is - Describe how to use the package, service, and template - resources - Upload a cookbook to the Chef Server - Explain what a run list is, and how to set it for a node - via knife - Explain the output of a chef-client run Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=S5lHUpzoCYo&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Node setup, resource, and recipes - Fundamentals Webinar Series Part 2
Node setup, resource, and recipes - Fundamentals Webinar Series Part 2
Chef
When most people talk about automating infrastructure, they focus on things like consistency, scalability, and flexibility. While fine goals, we recently converted several projects to Chef for both systems AND application deployment, and found that, with a little work, these tools could also help you enable better software quality assurance, load modeling, and even improve resource allocation. By sharing cookbooks across projects, we were able to standardize practices and eliminate arbitrary differences, while using parameterization to perfectly isolate the special needs of each project. This allowed us to transfer knowledge among staff much more quickly. Pulling in and parameterizing application state – database contents, website assets, uploaded content – allowed us to spin up new environments with as much or as little state as needed. Integrating with Vagrant and Jenkins, we were then able to use chef to treat the entire image – system and application – as a test fixture. As each engineer (ops or dev) has visibility into the whole stack, we can more easily move people between dev and ops, or between projects.
The unintended benefits of Chef
The unintended benefits of Chef
Chef Software, Inc.
Slides from 09-12-2013 Opscode webinar on using Chef to automate your VMware infrastructure.
Opscode Webinar: Managing Your VMware Infrastructure with Chef
Opscode Webinar: Managing Your VMware Infrastructure with Chef
Chef Software, Inc.
Part 4 of a 6 part series introducing you to the fundamentals of Chef. This session includes an introducing Data Bags & Data Bag Items After viewing this webinar you will be able to: - Use Data Bags for data-driven recipes - Use multiple recipes for a node's run list Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=fS_yrFNSL9w&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Common configuration with Data Bags - Fundamentals Webinar Series Part 4
Common configuration with Data Bags - Fundamentals Webinar Series Part 4
Chef
Ansible slides of a talk during 1st Bitnami Bootcamp on September 2014
Automated Deployment and Configuration Engines. Ansible
Automated Deployment and Configuration Engines. Ansible
Alberto Molina Coballes
Part 3 of a 6 part series introducing you to the fundamentals of Chef. This session includes: * Node object * Chef roles After viewing this webinar you will be able to: - Explain what the node object represents in Chef - Show details about a node - Describe what node attributes are - Retrieve a node attribute - Describe where and how attributes are set - Explain the attribute merge order and precedence rules - Declare an attribute with a recipe and set its value - Explain what Roles are, and how they are used to provide -larity - Discuss the Role JSON DSL - Explain how merge order affects the precedence hierarchy Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=nQogf89hgnM&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Node object and roles - Fundamentals Webinar Series Part 3
Node object and roles - Fundamentals Webinar Series Part 3
Chef
Members of the Chef for OpenStack community had a meetup on the last day of the Spring 2013 OpenStack Summit to coordinate and plan further Grizzly work. These are our notes, we'll report back at the Fall 2013 OpenStack Summit what we accomplished.
Chef for OpenStack: Grizzly Roadmap
Chef for OpenStack: Grizzly Roadmap
Matt Ray
Chef Fundamentals Training Series Module 3: Setting up Nodes and Cookbook Authoring
Chef Fundamentals Training Series Module 3: Setting up Nodes and Cookbook Aut...
Chef Fundamentals Training Series Module 3: Setting up Nodes and Cookbook Aut...
Chef Software, Inc.
These are the slides from the January 22 and 24, 2013 Chef for OpenStack Hack Days in Boston and New York City. The slides were slightly updated between the 2 days, so I've only uploaded the more recent set.
Boston/NYC Chef for OpenStack Hack Days
Boston/NYC Chef for OpenStack Hack Days
Matt Ray
Austin OpenStack Meetup December 2012 presentation. The first part of the session was Chef for OpenStack, the second was Q&A about AT&T's OpenStack private cloud deployments to multiple data centers.
Chef for OpenStack December 2012
Chef for OpenStack December 2012
Matt Ray
Overview of current Chef for OpenStack ecosystem at the OpenStack Spring Summit 2013.
Chef for OpenStack: OpenStack Spring Summit 2013
Chef for OpenStack: OpenStack Spring Summit 2013
Matt Ray
The session at the Atlanta 2014 OpenStack Summit is for those already familiar with Chef and interested in deploying and managing OpenStack. We cover the state of the deploying OpenStack with Chef and deploying infrastructure on top of OpenStack with Chef. The second half of the talk is a deep-dive walkthrough of the Vagrant deployment, the instructions are here: http://bit.ly/ATLChef http://openstacksummitmay2014atlanta.sched.org/event/39587e0e47a20323c6389e136c954ecf
Atlanta OpenStack 2014 Chef for OpenStack Deployment Workshop
Atlanta OpenStack 2014 Chef for OpenStack Deployment Workshop
Matt Ray
At Ninefold we've spent 3+ years with Chef. We've built a PaaS with Chef and we manage our internal systems with it. In this presentation we explore the design decisions we needed to make in order to build the platform. It highlights the things we've learned along the way that weren't exactly obvious when we started.
Building a PaaS using Chef
Building a PaaS using Chef
Shaun Domingo
Slides for Chef Fundamentals Training Series Module 6: Roles, Environments, Community Cookbooks, and Other Resources.
Chef Fundamentals Training Series Module 6: Roles, Environments, Community Co...
Chef Fundamentals Training Series Module 6: Roles, Environments, Community Co...
Chef Software, Inc.
These slides are containing a brief intro to chef software and will let you know the power of chef, and how to use it and make deployment automatic.
Introduction to Chef
Introduction to Chef
Knoldus Inc.
This is a presentation I gave for an O'Reilly webinar on the 6th of August, 2014
Automating your infrastructure with Chef
Automating your infrastructure with Chef
John Ewart
A brief overview of Chef-Zero and using local mode to configure your infrastructure with Chef.
Chef-Zero & Local Mode
Chef-Zero & Local Mode
Michael Goetz
What's hot
(20)
Chef Fundamentals Training Series Module 4: The Chef Client Run and Expanding...
Chef Fundamentals Training Series Module 4: The Chef Client Run and Expanding...
Chef Fundamentals Training Series Module 2: Workstation Setup
Chef Fundamentals Training Series Module 2: Workstation Setup
Environments - Fundamentals Webinar Series Week 5
Environments - Fundamentals Webinar Series Week 5
Node setup, resource, and recipes - Fundamentals Webinar Series Part 2
Node setup, resource, and recipes - Fundamentals Webinar Series Part 2
The unintended benefits of Chef
The unintended benefits of Chef
Opscode Webinar: Managing Your VMware Infrastructure with Chef
Opscode Webinar: Managing Your VMware Infrastructure with Chef
Common configuration with Data Bags - Fundamentals Webinar Series Part 4
Common configuration with Data Bags - Fundamentals Webinar Series Part 4
Automated Deployment and Configuration Engines. Ansible
Automated Deployment and Configuration Engines. Ansible
Node object and roles - Fundamentals Webinar Series Part 3
Node object and roles - Fundamentals Webinar Series Part 3
Chef for OpenStack: Grizzly Roadmap
Chef for OpenStack: Grizzly Roadmap
Chef Fundamentals Training Series Module 3: Setting up Nodes and Cookbook Aut...
Chef Fundamentals Training Series Module 3: Setting up Nodes and Cookbook Aut...
Boston/NYC Chef for OpenStack Hack Days
Boston/NYC Chef for OpenStack Hack Days
Chef for OpenStack December 2012
Chef for OpenStack December 2012
Chef for OpenStack: OpenStack Spring Summit 2013
Chef for OpenStack: OpenStack Spring Summit 2013
Atlanta OpenStack 2014 Chef for OpenStack Deployment Workshop
Atlanta OpenStack 2014 Chef for OpenStack Deployment Workshop
Building a PaaS using Chef
Building a PaaS using Chef
Chef Fundamentals Training Series Module 6: Roles, Environments, Community Co...
Chef Fundamentals Training Series Module 6: Roles, Environments, Community Co...
Introduction to Chef
Introduction to Chef
Automating your infrastructure with Chef
Automating your infrastructure with Chef
Chef-Zero & Local Mode
Chef-Zero & Local Mode
Similar to Open Source Recipes for Chef Deployments of Hadoop
Practical introduction to dev ops with chef
Practical introduction to dev ops with chef
LeanDog
A presentation I gave at the 2013 Salishan High Speed Computing conference. With 2 hours' notice :)
Introduction to Chef
Introduction to Chef
kevsmith
This is an Overview of Chef. After viewing this webinar you will be able to: - Describe how Chef thinks about Infrastructure Automation - Define the following terms: - Resource - Recipe - Node - Run List - Search - Login to Hosted Chef - Run `knife` commands from your workstation Video of this webinar can be found at the following URL https://www.youtube.com/watch?v=S5lHUpzoCYo&list=PL11cZfNdwNyPnZA9D1MbVqldGuOWqbumZ
Overview of Chef - Fundamentals Webinar Series Part 1
Overview of Chef - Fundamentals Webinar Series Part 1
Chef
All Things Open 2014 - Day 2 Thursday, October 23rd, 2014 Nathen Harvey Co-Host of Food Fight Show & Director of Community and #LEARNCHEF / Chef DevOps Introduction to Infrastructure as Code & Automation / Introduction to Chef
Introduction to Infrastructure as Code & Automation / Introduction to Chef
Introduction to Infrastructure as Code & Automation / Introduction to Chef
All Things Open
Talk from CodeMesh 2014. Using Chef with Test Kitchen and Docker to create testable infrastructure code in a flexible way.
Testable Infrastructure with Chef, Test Kitchen, and Docker
Testable Infrastructure with Chef, Test Kitchen, and Docker
Mandi Walls
For many years, Facebook managed its systems with cfengine2. With many individual clusters over 10k nodes in size, a slew of different constantly-changing system configurations, and small teams, this system was showing its age and the complexity was steadily increasing, limiting its effectiveness and usability. It was difficult to integrate with internal systems, testing was often impractical, and it provided no isolation of configurations, among many other problems. After an extensive evaluation of the tools and paradigms in modern systems configuration management – open source, proprietary, and a potential home-grown solution – we built a system based on the open-source project Chef. The evaluation process involved understanding the direction we wanted to take in managing the next many iterations of systems, clusters, and teams. More importantly, we evaluated the various paradigms behind effective configuration management and the different kinds of scale they provide. What we ended up with is an extremely flexible system that allows a tiny team to manage an incredibly large number of systems with a variety of unique configuration needs. In this talk we will look at the paradigms behind the system we built, the software we chose and why, and the system we built using that software. Further, we will look at how the philosophies we followed can apply to anyone wanting to scale their systems infrastructure. Phil Dibowitz - Phil Dibowitz has been working in systems engineering for 12 years and is currently a production engineer at Facebook. Initially, he worked on the traffic infrastructure team, automating load balancer configuration management, as well as designing and building the production IPv6 infrastructure. He now leads the team responsible for rebuilding the configuration management system from the ground up. Prior to Facebook, he worked at Google, where he managed the large Gmail environment, and at Ticketmaster, where he co-authored and open sourced a configuration management tool called Spine. He also contributes to, and maintains, various open source projects and has spoken at conferences and LUG’s on a variety of topics from Path MTU Discovery to X509.
Atmosphere 2014: Really large scale systems configuration - Phil Dibowitz
Atmosphere 2014: Really large scale systems configuration - Phil Dibowitz
PROIDEA
Chef Conf 2015 - April 1
Chef conf-2015-chef-patterns-at-bloomberg-scale
Chef conf-2015-chef-patterns-at-bloomberg-scale
Biju Nair
What is Apache Bigtop? Achieving Build Automation One-Click Hadoop Provisioning Bigtop at Trend Micro
How bigtop leveraged docker for build automation and one click hadoop provis...
How bigtop leveraged docker for build automation and one click hadoop provis...
Evans Ye
Your customers expect you to continuously deliver delightful experiences. This means that you’ll need to continuously deliver application and infrastructure updates. Hand-crafted servers lovingly built and maintained by a system administrator are a thing of the past. Golden images are fine for initial provisioning but will quickly fail as your configuration requirements change over time. It’s time for you to fully automate the provisioning and management of your infrastructure components. Welcome to the world of infrastructure as code! In this new world, you’ll be able to programmatically provision and configure the components of your infrastructure. Disposable infrastructure whose provisioning, configuration, and on-going maintenance is fully automated allow you to change the way you build and deliver applications. Move your applications and infrastructure towards continuous delivery. In this talk, we’ll explore the ideas behind “infrastructure as code” and, specifically, look at how Chef allows you to fully automate your infrastructure. If you’re brave enough, we’ll even let you get your hands on some Chef and experience the delight of using Chef to build and deploy some infrastructure components.
Introduction to Infrastructure as Code & Automation / Introduction to Chef
Introduction to Infrastructure as Code & Automation / Introduction to Chef
Nathen Harvey
Nagios World Conference 2012 presentation introduces Chef and demo'd the Nagios cookbook.
Using Nagios with Chef
Using Nagios with Chef
Bryan McLellan
Talk by Patrick McDonnell (@mcdonnps) at #ChefConf 2012 Chef makes it so easy to change configuration en masse that it can be dangerous if not used with certain precautions and in accordance with a well thought out testing workflow. In our use of Chef at Etsy, we have devised many in-house best practices in response to failures which have helped greatly in avoiding catastrophic outages. This talk will focus on mistakes we've made and how we've avoided repeating them by enforcing standards in cookbooks, testing changes before rollout through the use of environments and in conjunction with the Spork plugin for Knife, and linting cookbooks with Foodcritic. I'll also talk about using handlers intelligently to monitor Chef runs and how to generate reports from the myriad data available in CouchDB.
Lessons from Etsy: Avoiding Kitchen Nightmares - #ChefConf 2012
Lessons from Etsy: Avoiding Kitchen Nightmares - #ChefConf 2012
Patrick McDonnell
the second round of cocopads introduction
Cocoapods in action
Cocoapods in action
Han Qin
The open source configuration management and automation framework Chef is used to configure, deploy and manage infrastructure of every sort. In addition to managing Linux, Windows and many other operating systems; Chef may be used to manage network hardware and storage systems. This session will provide an overview of the concepts and capabilities of Chef and discuss upcoming projects and how they fit into the Chef ecosystem.
TXLF: Chef- Software Defined Infrastructure Today & Tomorrow
TXLF: Chef- Software Defined Infrastructure Today & Tomorrow
Matt Ray
Interested in speeding up time to production when developing an application? Want to understand how to minimize risk associated with changes? Come learn about infrastructure automation with Chef. In this beginner level workshop, I will teach you the core set of skills needed to implement Chef in your environment whether for work or personal projects. I will cover the basic architecture of Chef and the associated tools that will help you improve your application workflow from design to production.
Introduction to Chef - Techsuperwomen Summit
Introduction to Chef - Techsuperwomen Summit
Jennifer Davis
What is Apache Bigtop? Achieving Build Automation One-Click Hadoop Provisioning Bigtop at Trend Micro
How bigtop leveraged docker for build automation and one click hadoop provis...
How bigtop leveraged docker for build automation and one click hadoop provis...
Evans Ye
A presentation I gave at Adelaide.rb's third meetup in April 2011 - a short introduction to Chef.
Chef - Infrastructure Automation for the Masses