SlideShare une entreprise Scribd logo
1  sur  15
Télécharger pour lire hors ligne
INTRO AND GOALS
AUTOMATED BUILD SYSTEM WITH
DOCKER, JENKINS, AZURE, AND GO
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
OUTCOMES
▸ As a build engineer I want to:
▸ Avoid setting up environment after environment for dev teams
▸ Concentrate on keeping the infrastructure healthy
▸ Work to implement new features to streamline processes
▸ As a software developer I want to:
▸ Control my software through to production without impediments
▸ Have freedom to create build environments without making special
requests
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
WHAT WILL THIS SOLUTION LOOK LIKE?
▸ Dev creates a docker image for build environment (hopefully uses it
locally to run, test and debug)
▸ Dev writes tests and code
▸ Dev adds a text file to repository that contains the Jenkins pipeline script
▸ Dev pushes Docker image to the organization's private Docker registry
▸ Dev then uses a tool (currently command line) to create the build job/CI/
CD pipeline - I will open source the code for this tool
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
WHAT WILL THIS SOLUTION LOOK LIKE?
▸ So with a command like:
▸ harbormaster --dockertlsfolder /tlsCerts/ -registryuser
user -registrypassword correcthorsebatteystaple -imagename
bargelt-slavedotnet -label
teambargelt_dotnetcore_simpleDotNet -jenkinsurl http://
dockerbuild.harebrained-apps.com -jenkinsuser steve -
jenkinspassword correcthorsebatteystaple -report https://
github.com/stevebargelt/simpleDotNet.git
▸ Magic happens…
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
MAGIC…
▸ Docker image is pulled to docker host
▸ Docker container created and started
▸ Test performed on Docker container
▸ Actually works!
▸ Conforms to standards
▸ Jenkins Docker Template is created
▸ Jenkins Job is created
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
STEP BY STEP
▸ Setup Docker in Azure
▸ Run Jenkins in Docker… in Azure
▸ Setup Jenkins to spin up ephemeral (Docker containers) Jenkins slaves
▸ Setup a Docker registry in Azure (including getting TLS/SSL certs)
▸ Write all the code (in Go) to allow hands-off build job creation
▸ Walk through creating software utilizing this system
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
TUTORIAL 01: DOCKER IN A VM IN AZURE
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
TUTORIAL 02: JENKINS AND EPHEMERAL SLAVES
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
TUTORIAL 03: PRIVATE DOCKER REGISTRY (SECURE)
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
TUTORIAL 04: JENKINS SCRIPTING AND API
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
TUTORIAL 05: DOCKHAND - CODING IN GO
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
TUTORIAL 06: USING THE SYSTEM WITH DOTNET CORE
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
THIS TUTORIAL SERIES
▸ Videos and details step-by-step blog posts
▸ Six installments planned
▸ More enhancement ideas to follow
▸ Expand to AWS
▸ I am use this system for my own projects so I’ll keep it up-to-date
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
WHAT THIS SERIES IS NOT
▸ No fluff
▸ Not going to explain Docker / Containers
▸ Not going to debate tech choices
AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
COLLABORATION AND OPEN SOURCE
▸ I’m no expert on any of these technologies
▸ I’m not a security expert
▸ All code will be open source
▸ Welcome PRs, comments, issues

Contenu connexe

En vedette

Using Canary Honeypots for Network Security Monitoring
Using Canary Honeypots for Network Security MonitoringUsing Canary Honeypots for Network Security Monitoring
Using Canary Honeypots for Network Security Monitoringchrissanders88
 
Applied Detection and Analysis Using Flow Data - MIRCon 2014
Applied Detection and Analysis Using Flow Data - MIRCon 2014Applied Detection and Analysis Using Flow Data - MIRCon 2014
Applied Detection and Analysis Using Flow Data - MIRCon 2014chrissanders88
 
Abstract Tools for Effective Threat Hunting
Abstract Tools for Effective Threat HuntingAbstract Tools for Effective Threat Hunting
Abstract Tools for Effective Threat Huntingchrissanders88
 
The Layman's Guide to Microsoft Azure
The Layman's Guide to Microsoft AzureThe Layman's Guide to Microsoft Azure
The Layman's Guide to Microsoft AzureAptera Inc
 
DevOps in the Cloud with Microsoft Azure
DevOps in the Cloud with Microsoft AzureDevOps in the Cloud with Microsoft Azure
DevOps in the Cloud with Microsoft Azuregjuljo
 
BSA2016 - Honeypots for Network Security Monitoring
BSA2016 - Honeypots for Network Security MonitoringBSA2016 - Honeypots for Network Security Monitoring
BSA2016 - Honeypots for Network Security Monitoringchrissanders88
 
Microservices: The Right Way
Microservices: The Right WayMicroservices: The Right Way
Microservices: The Right WayDaniel Woods
 

En vedette (9)

Microsoft Azure
Microsoft AzureMicrosoft Azure
Microsoft Azure
 
Using Canary Honeypots for Network Security Monitoring
Using Canary Honeypots for Network Security MonitoringUsing Canary Honeypots for Network Security Monitoring
Using Canary Honeypots for Network Security Monitoring
 
Applied Detection and Analysis Using Flow Data - MIRCon 2014
Applied Detection and Analysis Using Flow Data - MIRCon 2014Applied Detection and Analysis Using Flow Data - MIRCon 2014
Applied Detection and Analysis Using Flow Data - MIRCon 2014
 
Abstract Tools for Effective Threat Hunting
Abstract Tools for Effective Threat HuntingAbstract Tools for Effective Threat Hunting
Abstract Tools for Effective Threat Hunting
 
The Layman's Guide to Microsoft Azure
The Layman's Guide to Microsoft AzureThe Layman's Guide to Microsoft Azure
The Layman's Guide to Microsoft Azure
 
DevOps in the Cloud with Microsoft Azure
DevOps in the Cloud with Microsoft AzureDevOps in the Cloud with Microsoft Azure
DevOps in the Cloud with Microsoft Azure
 
BSA2016 - Honeypots for Network Security Monitoring
BSA2016 - Honeypots for Network Security MonitoringBSA2016 - Honeypots for Network Security Monitoring
BSA2016 - Honeypots for Network Security Monitoring
 
Microservices: The Right Way
Microservices: The Right WayMicroservices: The Right Way
Microservices: The Right Way
 
Azure Cloud PPT
Azure Cloud PPTAzure Cloud PPT
Azure Cloud PPT
 

Dernier

Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfkalichargn70th171
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfkalichargn70th171
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsArshad QA
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxComplianceQuest1
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...MyIntelliSource, Inc.
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...Health
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdfWave PLM
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...OnePlan Solutions
 
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female serviceCALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female serviceanilsa9823
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providermohitmore19
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Modelsaagamshah0812
 

Dernier (20)

Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
 
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS LiveVip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
Vip Call Girls Noida ➡️ Delhi ➡️ 9999965857 No Advance 24HRS Live
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlan’s ...
 
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female serviceCALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
CALL ON ➥8923113531 🔝Call Girls Badshah Nagar Lucknow best Female service
 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...
 
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 

Automated Build System with Docker, Jenkins and Azure: Intro

  • 1. INTRO AND GOALS AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO
  • 2. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO OUTCOMES ▸ As a build engineer I want to: ▸ Avoid setting up environment after environment for dev teams ▸ Concentrate on keeping the infrastructure healthy ▸ Work to implement new features to streamline processes ▸ As a software developer I want to: ▸ Control my software through to production without impediments ▸ Have freedom to create build environments without making special requests
  • 3. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO WHAT WILL THIS SOLUTION LOOK LIKE? ▸ Dev creates a docker image for build environment (hopefully uses it locally to run, test and debug) ▸ Dev writes tests and code ▸ Dev adds a text file to repository that contains the Jenkins pipeline script ▸ Dev pushes Docker image to the organization's private Docker registry ▸ Dev then uses a tool (currently command line) to create the build job/CI/ CD pipeline - I will open source the code for this tool
  • 4. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO WHAT WILL THIS SOLUTION LOOK LIKE? ▸ So with a command like: ▸ harbormaster --dockertlsfolder /tlsCerts/ -registryuser user -registrypassword correcthorsebatteystaple -imagename bargelt-slavedotnet -label teambargelt_dotnetcore_simpleDotNet -jenkinsurl http:// dockerbuild.harebrained-apps.com -jenkinsuser steve - jenkinspassword correcthorsebatteystaple -report https:// github.com/stevebargelt/simpleDotNet.git ▸ Magic happens…
  • 5. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO MAGIC… ▸ Docker image is pulled to docker host ▸ Docker container created and started ▸ Test performed on Docker container ▸ Actually works! ▸ Conforms to standards ▸ Jenkins Docker Template is created ▸ Jenkins Job is created
  • 6. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO STEP BY STEP ▸ Setup Docker in Azure ▸ Run Jenkins in Docker… in Azure ▸ Setup Jenkins to spin up ephemeral (Docker containers) Jenkins slaves ▸ Setup a Docker registry in Azure (including getting TLS/SSL certs) ▸ Write all the code (in Go) to allow hands-off build job creation ▸ Walk through creating software utilizing this system
  • 7. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO TUTORIAL 01: DOCKER IN A VM IN AZURE
  • 8. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO TUTORIAL 02: JENKINS AND EPHEMERAL SLAVES
  • 9. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO TUTORIAL 03: PRIVATE DOCKER REGISTRY (SECURE)
  • 10. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO TUTORIAL 04: JENKINS SCRIPTING AND API
  • 11. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO TUTORIAL 05: DOCKHAND - CODING IN GO
  • 12. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO TUTORIAL 06: USING THE SYSTEM WITH DOTNET CORE
  • 13. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO THIS TUTORIAL SERIES ▸ Videos and details step-by-step blog posts ▸ Six installments planned ▸ More enhancement ideas to follow ▸ Expand to AWS ▸ I am use this system for my own projects so I’ll keep it up-to-date
  • 14. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO WHAT THIS SERIES IS NOT ▸ No fluff ▸ Not going to explain Docker / Containers ▸ Not going to debate tech choices
  • 15. AUTOMATED BUILD SYSTEM WITH DOCKER, JENKINS, AZURE, AND GO COLLABORATION AND OPEN SOURCE ▸ I’m no expert on any of these technologies ▸ I’m not a security expert ▸ All code will be open source ▸ Welcome PRs, comments, issues