Intelligent Cloud Conference 2018 - Automatically scaling Kubernetes pods based on Azure metrics

•

1 j'aime•412 vues

Tom Kerkhove

Kubernetes, Docker, Azure, Prometheus and more buzzwords

Logiciels

Automatically scaling Kubernetes
pods based on Azure metrics

Hi!
Tom Kerkhove
• Azure Consultant at Codit
• Microsoft Azure MVP & Advisor
• Belgian Azure User Group (AZUG)
blog.tomkerkhove.be
@TomKerkhove
tomkerkhove

Orders API
Pod
Orders Processor
Pod
Azure Service Bus

Autoscaling pods in Kubernetes
• Horizontal Pod Autoscaler (HPA)
• Allows you to automatically scale out/in pods in a deployment
• Built-in metrics such as CPU
• Support for custom metrics is coming
• GitHub issue #177
• Requires a metrics aggregator adapter (list)
• Prometheus
• Google StackDriver

What is Prometheus?
• Open-source monitoring & alerting
• Part of Cloud Native Computing Foundation since 2016

Orders API
Pod
Orders Processor
Pod
Azure Service Bus Azure Monitor
Horizontal Pod Autoscaler
Prometheus

Introducing Promitor Alpha
• Automatically scrapes Azure Monitor metrics
• Provides scraping endpoint for Prometheus
• Easy to declare metrics to scrape via YAML & APIs
• Easily deployable via Docker & Kubernetes
• Built-in support for a variety of Azure services
• Currently supports Azure Service Bus Queues, more on the way
• Open-Source on GitHub: https://github.com/tomkerkhove/promitor
• Documentation on promitor.io

Orders API
Pod
Orders Processor
Pod
Azure Service Bus Azure Monitor
Horizontal Pod Autoscaler
Prometheus Promitor

Contenu connexe

Tendances

The city of Langford has a homegrown timesheet entry system. This system has been integrated to SharePoint 2010 for submission and approval. This presentation will show how the submission (via code) and approval (code – less) are implemented. Kevin Dube has been working with SharePoint since 2008 for the City of Langford wearing many hats (support, administration & development). Kevin’s blog site is: http://www.greenroomsolutions.ca/blog/

Timesheet Approval Process

Regroove

Power Friday - Introduction to Azure Integration services

Wagner Silveira

Tracing Java Applications on Azure

CodeOps Technologies LLP

CREATING REAL TIME DASHBOARD WITH BLAZOR, AZURE FUNCTION COSMOS DB AN AZURE S...

CodeOps Technologies LLP

Using Terraform for AWS as the IaC tool

Lay How

Microservices are on the cusp of becoming the dominant style of software architecture in the enterprise. The benefits that are realized—increased developer velocity, improved organizational agility, and reduced time-to-market of new services—are a powerful catalyst that is driving this transformation. As practitioners, how do we successfully fit microservices into the models and processes we already have in place? Join Tom Kerkhove, an Azure Architect with many years of experience helping enterprises make this exact transition, for a hands-on experience demonstrating how he helps enterprises make the transition to API-first architectures and microservices in a hybrid, multi-cloud world.

Microsoft Ignite 2019 - API management for microservices in a hybrid and mult...

Tom Kerkhove

IglooConf 2020 - API management for microservices in a hybrid and multi-cloud...

Tom Kerkhove

App Services - Connecting the dots of Web Mobile and Integration_published

Wagner Silveira

European SharePoint Conference - TH3

Rick Van Rousselt

Fission Introduction

Ta Ching Chen

by Mike Resseler So you have a few or all of the components of the System Center suite installed… How about bringing them all together and integrating them? How about making sure that your investment in this suite pays off and you get some automation work done out of the box? In this session you will see (with lots of demo’s) how you can easily integrate the components, get 80% of your work automated and much more…

Sysctr Track: Integrating the components of the System Center suite… The next...

ITProceed

Speed and agility are the most expected in today’s analytics tools. The quicker you get from idea to insights, the more you can innovate & perform ad-hoc data analysis. I will be talking about how we can use AWS serverless architecture to stream IoT data, managed by python. We can be up and running in minutes―starting small, but able to easily grow to millions of devices and billions of messages.

Iot meets Serverless

Narendran R

My session slides from unityConnect 2016 in Haarlem

Rick Van Rousselt

Serverless Logging Architecture

Narendran R

Session Slides from DEVintersection Europe

Rick Van Rousselt

Introduction to Azure Functions - Tutorial

BizTalk360

In this session, we will discuss a use case where we need to quickly develop web and mobile front end applications which are using several different frameworks, hosting options, and complex integrations between systems under the hood. Let’s see how we can leverage serverless technologies (Azure Functions and logic apps) and Low Code/No code platform to achieve the goal. During the session we will go though the code followed by a demonstration.

CREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNER

CodeOps Technologies LLP

Azure Functions for Python developers

Hansamali Gamage

This presentation is from the Integration Day event, a TechMeet360 Community Initiative, held on September 10, 2016 at Microsoft GSTC in Bangalore. In this slide, Microsoft's Escalation Engineers Tulika Chaudharie and Harikharan Krishnaraju explain using Azure Functions for Integration. The presentation starts with a general overview of Azure Functions and then it moves on to some of the common Integration Patterns and how Azure Functions fit into the scenarios.

Using Azure Functions for Integration

BizTalk360

AWS Community Day Bangkok 2019 - Dev Ops Philosophy Increase Productivity

AWS User Group - Thailand

Tendances (20)

Timesheet Approval Process

Power Friday - Introduction to Azure Integration services

Tracing Java Applications on Azure

CREATING REAL TIME DASHBOARD WITH BLAZOR, AZURE FUNCTION COSMOS DB AN AZURE S...

Using Terraform for AWS as the IaC tool

Microsoft Ignite 2019 - API management for microservices in a hybrid and mult...

IglooConf 2020 - API management for microservices in a hybrid and multi-cloud...

App Services - Connecting the dots of Web Mobile and Integration_published

European SharePoint Conference - TH3

Fission Introduction

Sysctr Track: Integrating the components of the System Center suite… The next...

Iot meets Serverless

My session slides from unityConnect 2016 in Haarlem

Serverless Logging Architecture

Session Slides from DEVintersection Europe

Introduction to Azure Functions - Tutorial

CREATE RELIABLE AND LOW-CODE APPLICATION IN SERVERLESS MANNER

Azure Functions for Python developers

Using Azure Functions for Integration

AWS Community Day Bangkok 2019 - Dev Ops Philosophy Increase Productivity

Similaire à Intelligent Cloud Conference 2018 - Automatically scaling Kubernetes pods based on Azure metrics

Azure Functions 101

Martin Abbott

Microsoft Partners - Application Autoscaling Made Easy With Kubernetes Event-...

Tom Kerkhove

NDC London 2021 - Application Autoscaling Made Easy With Kubernetes Event-Dri...

Tom Kerkhove

Zure Azure PaaS Zero to Hero - DevOps training day

Okko Oulasvirta

Serverless architecture is the next big shift in computing - completely abstracting the underlying infrastructure and focusing 100% on the business logic. Today we can create applications directly in our browser and leave the decision how they are hosted and scaled to the cloud provider. Moreover, this approach give us incredible control over the granularity of our applications since most of the time we are dealing with single function at a time. In this presentation we will cover: • Introduce Serverless Architectures • Talk about the advantages of Serverless Architectures • Discuss in details in event-driven computing • Cover common Serverless approaches • See practical applications with Azure Functions • Compare AWS Lambda and Azure Functions • Talk about open source alternatives • Explore the relation between Microservices and Serverless Architectures

Tokyo Azure Meetup #7 - Introduction to Serverless Architectures with Azure F...

Tokyo Azure Meetup

Introduction to Promitor

Tom Kerkhove

Open service broker API with Azure Kubernetes Services

Jorge Arteiro

شرح عن منتج Azure DevOps و اهم مكوناته و كيفيه الحصول على الشهادة Azure DevOps Expert Azure DevOps link: https://dev.azure.com Exam AZ-103: Microsoft Azure Administrator https://docs.microsoft.com/en-us/learn/certifications/exams/az-103 Exam AZ-203: Developing Solutions for Microsoft Azure https://docs.microsoft.com/en-us/learn/certifications/exams/az-203 Exam AZ-400: Microsoft Azure DevOps Solutions https://docs.microsoft.com/en-us/learn/certifications/exams/az-400 مصادر تعليم الخاصه بالشهادات https://cloudsociety.fastlane.live/courses My Twitter account https://twitter.com/ahmad_ezzeir My Facebook page: https://www.facebook.com/Arabic-DevOps-Ahmad-Ezzeir-100543094861932

Azure DevOps Overview [Arabic]

ahmadezzeir

Modern solutions are based on complex architectures, which are made of multiple layers and services. Often, to run your solutions, you need to host services on Azure, configure services in Office 365, and provision content in SharePoint Online. Deploying manually such kind of solutions in target environments can be really challenging, time consuming, and error-prone. In this session, you will learn how to automate the provisioning of such kind of solutions using the Microsoft Graph, the Azure Management API, and the REST API more in general. During the session you will see a real case study, based on the open source PnP Partner Pack Setup Wizard.

D2 - Automate Custom Solutions Deployment on Office 365 and Azure - Paolo Pia...

SPS Paris

Tokyo azure meetup #8 azure update, august

Tokyo Azure Meetup

Tokyo azure meetup #8 - Azure Update, August

Kanio Dimitrov

AKS Azure Kubernetes Services - Azure Nights melbourne feb 2018

Jorge Arteiro

How to build a serverless helmet detection system

Mandar Dharmadhikari

For the last year Sourced has been assisting a large Canadian based financial organization migrate workloads to Microsoft's Azure public cloud platform. As part of this deployment, Puppet is leveraged to ensure high levels of automation and compliance across the environment. In this updated session we will walk through our approach to integrating Puppet in Azure environments to ensure that automation, security, compliance and infrastructure as code is at the forefront.

PuppetConf 2017: Unlocking Azure with Puppet Enterprise- Keiran Sweet, Source...

Puppet

SPS calgary 2017 introduction to azure functions microsoft flow

Vincent Biret

Azure full

Mohit Chhabra

Serverless Summit 22 - micro-frontends aws archiecture

lagrotteri

Welcome to Azure Devops

Alessandro Scardova

To run automated tests, the task is often to create an isolated environment for various platforms, but building such environments for testing is far from the easiest task. We also want to have a monitoring and control system for autotests and test code, analyze the stability of tests and the quality of the tested software - the task becomes even more difficult. Microsoft's Azure DevOps Cloud Services helped me with these challenges, and for free. Let's get acquainted with service services (Azure Pipelines, Azure Test Plans, Azure Boards, Azure Repos, Azure Artifacts), which will help us complement workflows, improve planning accuracy, quality, productivity and speed of delivery of our Open Source solutions both for the user and for our own development ... Let's see how easy it is to set up CI / CD pipelines and flexibly parameterize configurations, manage packages using Azure DevOps on MacOS, Unix, Windows, perform analysis and get results.

Azure DevOps for QA Automation

Evgeny Popovich

Connector API Apps

BizTalk360

Similaire à Intelligent Cloud Conference 2018 - Automatically scaling Kubernetes pods based on Azure metrics (20)

Azure Functions 101

Microsoft Partners - Application Autoscaling Made Easy With Kubernetes Event-...

NDC London 2021 - Application Autoscaling Made Easy With Kubernetes Event-Dri...

Zure Azure PaaS Zero to Hero - DevOps training day

Tokyo Azure Meetup #7 - Introduction to Serverless Architectures with Azure F...

Introduction to Promitor

Open service broker API with Azure Kubernetes Services

Azure DevOps Overview [Arabic]

D2 - Automate Custom Solutions Deployment on Office 365 and Azure - Paolo Pia...

Tokyo azure meetup #8 azure update, august

Tokyo azure meetup #8 - Azure Update, August

AKS Azure Kubernetes Services - Azure Nights melbourne feb 2018

How to build a serverless helmet detection system

PuppetConf 2017: Unlocking Azure with Puppet Enterprise- Keiran Sweet, Source...

SPS calgary 2017 introduction to azure functions microsoft flow

Azure full

Serverless Summit 22 - micro-frontends aws archiecture

Welcome to Azure Devops

Azure DevOps for QA Automation

Connector API Apps

Plus de Tom Kerkhove

Techorama 2022 - Adventures of building Promitor, an open-source product

Tom Kerkhove

Azure Lowlands 2020 - API management for microservices in a hybrid and multi-...

Tom Kerkhove

Building Bruges 2020 - Adventures of building a multi-tenant PaaS on Microsof...

Tom Kerkhove

AZUG Lightning Talk - Application autoscaling on Kubernetes with Kubernetes E...

Tom Kerkhove

IglooConf 2020 - Adventures of building a multi-tenant PaaS on Microsoft Azure

Tom Kerkhove

Integrate UK 2019 - Adventures of building a (multi-tenant) PaaS on Microsoft...

Tom Kerkhove

Building a multi-tenant PaaS is not a walk in the part, certainly if the platform you are building on is constantly changing. In this session I'll walk you through the adventure we've been on where you'll learn about the challenges we've had and how we approached them and whether or not our decisions worked out or not. – How to design for scale – How to operate the platform – How to grow a platform mindset and force ownership – How to run tests for your whole platform – How to design for multi-tenancy – How to approach constant change – etc Cloud projects are never finished so you'd better come prepared.

Techdays Finland 2019 - Adventures of building a (multi-tenant) PaaS on Micro...

Tom Kerkhove

Azure Low Lands 2019 - Building secure cloud applications with Azure Key Vault

Tom Kerkhove

Next Generation Data Integration with Azure Data Factory

Tom Kerkhove

Intelligent Cloud Conference 2018 - Building secure cloud applications with A...

Tom Kerkhove

Azure Data Factory is a hybrid data integration service in Azure that allows you to create, manage & operate data pipelines in Azure. It is a serverless orchestrator that allows you to create data pipelines to either move, transform, load data; a fully managed Extract, Transform, Load (ETL) & Extract, Load, Transform (ELT) service if you will. In this talk I'll cover the basics of Azure Data Factory and show you how you can create, manage & operate data pipelines.

Intelligent Cloud Conference 2018 - Next Generation of Data Integration with ...

Tom Kerkhove

NDC Minnesota - Analyzing StackExchange data with Azure Data Lake

Tom Kerkhove

Techdays Finland 2018 - Building secure cloud applications with Azure Key Vault

Tom Kerkhove

Big data is the new big thing where storing the data is the easy part. Gaining insights in your pile of data is something different. Based on a data dump of the well-known StackExchange websites, we will store & analyse 150+ GB of data with Azure Data Lake Store & Analytics to gain some insights about their users. After that we will use Power BI to give an at a glance overview of our learnings. If you are a developer that is interested in big data, this is your time to shine! We will use our existing SQL & C# skills to analyse everything without having to worry about running clusters.

NDC Sydney - Analyzing StackExchange with Azure Data Lake

Tom Kerkhove

The Internet-of-Things was one of the big hypes in 2015 but it’s more than that – Customers want to build out their own infrastructures and act on their data. Today we’ll look at how Microsoft Azure helps us to build scalable solutions to process events from thousands of devices in a secure manner and the challenges it has. Once the data is in the cloud we’ll also take a look at ways we can learn from our measurements.

TechDays NL 2016 - Building your scalable secure IoT Solution on Azure

Tom Kerkhove

Integration Monday - Analysing StackExchange data with Azure Data Lake

Tom Kerkhove

Security has become more and more important as we move to the cloud and countries & companies are being hacked – remember the Sony hack? But how do we securely store sensitive data such as connection strings to our databases? Where do we store our encryption keys? Can I share them with my customers? How do I prevent abuse of my secrets and block them from doing so? That’s what this session is all about – I will introduce you to the concepts of Microsoft Azure Key Vault where you can use this as it allows you to securely store keys, credentials and other secrets in the cloud. We will also have a look at how it enables us to store encryption keys for SQL Server TDE and how it can help you safeguard your cloud solutions even more.

ITProceed 2015 - Securing Sensitive Data with Azure Key Vault

Tom Kerkhove

As a developer you often have to use & store a lot of sensitive data going from service credentials to connection strings or even encryption keys. But how do I store these in a secure way? How do I know who has access to them and how do I prevent people from copying them and abusing them? On the other hand, SaaS customers have no clue how you store their sensitive data and how they use it. How can they monitor that? How can they revoke your access easily? Watch the recording here - http://azug.be/2015-05-05---securing-sensitive-data-with-azure-key-vault

Securing sensitive data with Azure Key Vault

Tom Kerkhove

GWAB - Hop on the Service Bus!

Tom Kerkhove

GWAB - Kinecting the Cloud.

Tom Kerkhove

Plus de Tom Kerkhove (20)