PyCon 2013 - Distributed Monitoring Configuration

•

0 j'aime•1,332 vues

Schlomo Schapiro

Technologie Formation

1. Konfiguration wird per RPM
Paket installiert
2. Technische Koppelung
fachlicher Zusammen- hänge
3. Keine hostübergreifenden
RPM Abhängigkeiten

Icinga Process that needs the
Monitoring / Alarming Configuration

Deploy Software & Configuration
and Monitoring / Alarming Configuration

https://github.com/ImmobilienScout24/monitoring-config-generator
Write Config & Reload

monitoring-config-generator

HTTP GET

YAML-based
Icinga
Configuration

yaml-server

/etc/monitoring/
00_default.yaml
20_httpd.yaml
80_webapp.yaml
https://github.com/ImmobilienScout24/yaml-server

Thank you very much!
Please contact me for further
questions and discussions.
Kontakt:
Immobilien Scout GmbH
Andreasstraße 10
10243 Berlin

Fon:
+49 30 243 01-1229
Email: schlomo.schapiro@immobilienscout24.de
URL: www.immobilienscout24.de

All images are either public domain, used in appropriate
context or taken from openclipart.org

5

Contenu connexe

Similaire à PyCon 2013 - Distributed Monitoring Configuration

Blugento cloud foundry - components - principles

Thomas Fleck

Webinar - VIT Autocode for NUUO

Igor Orlov

HTML5 on the AGL demo platform with Chromium and WAM (AGL AMM March 2021)

Igalia

Machine Learning (ML) is quite popular today in the academic/research world. However, it is quite difficult to put into a product, especially a product with a huge customer base. This session will give Kubeflow, the open source ML toolkit on top of Kubernetes, a deep look from the MLOps perspective. Furthermore, we will have a brief look at Distributed MLSys and how Kubeflow copes with scalability. Last, a demo of the Kubeflow stack setup and ML project pipeline deployment will be demonstrated in the cloud.

Bring-your-ML-Project-into-Production-v2.pdf

Liang Yan

Event log analyzer by me

ER Swapnil Raut

Bangalore OpenMSA DevDay - September 19, 2018

UBiqube

Give your Foreman a greater toolbox with Plugins - Dirk Goetz - Foreman Birth...

NETWAYS

20160221 va interconnect_pub

Canturk Isci

>>> View this presentation online at http://github-service-universe.kimminich.de/ <<< PDF version of the slide deck for my JavaLand 2015 talk "All-round careful Software Development with GitHub Services" Tools for unit testing, building applications, analyzing software quality and planning release scopes are an essential aspect of modern software development. With GitHub and "pluggable" external services there are lots of options to move these aspects into "the Cloud". For open source projects this is a viable alternative to on-premise solutions. In this talk I will present and demonstrate the CI lifecycle of some of my recent projects hosted on GitHub where I tried to integrate modern tools (e.g. Gradle, npm, bower) and external services (e.g. Travis-CI, Code Climate, Coveralls, HuBoard, AmazonSNS, NMA). The benefits and limitations of those services will be honestly illuminated. I am not affiliated with any of the providers mentioned, so this talk will not end up as a marketing show! Instead, the audience is supposed go out of this talk with some new things to try out with their own GitHub projects while hopefully being able to avoid some of the ramp-up difficulties.

Exploring the GitHub Service Universe

Björn Kimminich

This webinar demonstrates how easy it is to manage snom UC edition phones natively via the Lync Server, by using only standard Lync PowerShell commands. Mass configuration and customization of IP phones is a challenge in Microsoft Lync Enterprise Voice projects. Until now additional hardware and vendor-specific knowledge was necessary to provision Lync qualified phones. The snom UC edition phones are the first Lync qualified devices to seamlessly integrate Lync Server components to overcome standard provisioning limitations.

Webinar: snom UC edition Phones and Native Lync Server Provisioning

snom technology

26.1.7 lab snort and firewall rules

Freddy Buenaño

Todo lo lo que necesita saber para implementar FreePBX

PaloSanto Solutions

24272005 opc html_gen_doku_v10_e

gabriela feer

Smart devices taking over our living rooms, our bed rooms, and, in general, our life. It has never been more important to build secure devices, but most companies seem to fail, and they fail hard. We (only) build systems for farms and barns, and still, I wanted security for Cow-stumers. Building a mostly secure system is fairly simple. There is a good set of low-hanging fruits. Building a really locked down system is tough, though. Much harder than expected. Here is what I learned.

What I learned about IoT Security ... and why it's so hard!

Christoph Engelbert

FBI & Secret Service- Business Email Compromise Workshop

Ernest Staats

week 4_watermark.pdfffffffffffffffffffff

anushka2002ece

Week 4 lecture material cc (1)

Ankit Gupta

HTTPS and HTTP/2

MatthewWalker9

Introduction to OVH Analytics Data Platform

OVHcloud

Cisco ASA Firepower

Anwesh Dixit

Similaire à PyCon 2013 - Distributed Monitoring Configuration (20)

Blugento cloud foundry - components - principles

Webinar - VIT Autocode for NUUO

HTML5 on the AGL demo platform with Chromium and WAM (AGL AMM March 2021)

Bring-your-ML-Project-into-Production-v2.pdf

Event log analyzer by me

Bangalore OpenMSA DevDay - September 19, 2018

Give your Foreman a greater toolbox with Plugins - Dirk Goetz - Foreman Birth...

20160221 va interconnect_pub

Exploring the GitHub Service Universe

Webinar: snom UC edition Phones and Native Lync Server Provisioning

26.1.7 lab snort and firewall rules

Todo lo lo que necesita saber para implementar FreePBX

24272005 opc html_gen_doku_v10_e

What I learned about IoT Security ... and why it's so hard!

FBI & Secret Service- Business Email Compromise Workshop

week 4_watermark.pdfffffffffffffffffffff

Week 4 lecture material cc (1)

HTTPS and HTTP/2

Introduction to OVH Analytics Data Platform

Cisco ASA Firepower

Plus de Schlomo Schapiro

What is the role of GitOps in IT strategy? This talk gives an overview and puts GitOps into the context of current challenges in IT strategy. Main aspects are continuous delivery, policy as code, automated governance, compliant-by-default work environments, acceptable means of compliance and a comprehensive automation of all development and operations related processes with the goal of true hands-off operations. The result places GitOps as a major building block of any modern IT strategy. GitOps helps building essential key IT capabilities. It creates the motivation to truly “fix the basics” via sustainable solutions to enable creating higher level automation solutions. With GitOps engineers can focus much more on business value and spend less effort on boring IT topics.

The Role of GitOps in IT-Strategy v2 - July 2022 - Schlomo Schapiro

Schlomo Schapiro

I will show why GitOps is a major waypoint in the journey from old-style Dev vs. Ops data center operations towards a truly automated hands-off operations future. GitOps is the technological core required for compliance automation, large-scale operations, and lowering the cost of compliance & governance as well as lowering the cost of internal tooling. GitOps will give us a future, where we all take a step back, watch the bots do the admin job, and where we Dev, Ops, everybody work on improving the bots and invent new automation solutions. Schlomo Schapiro is an Agile IT and Open Source enthusiast dedicated to advancing an agile mindset and a DevOps-orientated culture in IT. He works as Principal Engineer at Forto in Berlin, is author of several Open Source projects, conference speaker and regularly publishes blog and magazine articles. See https://schlomo.schapiro.org/2021/04/the-gitops-journey.html for more details.

The GitOps Journey - Schlomo Schapiro - Berlin DevOps Meetup 2021-11

Schlomo Schapiro

The Role of GitOps in IT-Strategy - November 2021 - Schlomo Schapiro - Contin...

Schlomo Schapiro

Schlomo Schapiro - Why I like to use the proprietary Cloud services without f...

Schlomo Schapiro

See https://www.youtube.com/watch?v=_uDzXmbiUIg for German-language talk to these slides. What is the role of GitOps in IT strategy? This talk gives an overview and puts GitOps into the context of current challenges in IT strategy. Main aspects are continuous delivery, policy as code, automated governance, compliant-by-default work environments, acceptable means of compliance and a comprehensive automation of all development and operations related processes with the goal of true hands-off operations. The result places GitOps as a major building block of any modern IT strategy. GitOps helps building essential key IT capabilities. It creates the motivation to truly “fix the basics” via sustainable solutions to enable creating higher level automation solutions. With GitOps engineers can focus much more on business value and spend less effort on boring IT topics.

The Role of GitOps in IT Strategy - June 2021 - Schlomo Schapiro

Schlomo Schapiro

The GitOps Journey - GitOpsCon EU 2021 - Schlomo Schapiro

Schlomo Schapiro

Cloud, Automation und DevOps als Treiber der Digitalisierung: Wir zeigen den Weg der Deutschen Bahn in die Zukunft. Unter dem Motto “Fix the Basics” entwickeln wir grundlegende Services für Engineers, die u.a. Security- und Compliance-Prüfungen automatisieren und die Teams dadurch in die Lage versetzen, sich auf die Produktion von Business Value zu fokussieren. Einer dieser Services ist Continuous Delivery as a Service, eine anpassbare, hochautomatisoierte CD-Implementierung, die nach dem Ansatz "compliant by default" eine einfache und richtlinienkonforme Möglichkeit zum Deployment von Software darstellt. Der Vortrag zeigt auf, dass die Automation von Security- und Compliance-Vorgaben bei gleichzeitigem Fokus auf Usability für die Engineers ein kritischer Bestandteil auf dem weg zur Digitalisierung ist. Teams werden in die Lage versetzt, ihren Code nachhaltig qualitativ zu verbessern, die Unternehmen profitieren durch die folgende Innovation und die Fokussierung auf Business-relevante Lösungen. Vorkenntnisse Keine Vorkenntnisse erforderlich Lernziele * Die enge Beziehung zwischen DevOps, Continuous Delivery und Cloud kennenlernen und verstehen, warum sie eine optimale Arbeitslandschaft für Entwickler bietet. * "Entwicklerproduktivität" sollte an erster Stelle stehen, da wir so unserem Team helfen, sich auf die Entwicklung neuer Features zu konzentrieren, statt auf die Suche nach dem richtigen Werkzeug. * Automation ist die Schlüsselfertigkeit, um den Dreiklang DevOps, CD und Cloud erfolgreich zu machen. * Die Bereitstellung von grundlegenden Services in der Entwicklung versetzt die eigene Entwicklung in die Lage, echte Innovation zu betreiben.

Want Digitalisation, have Cloud - DevSecOps Days 2021 - Schlomo Schapiro

Schlomo Schapiro

Video: https://youtu.be/U4cHbXYy1FQ How to combine traditional IT governance with continuous delivery? Not At All! A highly automated continuous deployment environment creates a whole new world of challenges for companies to meet their compliance and governance requirements. Traditional - manual - processes don’t manage to keep up with quick and frequent releases. The solution to this conflict of interests is the automation of all compliance checks and the automated certification of every software delivery into production. Sounds obvious and simple, but it is difficult to implement. The talk shows how we tackle this topic at DB Systel and how we create solutions for automated compliance certification. See https://bit.ly/5pdops for more materials and the 5 DevOps Principles

Automated Governance - Continous Lifecycle 2019 - Schlomo Schapiro

Schlomo Schapiro

Wie passt klassische IT Governance zu Continuous Delivery? Gar nicht! Eine hochgradig automatisierte Continuous Deployment Welt stellt die Firma vor ganz neue Herausforderungen im Bereich Compliance und Governance. Klassische - manuelle - Prozesse kommen den schnellen und häufigen Releases gar nicht mehr hinterher. Die Lösung ist die Automation aller Governance prüfungen und die automatisierte Zertifizierung jeder Softwarelieferung. Das klingt banal und einfach, ist im Detail jedoch nicht einfach umzusetzen. Der Vortrag zeigt am konkreten Beispiel der DB Systel, wie wir das Thema angehen und Lösungen für die automatisierte Zertifizierung geschaffen haben.

Compliant by Default - Digitaler Wandel - 14.08.2019 - Schlomo Schapiro

Schlomo Schapiro

Video: https://vimeo.com/348556177 DevOps ist normal – oder etwa doch nicht? Wer kann das schon für seine Firma guten Gewissens sagen? Während sich die übliche DevOps-Diskussion um das Wie dreht, adressiert Schlomo die Frage, wann DevOps normal geworden ist und was dafür passieren muss, damit alle dieser Meinung sind. Von einer neuen DevOps-Definition ausgehend stellt der Vortrag eine einfache Argumentationskette für DevOps vor, in der die DevOps-Transformation mit Fahren lernen verglichen wird. So wie es heutzutage normal ist, dass die meisten Erwachsenen einen Führerschein haben, so normal sollte DevOps in jeder IT sein. Diese Analogie lässt sich auch in einem Aufzugsgespräch verwenden, um das Management von der Normalität des DevOps-Ansatzes zu überzeugen. Mit der DevOps-Definition gelingt es den Teilnehmern, jede DevOps-Diskussion zu gewinnen und damit DevOps zur neuen Normalität zu machen. Am konkreten Beispiel der DB Systel zeigt der Vortrag, wie mit dem Thema DevOps-Teams konstruktiv umgegangen werden kann. Siehe https://bit.ly/5pdops für weiteres Material und die 5 DevOps Prinzipien

DevOps ist normal - DevOps Essentials 2019 - Schlomo Schapiro

Schlomo Schapiro

How to convince your company that DevOps is a transitional mode of operations and the means to a goal instead of goal in itself. What comes after DevOps is “done”? DevOps is like learning to drive and a “DevOps Team” is like a motor cycle driving school. You learn in theory and practice to survive amongst “live traffic”, where other road participants are not very considerate. You have to comply with a lot of regulations. From early on you drive your motor cycle alone and the driving instructor follows you in his car keeping a safe distance. He talks with you via radio and tells you where to pay attention and how to drive. But you drive all alone and by yourself - amongst live traffic. If you hit a tree and die, it is your own fault. If you cause a crash, it is your own fault. Same about learning DevOps. You are responsible for your product in production with “live traffic” and real customers. If you crash your server, it your own fault. If your code quality causes harm to the company, it is your own fault. Your DevOps Coach sits next to you and talks to you while you type away at your screen, like a driving instructor. In the end you prove your driving skills, get your license and ride happily singing full speed into the sunset. Same about DevOps, after a training period you work alone. You build it - you run it. You go full speed ahead and deliver value over value. Who has a bumper sticker claiming “I have a driving license”? That’s why “DevOps Team” is a passing thing and once you qualify you are just an Engineering Team who are fully responsible for their product end to end. No need to put a claim to what is normal, because DevOps is normal. Video: https://youtu.be/N2EWEfhQt2M

The Devops Driving School - DevOps Gathering 2019 - Schlomo Schapiro

Schlomo Schapiro

Open Source Contribution Policy at DB Systel - Schlomo Schapiro - AK Open Sou...

Schlomo Schapiro

Learn about the journey of Deutsche Bahn towards Cloud computing, DevOps and agile transformation, with special focus on our Continuous Delivery strategy and implementation. After a brief overview of what is happening at DB Systel, we will show our Continuous Delivery as-a-Service (CDaaS) approach. CDaaS is an integrative approach to Continuous Delivery ensuring governance and security compliance whilst being fully focused on the user experience. We will show the extensibility and simplicity of CDaaS and how it helps DevOps teams improve code quality. Key take aways are a profound understanding of the intimate relationship between DevOps, Continuous Delivery and Cloud which enables a truly integrated work environment for our developers. By putting ?Developer Productivity? first we ensure that our teams can focus on developing their features over choosing the right tool or knowing all platform topics in-depth

Compliant by Default - Continuous Delivery at DB Systel - 16.10.2018 - Schlom...

Schlomo Schapiro

More than just buzzwords, true agility depends on the successful combination of DevOps, Continuous Delivery and Cloud platforms. Learn which technology choices have the greatest impact on the company culture. Take DevOps adoption to the next level by introducing DevOps key performance indicators as a measure of your company’s progress. This session presents current developments and projects at DB Systel, the IT company of Deutsche Bahn.

DevOps + Continuous Delivery + Cloud: The Three Drivers of Enterprise Agility...

Schlomo Schapiro

Kubernetes: Shifting the mindset from servers to containers With Kubernetes pods and containers several fundamental assumptions of server operations don't apply any more. Some Linux services like SSH even disappear and are provided by Kubernetes instead. This talk explores the mindset shift that developers and admins of Linux servers have to do in order to fully take advantage of the power of a Kubernetes cluster: * Servers turn into pods * Linux application services turn into containers * Standard services like cron and SSH disappear completely * How to separate between initialization, run and maintenance phases * Building pods with multiple containers that work together Following practical examples from real migration projects participants gain a new understanding of the role of services, init scripts, cron jobs and other standard Linux components. Key takeaways are a better understanding of how to model a complex system on top of Kubernetes and practical tips for migrating servers into Kubernetes containers. Successfully adopting Kubernetes requires a big change in how developers and admins think about servers - bigger than any change before. Bigger than the change brought by VMs. This talk shows why it pays to change traditional concepts and to embrace the new world of Linux services modularization that Kubernetes stands for. See Using Kubernetes with Multiple Containers for Initialization and Maintenance (http://blog.schlomo.schapiro.org/2017/06/using-kubernetes-with-multiple.html) for more information and a demo.

Kubernetes - Shifting the mindset from servers to containers - microxchg 201...

Schlomo Schapiro

Root for All - Measuring DevOps Adoption DevOps is about culture and mindset more than about technology - but how do you measure success? How do you know if your company really "does" DevOps? It turns out that root access to production servers is not only the proverbial holy grail but actually serves as a fact-based measure for the trust and automation levels in an organization. This talk explores the connection between root access and automation on one hand and DevOps mindsets, cross functional teams and shared responsibility on the other hand. Based on practical experiences, the talk provides concrete suggestions for achieving true DevOps happiness. As a result you will know why in the end there is no harm at all in granting root access to everybody. Key takeaways are solid arguments that you can use to convince your boss and your peers to take a different approach on root access demonstrating how shared responsibility works for real. See Root for All - A DevOps Measure? (http://blog.schlomo.schapiro.org/2017/06/root-for-all-devops-measure.html) for more background information.

Root for all - measuring DevOps adoption - microxchg 2018 - Schlomo Schapiro

Schlomo Schapiro

How should our internal IT look in order to be a driving force for a company’s success in the digital age? This proposal is based on all my learnings from the previous 15 years and especially the Agile and DevOps revolution in IT. It takes the concept of a Product Development Organization to apply everywhere and provides a sure path to increase productivity and improve culture through technology. Transforming Corporate IT into a Workplace product takes internal IT out of the proverbial basement and puts it in the front of the internal value chain. Most of the standard tooling for product development also fits the Workplace product. This proposal is written for a typical company that employs both modern web technologies like G Suite and cloud services as well as traditional technologies like Microsoft Office and data centers.

GUUG FFG 2017 - DevOps for Everybody - A Workplace Strategy for the Digital Age

Schlomo Schapiro

DevOps ist aus der IT nicht mehr wegzudenken und hat sich als Arbeitsweise etabliert, die nicht nur die Qualität und operative Effizienz verbessert, sondern auch eine nachhaltige Entwicklung ermöglicht. In den meisten Unternehmen ist die IT jedoch eine Minderheit. Wie können wir mit den Ideen und Erkenntnissen aus der DevOps Welt die ganze Firma voranbringen? Warum funktioniert die agile Zusammenarbeit nicht automatisch mit anderen Abteilungen? Was macht die ITler so besonders? Die Schnittstelle zwischen allen Mitarbeitern und IT Themen ist die interne IT. Sie trägt die Verantwortung dafür, dass alle Mitarbeiter mit Hilfe von IT ihre Aufgaben effizient und effektiv erledigen können. Während die interne IT oftmals nur als Kostenstelle betrachtet wird, leistet sie in Wahrheit einen sehr hohen Beitrag zur Wertschöpfungskette: Schlechte Werkzeuge führen direkt zu langsamer Arbeit und frustrieren, gute Werkzeuge befähigen die Mitarbeiter und erhöhen die Freude an der gemeinsamen Arbeit. Heute leisten es sich viele Unternehmen noch, dass ihre Mitarbeiter auf einer digitalisierten Plattform manuelle Tätigkeiten verrichten. Messgrößen sind etwa die Anzahl der Copy-Paste Vorgänge (Mensch als technische Schnittstelle), die Anzahl an internen Emails mit Dateianhang (Dokumente werden vervielfältigt anstatt sie zentral bereit zu stellen) sowie die Anzahl der Logins die ein Mitarbeiter täglich absolviert (schwach oder gar nicht integrierte Systeme). Die Herausforderungen der fortschreitenden Digitalisierung und Verteuerung von Arbeitskraft erfordern hier auch ein Umdenken. Der Vortrag zeichnet einen Weg von DevOps in der IT zu einem neuen Denkansatz für den Umgang mit IT im Unternehmen. Dabei entwickeln sich Mitarbeiter von IT Konsumenten zu beteiligten Nutzern, die den Computer als Werkzeug für sich entdecken können. Die interne IT stellt nicht nur gute Services zur Verfügung sondern fokussiert sich auf die Produktivität und Zufriedenheit aller Mitarbeiter.

GUUG FFG 2017 - DevOps for Everybody - How the entire company can benefit fro...

Schlomo Schapiro

How Open Source, Agile Methods and DevOps come together at ImmobilienScout24. Was verbindet Open Source, Agiles Mindset und DevOps? In der richtigen Kombination dieser Themen entsteht für die IT eine neue Basis der Zusammenarbeit. Ein Rückblick auf die letzten 6 Jahre bei ImmobilienScout24 zeigt, wie die Anwendung in der Praxis unsere IT-Abteilung voran gebracht hat. Bei der Cloudmigration profitieren wir insbesondere von der offenen Kultur in der Firma und der Community.

DevOps, Agile and Open Source at ImmobilienScout24

Schlomo Schapiro

EuroPython 2014 YAML Reader Lightning Talk

Schlomo Schapiro

Plus de Schlomo Schapiro (20)