DigitalOcean Microservices Talk Rocket Internet Conf '16

•

0 j'aime•256 vues

Matthew Campbell

How Digita Ocean Builds Microservices, a hands on approach

Technologie

Cloud in your cloud
Building the cloud with Microservices

About Me
• Technical Lead Digital Ocean 
• Microservices in GO Book
• Lives in Bangkok

Microservices
• Organizational scaling tool 
• Most great companies  
start as a monolith

Apps
Vertical Product
*dozen nodes*
• Customer Dashboard
• Community Site
• Cloud Api
• Billing
• VM Images
• VM Scheduler
• Server creation
• Metrics
• Monitoring
• Software Networking
Fleet Wide
*10,000(s) nodes*
• Metrics
Customer Hosted
*million(s) nodes*

Questions?
We’re Hiring!
Matthew Campbell
hyper@hyperworks.nu
@kanwisher
github.com/mattkanwisher

Contenu connexe

Tendances

Serverless Architectures

Lynn Langit

Embracing Serverless with Google

Joseph Lust

My graduation project on Opsschool ('the elephant')

Liora Kamil

Keystone event processing pipeline on a dockerized microservices architecture

Zhenzhong Xu

Scenejs

Lindsay Kay

Cloudsolutionday 2016: Docker & FAAS at getvero.com

AWS Vietnam Community

Itera Dev Meetup - Function as a Service - Serverless architecture

Pavol Rajzák

Kafka Connectors are used extensively in data migration solutions, serving as a middle tier when migrating data across databases. In addition, microservice architectures also use Kafka Connectors heavily when communicating with one another while still operating independently on their own data stores. In this talk, we cover these use cases in more detail along with a deep dive into the architecture of the source and sink Kafka Connectors for Cosmos DB.

Azure Cosmos DB Kafka Connectors | Abinav Rameesh, Microsoft

HostedbyConfluent

Through the looking glass an intro to scalable, distributed counting in data...

Geoff Cooney

Firebase Cloud Functions: a quick overview

Joseph Lust

One of the great things about running applications in the cloud is that you only pay for the resources that you use. But that also makes it more important than ever for our applications to be resource-efficient. This becomes even more critical when we use serverless functions. Micronaut is an application framework that provides dependency injection, developer productivity features, and excellent support for Apache Kafka. By performing dependency injection, AOP, and other productivity-enhancing magic at compile time, Micronaut allows us to build smaller, more efficient microservices and serverless functions. In this session, we'll explore the ways that Apache Kafka and Micronaut work together to enable us to build fast, efficient, event-driven applications. Then we'll see it in action, using the AWS Lambda Sink Connector for Confluent Cloud.

Event-driven Applications with Kafka, Micronaut, and AWS Lambda | Dave Klein,...

HostedbyConfluent

Cognos tm1 Online Training

Nagendra Kumar

Kubernetes & Google Container Engine @ mabl

Joseph Lust

Serverless Architecture GCP In Production

Oliver Fierro

Bootstrapping a Kubernetes cluster is easy, rolling it out to nearly 200 engineering teams and operating it at scale is a challenge. In this talk, we are presenting our approach to Kubernetes provisioning on AWS, operations and developer experience for our growing Zalando Technology department. We will highlight in the context of Kubernetes: AWS service integrations, our IAM/OAuth infrastructure, cluster autoscaling, continuous delivery and general developer experience. The talk will cover our most important learnings and we will openly share failure stories. Talk given at Container Days HH (https://containerdays.io/) on 2017-06-20.

Large Scale Kubernetes on AWS at Europe's Leading Online Fashion Platform - C...

Henning Jacobs

Serverless with Google Cloud Functions

Jerry Jalava

Function-as-a-Service "serverless" cloud offerings provide you with a super easy way to run custom code in response to events. One promise of FaaS model is the ability to scale without limits, up or down, whenever needed. But how does that work in practice? Can AWS Lambda handle thousands of messages per second? How fast can Azure Functions scale up under sudden heavy load? What kind of latency can you expect from Google Cloud Functions? During this session Mikhail will share with you short tales, each of them teaching a lesson about practical scalability of serverless applications. You will also explore the steps to evaluate whether your application profile is suitable for serverless today.

Performance Tales of Serverless - CloudNative London 2018

☁️ Mikhail Shilkov

eBay inc runs one of the largest Openstack based private clouds in the world offering various infrastructural services to its developers. However, developing cloud-scale services using only infrastructural primitives poses a really hard problem. We have been playing around with Kubernetes from early on with the intention of adopting it as the standard base for developing web scale platform services. In this presentation cover: -The motivations behind adopting Kubernetes The technical challenges and solutions for making Kubernetes work on Openstack, specifically on the following areas of: -Networking -Storage -Identity and Access Management -Future plans and priorities -Q&A KubeCon schedule link: http://sched.co/4ZUU

Cloud-Scale Kubernetes at eBay

KubeAcademy

Owain Perry (Just Giving) - Continuous Delivery of Windows Micro-Services in ...

Outlyer

Continuously delivered scalable geoservies

Daniel Fenton

Tendances (20)

Serverless Architectures

Embracing Serverless with Google

My graduation project on Opsschool ('the elephant')

Keystone event processing pipeline on a dockerized microservices architecture

Scenejs

Cloudsolutionday 2016: Docker & FAAS at getvero.com

Itera Dev Meetup - Function as a Service - Serverless architecture

Azure Cosmos DB Kafka Connectors | Abinav Rameesh, Microsoft

Through the looking glass an intro to scalable, distributed counting in data...

Firebase Cloud Functions: a quick overview

Event-driven Applications with Kafka, Micronaut, and AWS Lambda | Dave Klein,...

Cognos tm1 Online Training

Kubernetes & Google Container Engine @ mabl

Serverless Architecture GCP In Production

Large Scale Kubernetes on AWS at Europe's Leading Online Fashion Platform - C...

Serverless with Google Cloud Functions

Performance Tales of Serverless - CloudNative London 2018

Cloud-Scale Kubernetes at eBay

Owain Perry (Just Giving) - Continuous Delivery of Windows Micro-Services in ...

Continuously delivered scalable geoservies

Similaire à DigitalOcean Microservices Talk Rocket Internet Conf '16

Niko Kurtti talks about the challenges Shopify saw in moving from a traditional host-based infrastructure to a cloud native one, moving not only their core app to Kubernetes but also hundreds of other apps at the same time. He focuses on the cluster tooling solutions they've built, such as controllers, cluster creators, and deploy tools. Filmed at qconnewyork.com. Niko Kurtti is a production engineer at Shopify. He started out as a software developer doing web apps with Java, but since then fell in love with container technologies. He was part of the effort to roll out Docker in production at Shopify in 2014 and is still working around the same domain, but today the focus is on Shopify’s internal PaaS based on k8s.

Forced Evolution: Shopify's Journey to Kubernetes

C4Media

GCP Meetup #3 - Approaches to Cloud Native Architectures

nine

Data Streaming with Apache Kafka & MongoDB

confluent

Building Microservices with gRPC and NATS

Shiju Varghese

AWS Architecture Case Study: Real-Time Bidding

Amazon Web Services

Azure - The Good Parts

Mark Allan

MongoDB World 2018: MongoDB and Cloud Foundry – A Match Made for the Cloud

MongoDB

An afternoon with mongo db new delhi

Rajnish Verma

Google Cloud Fundamentals by CloudZone

Idan Tohami

Deep Dive on Microservices and Docker

Kristana Kane

DevOps Cardiff - Monitoring Automation for DevOps

Outlyer

"Google's ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels. This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.” - Wired --- Well, Wired hit the nail on the head with this quote about our platform. In this presentation we cover most of the new interesting features that will give you the ability to scale with (a big) smile!

Google Cloud - Scale With A Smile (Dec 2014)

Ido Green

How leading financial services organisations are winning with tech

MongoDB

This session focuses on the great opportunities that cloud integration brings to your business. Common challenges and pitfalls for hybrid messaging-based and API-based integration are discussed. Next to that, Codit's added-value approach to hybrid integration is presented, which combines a solid foundation of 15 years integration experience with an innovative and rapidly moving Azure cloud platform.

Cloud integration: what's in it for you? (Toon Vanhoutte & Massimo Crippa at ...

Codit

Data Streaming with Apache Kafka & MongoDB - EMEA

Andrew Morgan

Webinar: Data Streaming with Apache Kafka & MongoDB

MongoDB

Code first in the cloud: going serverless with Azure

Jeremy Likness

Cloud Native Patterns with Bluemix Developer Console

Matthew Perrins

Microservices: Living Large in Your Castle Made of Sand

MongoDB

Designing microservices

Masashi Narumoto

Similaire à DigitalOcean Microservices Talk Rocket Internet Conf '16 (20)

Forced Evolution: Shopify's Journey to Kubernetes

GCP Meetup #3 - Approaches to Cloud Native Architectures

Data Streaming with Apache Kafka & MongoDB

Building Microservices with gRPC and NATS

AWS Architecture Case Study: Real-Time Bidding

Azure - The Good Parts

MongoDB World 2018: MongoDB and Cloud Foundry – A Match Made for the Cloud

An afternoon with mongo db new delhi

Google Cloud Fundamentals by CloudZone

Deep Dive on Microservices and Docker

DevOps Cardiff - Monitoring Automation for DevOps

Google Cloud - Scale With A Smile (Dec 2014)

How leading financial services organisations are winning with tech

Cloud integration: what's in it for you? (Toon Vanhoutte & Massimo Crippa at ...

Data Streaming with Apache Kafka & MongoDB - EMEA

Webinar: Data Streaming with Apache Kafka & MongoDB

Code first in the cloud: going serverless with Azure

Cloud Native Patterns with Bluemix Developer Console

Microservices: Living Large in Your Castle Made of Sand

Designing microservices

Plus de Matthew Campbell

Practical Plasma: Gaming. Upbit Developers conference 2018

Matthew Campbell

Microservices Python bangkok

Matthew Campbell

Intro to microservices GopherDay Taipei '17

Matthew Campbell

Distributed Timeseries Database In Go (gophercon India 17)

Matthew Campbell

Containers are the future for all microservice based apps. Where do you deploy them? How do you manage them? At Digital Ocean we went through growing pains of trying out 5 of the top major Docker container schedulers, Mesos, Kubernetes, Docker Swarm, Nomad and we even tried manual scheduling of containers. Let us walk you through how we chose different schedulers for different applications, and tips and tricks for choosing a scheduler to use.

Distributed scheduler hell (MicroXChg 2017 Berlin)

Matthew Campbell

Breaking Prometheus (Promcon Berlin '16)

Matthew Campbell

presentation-chaos-monkey

Matthew Campbell

Intro to GO (Bangkok Launchpad 2014)

Matthew Campbell

Plus de Matthew Campbell (8)

Practical Plasma: Gaming. Upbit Developers conference 2018

Microservices Python bangkok

Intro to microservices GopherDay Taipei '17

Distributed Timeseries Database In Go (gophercon India 17)

Distributed scheduler hell (MicroXChg 2017 Berlin)

Breaking Prometheus (Promcon Berlin '16)

presentation-chaos-monkey

Intro to GO (Bangkok Launchpad 2014)

Dernier

🐬 The future of MySQL is Postgres 🐘

RTylerCroy

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

GenCyber Cyber Security Day Presentation

Michael W. Hawkins

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

What is a good lead in your organisation? Which leads are priority? What happens to leads? When sales and marketing give different answers to these questions, or perhaps aren't sure of the answers at all, frustrations build and opportunities are left on the table. Join us for an illuminating session with Cian McLoughlin, HubSpot Principal Customer Success Manager, as we look at that crucial piece of the customer journey in which leads are transferred from marketing to sales.

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

HampshireHUG

[2024]Digital Global Overview Report 2024 Meltwater.pdf

hans926745

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Rafal Los

Finology Group – Insurtech Innovation Award 2024

The Digital Insurer

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Scaling API-first – The story of a global engineering organization

Radu Cotescu

Enterprise Knowledge’s Urmi Majumder, Principal Data Architecture Consultant, and Fernando Aguilar Islas, Senior Data Science Consultant, presented "Driving Behavioral Change for Information Management through Data-Driven Green Strategy" on March 27, 2024 at Enterprise Data World (EDW) in Orlando, Florida. In this presentation, Urmi and Fernando discussed a case study describing how the information management division in a large supply chain organization drove user behavior change through awareness of the carbon footprint of their duplicated and near-duplicated content, identified via advanced data analytics. Check out their presentation to gain valuable perspectives on utilizing data-driven strategies to influence positive behavioral shifts and support sustainability initiatives within your organization. In this session, participants gained answers to the following questions: - What is a Green Information Management (IM) Strategy, and why should you have one? - How can Artificial Intelligence (AI) and Machine Learning (ML) support your Green IM Strategy through content deduplication? - How can an organization use insights into their data to influence employee behavior for IM? - How can you reap additional benefits from content reduction that go beyond Green IM?

Driving Behavioral Change for Information Management through Data-Driven Gree...

Enterprise Knowledge

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

Dernier (20)

🐬 The future of MySQL is Postgres 🐘

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

Partners Life - Insurer Innovation Award 2024

GenCyber Cyber Security Day Presentation

GenAI Risks & Security Meetup 01052024.pdf

Strategies for Landing an Oracle DBA Job as a Fresher

Apidays New York 2024 - The value of a flexible API Management solution for O...

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

[2024]Digital Global Overview Report 2024 Meltwater.pdf

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Powerful Google developer tools for immediate impact! (2023-24 C)

Exploring the Future Potential of AI-Enabled Smartphone Processors

Boost Fertility New Invention Ups Success Rates.pdf

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Finology Group – Insurtech Innovation Award 2024

How to Troubleshoot Apps for the Modern Connected Worker

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Scaling API-first – The story of a global engineering organization

Driving Behavioral Change for Information Management through Data-Driven Gree...

HTML Injection Attacks: Impact and Mitigation Strategies

DigitalOcean Microservices Talk Rocket Internet Conf '16

1. Cloud in your cloud Building the cloud with Microservices

2. About Me • Technical Lead Digital Ocean  • Microservices in GO Book • Lives in Bangkok 

3. Microservices • Organizational scaling tool  • Most great companies   start as a monolith

4. Apps Vertical Product *dozen nodes* • Customer Dashboard • Community Site • Cloud Api • Billing • VM Images • VM Scheduler • Server creation • Metrics • Monitoring • Software Networking Fleet Wide *10,000(s) nodes* • Metrics Customer Hosted *million(s) nodes*

6. Build

7. Monorepo

8. Pull Request Driven development

9. GRPC vs HTTP/JSON

10. Service Discovery

11. Consul Dashboard

12.

13. Consul Replication Regions

14. DNS SRV vs API For discovery

15. Deploy

16. Docker Images Created on every build

17. Instead of branches Feature Flags