Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

•

36 j'aime•8,970 vues

A high-performance proxy server is less than a hundred lines of Ruby code and it is an indispensable tool for anyone who knows how to use it. In this session we will first walk through the basics of event-driven architectures and high-performance network programming in Ruby using the EventMachine framework.

Technologie

Ruby Proxies for Scale, Performance and Monitoring Ilya Grigorik CTO / AideRSS Event-Driven Architectures @igrigorik #meshu #eda http://bit.ly/eda

postrank.com/topic/ruby The slides… Twitter My blog

[object Object],“ Rails, Django, Seaside, Scala…” cant scale.

Proxies for Monitoring, Performance and Scale welcome to the wonderful world of intercepting, caching, … , proxy servers

Problem: Staging Environment Production Simulated User

“ Representative Load / Staging” Duplication Simulating traffic?

Replay log data, rinse, repeat github.com/igrigorik/autoperf

[object Object],[object Object],Real (production) traffic Duplex Ruby Proxy, FTW!

Same response, different turnaround time Different response body!

[object Object],1. Accept connection - Connect & Forward to Production - Connect & Forward to Staging 2. Stream response to client from Production - Buffer response from Staging 3. Run “Processor / Analyzer” once both return

Ruby EventMachine crash course EM::Connection #receive_data - new data ready for processing #unbind - connection terminated #connection_completed - connected

Forward Production Response Analyze Results

Pass response to Duplex Notify when done

%w[ <Transparent> Intercepting Caching … ] solution for every problem

Validating Proxy easy, real-time diagnostics Woops!

Who said you’re not allowed to touch the data? Intercepting Proxy for those hard-to-reach spots

SMTP / Mail: inject SPAM detection De(encrypt): stream data MySQL: inject sharding logic Intercepting Proxy for those hard-to-reach spots

@PostRank: Beanstalkd + Ruby Proxy because RAM is still expensive

[object Object],~ 93 Bytes of overhead per job ~300 Bytes of data / job x 80,000,000 jobs in memory ~ 30 GB of RAM = 2 X-Large EC2 instances Oi, expensive!

[object Object],Observations: 1. Each job is rescheduled several times 2. > 95% are scheduled for > 3 hours into the future 3. Beanstalkd does not have overflow page-to-disk Memory is wasted… We’ll add it ourselves!

@PostRank: “Chronos Scheduler” 1 “Medium” EC2 Instance Intercepting Proxy

Extend the protocol Chronos Scheduler Beanstalkd persistence Process incoming data Buffer “SCHEDULE” requests, otherwise forward

Archive to MySQL Chronos Scheduler Beanstalkd persistence Buffer “SCHEDULE”

@PostRank: “Chronos Scheduler” Extend the protocol ARCHIVE RESERVE, … 10 line patch to client: queue.archive(job)

@PostRank: “Chronos Scheduler” ~79,000,000 jobs, 4GB RAM ARCHIVE RESERVE, … Upcoming jobs: ~ 1M 400% cheaper + extensible! 1 Proxy, 1 Beanstalkd, 1 MySQL = 200 req/s

%w[ Transparent <Intercepting> Auth Cache … ] easy to make & a powerful hammer

Cheers. Questions? The slides… Twitter My blog

Recommandé

Ruby Proxies for Scale, Performance, and MonitoringIlya Grigorik

Event Driven Architecture - MeshU - Ilya GrigorikIlya Grigorik

Servers with Event Machine - David Troy - RailsConf 2011David Troy

0-60 with Goliath: Building High Performance Ruby Web-ServicesIlya Grigorik

0-60 with Goliath: High performance web servicesIlya Grigorik

No callbacks, No Threads - Cooperative web servers in Ruby 1.9Ilya Grigorik

Building WebSocket and Server Side Events Applications using Atmospherejfarcand

Ruby 1.9 FibersKevin Ball

Recommandé

Ruby Proxies for Scale, Performance, and MonitoringIlya Grigorik

Event Driven Architecture - MeshU - Ilya GrigorikIlya Grigorik

Servers with Event Machine - David Troy - RailsConf 2011David Troy

0-60 with Goliath: Building High Performance Ruby Web-ServicesIlya Grigorik

0-60 with Goliath: High performance web servicesIlya Grigorik

No callbacks, No Threads - Cooperative web servers in Ruby 1.9Ilya Grigorik

Building WebSocket and Server Side Events Applications using Atmospherejfarcand

Ruby 1.9 FibersKevin Ball

The Atmosphere Frameworkjfarcand

GWT Web Socket and data serializationGWTcon

WebSockets with Spring 4Sergi Almar i Graupera

Concurrent Ruby Application ServersLin Jen-Shin

Communication in Python and the C10k problemJose Galarza

Writing highly scalable WebSocket using the Atmosphere Framework and Scalajfarcand

Websockets on the JVM: Atmosphere to the rescue!jfarcand

The HTML5 WebSocket APIDavid Lindkvist

Asynchronous Web Programming with HTML5 WebSockets and JavaJames Falkner

Web sockets in JavaPance Cavkovski

Reverse ajax in 2014Nenad Pecanac

Writing Portable WebSockets in Javajfarcand

Realtime web application with javaJeongHun Byeon

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocketsametmax

Dancing with websocketDamien Krotkine

Introduction to performance tuning perl web applicationsPerrin Harkins

Building Real-Time Applications with Android and WebSocketsSergi Almar i Graupera

Beyond Breakpoints: A Tour of Dynamic AnalysisFastly

WebSockets wiith Scala and Play! FrameworkFabio Tiriticco

Going Live! with CometSimon Willison

Degrading Performance? You Might be Suffering From the Small Files SyndromeDatabricks

Making it fast: Zotonic & PerformanceArjan

Contenu connexe

Tendances

The Atmosphere Frameworkjfarcand

GWT Web Socket and data serializationGWTcon

WebSockets with Spring 4Sergi Almar i Graupera

Concurrent Ruby Application ServersLin Jen-Shin

Communication in Python and the C10k problemJose Galarza

Writing highly scalable WebSocket using the Atmosphere Framework and Scalajfarcand

Websockets on the JVM: Atmosphere to the rescue!jfarcand

The HTML5 WebSocket APIDavid Lindkvist

Asynchronous Web Programming with HTML5 WebSockets and JavaJames Falkner

Web sockets in JavaPance Cavkovski

Reverse ajax in 2014Nenad Pecanac

Writing Portable WebSockets in Javajfarcand

Realtime web application with javaJeongHun Byeon

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocketsametmax

Dancing with websocketDamien Krotkine

Introduction to performance tuning perl web applicationsPerrin Harkins

Building Real-Time Applications with Android and WebSocketsSergi Almar i Graupera

Beyond Breakpoints: A Tour of Dynamic AnalysisFastly

WebSockets wiith Scala and Play! FrameworkFabio Tiriticco

Going Live! with CometSimon Willison

Tendances (20)

The Atmosphere Framework

GWT Web Socket and data serialization

WebSockets with Spring 4

Concurrent Ruby Application Servers

Communication in Python and the C10k problem

Writing highly scalable WebSocket using the Atmosphere Framework and Scala

Websockets on the JVM: Atmosphere to the rescue!

The HTML5 WebSocket API

Asynchronous Web Programming with HTML5 WebSockets and Java

Web sockets in Java

Reverse ajax in 2014

Writing Portable WebSockets in Java

Realtime web application with java

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocket

Dancing with websocket

Introduction to performance tuning perl web applications

Building Real-Time Applications with Android and WebSockets

Beyond Breakpoints: A Tour of Dynamic Analysis

WebSockets wiith Scala and Play! Framework

Going Live! with Comet

Similaire à Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

Degrading Performance? You Might be Suffering From the Small Files SyndromeDatabricks

Making it fast: Zotonic & PerformanceArjan

Mysql Latencysrubinstein

(BDT318) How Netflix Handles Up To 8 Million Events Per SecondAmazon Web Services

Data Streaming Technology OverviewDan Lynn

Toster - Understanding the Rails Web Model and Scalability OptionsFabio Akita

Understanding the Rails web model and scalability options.toster

High Performance Cloud ComputingAmazon Web Services

node.js, javascript and the futureJeff Miccolis

Low latency in java 8 by Peter Lawrey J On The Beach

Systems Bioinformatics Workshop KeynoteDeepak Singh

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...Flink Forward

Deploying On EC2Steve Loughran

PuppetDB: Sneaking Clojure into Operationsgrim_radical

Scalable Apache for Beginnerswebhostingguy

Netflix Global Applications - NoSQL Search RoadshowAdrian Cockcroft

The Real World - Plugging the Enterprise Into It (nodejs)Aman Kohli

Perfomance tuning on Go 2.0Yogi Kulkarni

Shootout at the PAAS CorralPostgreSQL Experts, Inc.

Similaire à Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com (20)

Degrading Performance? You Might be Suffering From the Small Files Syndrome

Making it fast: Zotonic & Performance

Mysql Latency

(BDT318) How Netflix Handles Up To 8 Million Events Per Second

Data Streaming Technology Overview

Toster - Understanding the Rails Web Model and Scalability Options

Understanding the Rails web model and scalability options

High Performance Cloud Computing

node.js, javascript and the future

Low latency in java 8 by Peter Lawrey

Systems Bioinformatics Workshop Keynote

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...

Deploying On EC2

PuppetDB: Sneaking Clojure into Operations

Scalable Apache for Beginners

Netflix Global Applications - NoSQL Search Roadshow

The Real World - Plugging the Enterprise Into It (nodejs)

Perfomance tuning on Go 2.0

Shootout at the PAAS Corral

Plus de Ilya Grigorik

Pagespeed what, why, and how it worksIlya Grigorik

Making the web fast(er) - RailsConf 2012Ilya Grigorik

Ruby in the Browser - RubyConf 2011Ilya Grigorik

Intelligent Ruby + Machine LearningIlya Grigorik

No Callbacks, No Threads - RailsConf 2010Ilya Grigorik

Real-time Ruby for the Real-time WebIlya Grigorik

Ruby C10K: High Performance Networking - RubyKaigi '09Ilya Grigorik

Lean & Mean Tokyo Cabinet Recipes (with Lua) - FutureRuby '09Ilya Grigorik

Leveraging Social Media - Strategies & Tactics - PostRankIlya Grigorik

Building Mini Google in RubyIlya Grigorik

Taming The RSS BeastIlya Grigorik

Plus de Ilya Grigorik (11)

Pagespeed what, why, and how it works

Making the web fast(er) - RailsConf 2012

Ruby in the Browser - RubyConf 2011

Intelligent Ruby + Machine Learning

No Callbacks, No Threads - RailsConf 2010

Real-time Ruby for the Real-time Web

Ruby C10K: High Performance Networking - RubyKaigi '09

Lean & Mean Tokyo Cabinet Recipes (with Lua) - FutureRuby '09

Leveraging Social Media - Strategies & Tactics - PostRank

Building Mini Google in Ruby

Taming The RSS Beast

Dernier

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls

Histor y of HAM Radio presentation slidevu2urc

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo

How to convert PDF to text with Nanonetsnaman860154

My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada

Scaling API-first – The story of a global engineering organizationRadu Cotescu

IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

Finology Group – Insurtech Innovation Award 2024The Digital Insurer

How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes

A Call to Action for Generative AI in 2024Results

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software

Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes

🐬 The future of MySQL is Postgres 🐘RTylerCroy

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia

Dernier (20)

Data Cloud, More than a CDP by Matt Robison

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

Histor y of HAM Radio presentation slide

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

How to convert PDF to text with Nanonets

My Hashitalk Indonesia April 2024 Presentation

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024

Scaling API-first – The story of a global engineering organization

IAC 2024 - IA Fast Track to Search Focused AI Solutions

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...

08448380779 Call Girls In Friends Colony Women Seeking Men

Finology Group – Insurtech Innovation Award 2024

How to Troubleshoot Apps for the Modern Connected Worker

A Call to Action for Generative AI in 2024

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Enhancing Worker Digital Experience: A Hands-on Workshop for Partners

🐬 The future of MySQL is Postgres 🐘

Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

1. Ruby Proxies for Scale, Performance and Monitoring Ilya Grigorik CTO / AideRSS Event-Driven Architectures @igrigorik #meshu #eda http://bit.ly/eda

2. postrank.com/topic/ruby The slides… Twitter My blog

9. Proxies for Monitoring, Performance and Scale welcome to the wonderful world of intercepting, caching, … , proxy servers

10. Problem: Staging Environment Production Simulated User

11. “ Representative Load / Staging” Duplication Simulating traffic?

12. Staging fail. Profile of queries has changed Fail Load on production has changed Fail Parallel environment Fail Slower release cycle Fail

13. Replay log data, rinse, repeat github.com/igrigorik/autoperf

14.

15. Transparent Duplex Proxy, FTW

16. Same response, different turnaround time Different response body!

17.

18.

19. Ruby EventMachine crash course EM::Connection #receive_data - new data ready for processing #unbind - connection terminated #connection_completed - connected

20. Duplex incoming data

21. Forward Production Response Analyze Results

22. Open connection to application server

23. Buffer until connected

24. Pass response to Duplex Notify when done

25. Analyze Time, Response…

26. Analyze Time, Response… Response Time

27. Cute, right? but so what…

28. %w[ <Transparent> Intercepting Caching … ] solution for every problem

29. Validating Proxy easy, real-time diagnostics Woops!

30. Who said you’re not allowed to touch the data? Intercepting Proxy for those hard-to-reach spots

31. SMTP / Mail: inject SPAM detection De(encrypt): stream data MySQL: inject sharding logic Intercepting Proxy for those hard-to-reach spots

32. @PostRank: Beanstalkd + Ruby Proxy because RAM is still expensive

33.

34.

35. @PostRank: “Chronos Scheduler” 1 “Medium” EC2 Instance Intercepting Proxy

36. Extend the protocol Chronos Scheduler Beanstalkd persistence Process incoming data Buffer “SCHEDULE” requests, otherwise forward

37. Archive to MySQL Chronos Scheduler Beanstalkd persistence Buffer “SCHEDULE”

38. @PostRank: “Chronos Scheduler” Extend the protocol ARCHIVE RESERVE, … 10 line patch to client: queue.archive(job)

39. @PostRank: “Chronos Scheduler” ~79,000,000 jobs, 4GB RAM ARCHIVE RESERVE, … Upcoming jobs: ~ 1M 400% cheaper + extensible! 1 Proxy, 1 Beanstalkd, 1 MySQL = 200 req/s

40. %w[ Transparent <Intercepting> Auth Cache … ] easy to make & a powerful hammer

41. Cheers. Questions? The slides… Twitter My blog

Notes de l'éditeur

Wonderful, wonderful world in the context of building and using Ruby proxy servers for scale, performance and monitoring.