Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

•

36 j'aime•8,970 vues

A high-performance proxy server is less than a hundred lines of Ruby code and it is an indispensable tool for anyone who knows how to use it. In this session we will first walk through the basics of event-driven architectures and high-performance network programming in Ruby using the EventMachine framework.

Technologie

Ruby Proxies for Scale, Performance and Monitoring Ilya Grigorik CTO / AideRSS Event-Driven Architectures @igrigorik #meshu #eda http://bit.ly/eda

postrank.com/topic/ruby The slides… Twitter My blog

[object Object],“ Rails, Django, Seaside, Scala…” cant scale.

Proxies for Monitoring, Performance and Scale welcome to the wonderful world of intercepting, caching, … , proxy servers

Problem: Staging Environment Production Simulated User

“ Representative Load / Staging” Duplication Simulating traffic?

Replay log data, rinse, repeat github.com/igrigorik/autoperf

[object Object],[object Object],Real (production) traffic Duplex Ruby Proxy, FTW!

Same response, different turnaround time Different response body!

[object Object],1. Accept connection - Connect & Forward to Production - Connect & Forward to Staging 2. Stream response to client from Production - Buffer response from Staging 3. Run “Processor / Analyzer” once both return

Ruby EventMachine crash course EM::Connection #receive_data - new data ready for processing #unbind - connection terminated #connection_completed - connected

Forward Production Response Analyze Results

Pass response to Duplex Notify when done

%w[ <Transparent> Intercepting Caching … ] solution for every problem

Validating Proxy easy, real-time diagnostics Woops!

Who said you’re not allowed to touch the data? Intercepting Proxy for those hard-to-reach spots

SMTP / Mail: inject SPAM detection De(encrypt): stream data MySQL: inject sharding logic Intercepting Proxy for those hard-to-reach spots

@PostRank: Beanstalkd + Ruby Proxy because RAM is still expensive

[object Object],~ 93 Bytes of overhead per job ~300 Bytes of data / job x 80,000,000 jobs in memory ~ 30 GB of RAM = 2 X-Large EC2 instances Oi, expensive!

[object Object],Observations: 1. Each job is rescheduled several times 2. > 95% are scheduled for > 3 hours into the future 3. Beanstalkd does not have overflow page-to-disk Memory is wasted… We’ll add it ourselves!

@PostRank: “Chronos Scheduler” 1 “Medium” EC2 Instance Intercepting Proxy

Extend the protocol Chronos Scheduler Beanstalkd persistence Process incoming data Buffer “SCHEDULE” requests, otherwise forward

Archive to MySQL Chronos Scheduler Beanstalkd persistence Buffer “SCHEDULE”

@PostRank: “Chronos Scheduler” Extend the protocol ARCHIVE RESERVE, … 10 line patch to client: queue.archive(job)

@PostRank: “Chronos Scheduler” ~79,000,000 jobs, 4GB RAM ARCHIVE RESERVE, … Upcoming jobs: ~ 1M 400% cheaper + extensible! 1 Proxy, 1 Beanstalkd, 1 MySQL = 200 req/s

%w[ Transparent <Intercepting> Auth Cache … ] easy to make & a powerful hammer

Cheers. Questions? The slides… Twitter My blog

Recommandé

Ruby Proxies for Scale, Performance, and MonitoringIlya Grigorik

Event Driven Architecture - MeshU - Ilya GrigorikIlya Grigorik

Servers with Event Machine - David Troy - RailsConf 2011David Troy

0-60 with Goliath: Building High Performance Ruby Web-ServicesIlya Grigorik

0-60 with Goliath: High performance web servicesIlya Grigorik

No callbacks, No Threads - Cooperative web servers in Ruby 1.9Ilya Grigorik

Building WebSocket and Server Side Events Applications using Atmospherejfarcand

Ruby 1.9 FibersKevin Ball

Recommandé

Ruby Proxies for Scale, Performance, and MonitoringIlya Grigorik

Event Driven Architecture - MeshU - Ilya GrigorikIlya Grigorik

Servers with Event Machine - David Troy - RailsConf 2011David Troy

0-60 with Goliath: Building High Performance Ruby Web-ServicesIlya Grigorik

0-60 with Goliath: High performance web servicesIlya Grigorik

No callbacks, No Threads - Cooperative web servers in Ruby 1.9Ilya Grigorik

Building WebSocket and Server Side Events Applications using Atmospherejfarcand

Ruby 1.9 FibersKevin Ball

The Atmosphere Frameworkjfarcand

GWT Web Socket and data serializationGWTcon

WebSockets with Spring 4Sergi Almar i Graupera

Concurrent Ruby Application ServersLin Jen-Shin

Communication in Python and the C10k problemJose Galarza

Writing highly scalable WebSocket using the Atmosphere Framework and Scalajfarcand

Websockets on the JVM: Atmosphere to the rescue!jfarcand

The HTML5 WebSocket APIDavid Lindkvist

Asynchronous Web Programming with HTML5 WebSockets and JavaJames Falkner

Web sockets in JavaPance Cavkovski

Reverse ajax in 2014Nenad Pecanac

Writing Portable WebSockets in Javajfarcand

Realtime web application with javaJeongHun Byeon

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocketsametmax

Dancing with websocketDamien Krotkine

Introduction to performance tuning perl web applicationsPerrin Harkins

Building Real-Time Applications with Android and WebSocketsSergi Almar i Graupera

Beyond Breakpoints: A Tour of Dynamic AnalysisFastly

WebSockets wiith Scala and Play! FrameworkFabio Tiriticco

Going Live! with CometSimon Willison

Degrading Performance? You Might be Suffering From the Small Files SyndromeDatabricks

Making it fast: Zotonic & PerformanceArjan

Contenu connexe

Tendances

The Atmosphere Frameworkjfarcand

GWT Web Socket and data serializationGWTcon

WebSockets with Spring 4Sergi Almar i Graupera

Concurrent Ruby Application ServersLin Jen-Shin

Communication in Python and the C10k problemJose Galarza

Writing highly scalable WebSocket using the Atmosphere Framework and Scalajfarcand

Websockets on the JVM: Atmosphere to the rescue!jfarcand

The HTML5 WebSocket APIDavid Lindkvist

Asynchronous Web Programming with HTML5 WebSockets and JavaJames Falkner

Web sockets in JavaPance Cavkovski

Reverse ajax in 2014Nenad Pecanac

Writing Portable WebSockets in Javajfarcand

Realtime web application with javaJeongHun Byeon

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocketsametmax

Dancing with websocketDamien Krotkine

Introduction to performance tuning perl web applicationsPerrin Harkins

Building Real-Time Applications with Android and WebSocketsSergi Almar i Graupera

Beyond Breakpoints: A Tour of Dynamic AnalysisFastly

WebSockets wiith Scala and Play! FrameworkFabio Tiriticco

Going Live! with CometSimon Willison

Tendances (20)

The Atmosphere Framework

GWT Web Socket and data serialization

WebSockets with Spring 4

Concurrent Ruby Application Servers

Communication in Python and the C10k problem

Writing highly scalable WebSocket using the Atmosphere Framework and Scala

Websockets on the JVM: Atmosphere to the rescue!

The HTML5 WebSocket API

Asynchronous Web Programming with HTML5 WebSockets and Java

Web sockets in Java

Reverse ajax in 2014

Writing Portable WebSockets in Java

Realtime web application with java

Introduction to WAMP, a protocol enabling PUB/SUB and RPC over Websocket

Dancing with websocket

Introduction to performance tuning perl web applications

Building Real-Time Applications with Android and WebSockets

Beyond Breakpoints: A Tour of Dynamic Analysis

WebSockets wiith Scala and Play! Framework

Going Live! with Comet

Similaire à Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

Degrading Performance? You Might be Suffering From the Small Files SyndromeDatabricks

Making it fast: Zotonic & PerformanceArjan

Mysql Latencysrubinstein

(BDT318) How Netflix Handles Up To 8 Million Events Per SecondAmazon Web Services

Data Streaming Technology OverviewDan Lynn

Toster - Understanding the Rails Web Model and Scalability OptionsFabio Akita

Understanding the Rails web model and scalability options.toster

High Performance Cloud ComputingAmazon Web Services

node.js, javascript and the futureJeff Miccolis

Low latency in java 8 by Peter Lawrey J On The Beach

Systems Bioinformatics Workshop KeynoteDeepak Singh

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...Flink Forward

Deploying On EC2Steve Loughran

PuppetDB: Sneaking Clojure into Operationsgrim_radical

Scalable Apache for Beginnerswebhostingguy

Netflix Global Applications - NoSQL Search RoadshowAdrian Cockcroft

The Real World - Plugging the Enterprise Into It (nodejs)Aman Kohli

Perfomance tuning on Go 2.0Yogi Kulkarni

Shootout at the PAAS CorralPostgreSQL Experts, Inc.

Similaire à Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com (20)

Degrading Performance? You Might be Suffering From the Small Files Syndrome

Making it fast: Zotonic & Performance

Mysql Latency

(BDT318) How Netflix Handles Up To 8 Million Events Per Second

Data Streaming Technology Overview

Toster - Understanding the Rails Web Model and Scalability Options

Understanding the Rails web model and scalability options

High Performance Cloud Computing

node.js, javascript and the future

Low latency in java 8 by Peter Lawrey

Systems Bioinformatics Workshop Keynote

Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...

Deploying On EC2

PuppetDB: Sneaking Clojure into Operations

Scalable Apache for Beginners

Netflix Global Applications - NoSQL Search Roadshow

The Real World - Plugging the Enterprise Into It (nodejs)

Perfomance tuning on Go 2.0

Shootout at the PAAS Corral

Plus de Ilya Grigorik

Pagespeed what, why, and how it worksIlya Grigorik

Making the web fast(er) - RailsConf 2012Ilya Grigorik

Ruby in the Browser - RubyConf 2011Ilya Grigorik

Intelligent Ruby + Machine LearningIlya Grigorik

No Callbacks, No Threads - RailsConf 2010Ilya Grigorik

Real-time Ruby for the Real-time WebIlya Grigorik

Ruby C10K: High Performance Networking - RubyKaigi '09Ilya Grigorik

Lean & Mean Tokyo Cabinet Recipes (with Lua) - FutureRuby '09Ilya Grigorik

Leveraging Social Media - Strategies & Tactics - PostRankIlya Grigorik

Building Mini Google in RubyIlya Grigorik

Taming The RSS BeastIlya Grigorik

Plus de Ilya Grigorik (11)

Pagespeed what, why, and how it works

Making the web fast(er) - RailsConf 2012

Ruby in the Browser - RubyConf 2011

Intelligent Ruby + Machine Learning

No Callbacks, No Threads - RailsConf 2010

Real-time Ruby for the Real-time Web

Ruby C10K: High Performance Networking - RubyKaigi '09

Lean & Mean Tokyo Cabinet Recipes (with Lua) - FutureRuby '09

Leveraging Social Media - Strategies & Tactics - PostRank

Building Mini Google in Ruby

Taming The RSS Beast

Dernier

Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3

Sample pptx for embedding into website for demoHarshalMandlekar2

Manual 508 Accessibility Compliance AuditSkynet Technologies

A Framework for Development in the AI AgeCprime

Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda

A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada

UiPath Community: Communication Mining from Zero to HeroUiPathCommunity

Scale your database traffic with Read & Write split using MySQL RouterMydbops

(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5

The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3

So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda

Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein

Connecting the Dots for Information Discovery.pdfNeo4j

Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq

The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3

Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery

The State of Passkeys with FIDO Alliance.pptxLoriGlavin3

How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes

Dernier (20)

Digital Identity is Under Attack: FIDO Paris Seminar.pptx

Sample pptx for embedding into website for demo

Manual 508 Accessibility Compliance Audit

A Framework for Development in the AI Age

Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024

UiPath Community: Communication Mining from Zero to Hero

Scale your database traffic with Read & Write split using MySQL Router

(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...

The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx

So einfach geht modernes Roaming fuer Notes und Nomad.pdf

Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24

Connecting the Dots for Information Discovery.pdf

Genislab builds better products and faster go-to-market with Lean project man...

The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx

Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...

The State of Passkeys with FIDO Alliance.pptx

How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes

Ruby Proxies for Scale, Performance, and Monitoring - GoGaRuCo - igvita.com

1. Ruby Proxies for Scale, Performance and Monitoring Ilya Grigorik CTO / AideRSS Event-Driven Architectures @igrigorik #meshu #eda http://bit.ly/eda

2. postrank.com/topic/ruby The slides… Twitter My blog

9. Proxies for Monitoring, Performance and Scale welcome to the wonderful world of intercepting, caching, … , proxy servers

10. Problem: Staging Environment Production Simulated User

11. “ Representative Load / Staging” Duplication Simulating traffic?

12. Staging fail. Profile of queries has changed Fail Load on production has changed Fail Parallel environment Fail Slower release cycle Fail

13. Replay log data, rinse, repeat github.com/igrigorik/autoperf

14.

15. Transparent Duplex Proxy, FTW

16. Same response, different turnaround time Different response body!

17.

18.

19. Ruby EventMachine crash course EM::Connection #receive_data - new data ready for processing #unbind - connection terminated #connection_completed - connected

20. Duplex incoming data

21. Forward Production Response Analyze Results

22. Open connection to application server

23. Buffer until connected

24. Pass response to Duplex Notify when done

25. Analyze Time, Response…

26. Analyze Time, Response… Response Time

27. Cute, right? but so what…

28. %w[ <Transparent> Intercepting Caching … ] solution for every problem

29. Validating Proxy easy, real-time diagnostics Woops!

30. Who said you’re not allowed to touch the data? Intercepting Proxy for those hard-to-reach spots

31. SMTP / Mail: inject SPAM detection De(encrypt): stream data MySQL: inject sharding logic Intercepting Proxy for those hard-to-reach spots

32. @PostRank: Beanstalkd + Ruby Proxy because RAM is still expensive

33.

34.

35. @PostRank: “Chronos Scheduler” 1 “Medium” EC2 Instance Intercepting Proxy

36. Extend the protocol Chronos Scheduler Beanstalkd persistence Process incoming data Buffer “SCHEDULE” requests, otherwise forward

37. Archive to MySQL Chronos Scheduler Beanstalkd persistence Buffer “SCHEDULE”

38. @PostRank: “Chronos Scheduler” Extend the protocol ARCHIVE RESERVE, … 10 line patch to client: queue.archive(job)

39. @PostRank: “Chronos Scheduler” ~79,000,000 jobs, 4GB RAM ARCHIVE RESERVE, … Upcoming jobs: ~ 1M 400% cheaper + extensible! 1 Proxy, 1 Beanstalkd, 1 MySQL = 200 req/s

40. %w[ Transparent <Intercepting> Auth Cache … ] easy to make & a powerful hammer

41. Cheers. Questions? The slides… Twitter My blog

Notes de l'éditeur

Wonderful, wonderful world in the context of building and using Ruby proxy servers for scale, performance and monitoring.