Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

Scaling Engineering Culture at Twitter

1 455 vues

Publié le

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1dfyyWw.

Raffi Krikorian discusses the software engineering challenges met re-architecting Twitter and the cultural change impact that came with it. Filmed at qconsf.com.

Raffi Krikorian is the VP of Engineering in charge of @twittereng's Platform, the core infrastructure of Twitter. His teams manage, amongst other things, the business logic, the scalable services, APIs, storage, core libraries, and the internal development model of all of Twitter.

Publié dans : Technologie
  • Soyez le premier à commenter

Scaling Engineering Culture at Twitter

  1. 1. every problem is a scaling problem @raffi qcon SF 2013
  2. 2. Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations /twitter-scalability-culture InfoQ.com: News & Community Site • 750,000 unique visitors/month • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • News 15-20 / week • Articles 3-4 / week • Presentations (videos) 12-15 / week • Interviews 2-3 / week • Books 1 / month
  3. 3. Presented at QCon San Francisco www.qconsf.com Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide
  4. 4. @raffi qcon SF 2013
  5. 5. @raffi qcon SF 2013
  6. 6. @raffi qcon SF 2013
  7. 7. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  8. 8. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  9. 9. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  10. 10. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL T-Bird T-Flock + Haplo Monorail Gizmoduck Flock(s) @raffi qcon SF 2013
  11. 11. ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  12. 12. ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  13. 13. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  14. 14. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  15. 15. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL challenges ⇢ storage I/O bottlenecks ⇢ poor concurrency, runtime performance Monorail MySQL ⇢ brittle ⇢ too many cooks in the same kitchen ⇢ leaky abstractions / tight-coupling @raffi qcon SF 2013
  16. 16. ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  17. 17. ROUTING PRESENTATION Monorail LOGIC STORAGE & RETRIEVAL MySQL @raffi qcon SF 2013
  18. 18. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Monorail @raffi qcon SF 2013
  19. 19. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Monorail Flock Memcache Redis @raffi qcon SF 2013
  20. 20. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Monorail Flock Memcache Redis @raffi qcon SF 2013
  21. 21. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL MySQL T-Bird Flock Memcache Redis @raffi qcon SF 2013
  22. 22. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet MySQL User T-Bird Timeline Flock Social Graph Memcache DMS Redis @raffi qcon SF 2013
  23. 23. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMS Redis PRESENTATION @raffi qcon SF 2013
  24. 24. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMS Redis PRESENTATION @raffi qcon SF 2013
  25. 25. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  26. 26. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  27. 27. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  28. 28. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  29. 29. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  30. 30. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  31. 31. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  32. 32. ROUTING PRESENTATION LOGIC STORAGE & RETRIEVAL Tweet Monorail TFE MySQL User T-Bird API Timeline goals of SOA (for us) ⇢ not just a web-stack Flock ⇢ isolate responsibilities and concerns ⇢ site speed Web Social Graph Memcache DMs Redis ⇢ reliability, isolate failures ⇢ developer productivity @raffi qcon SF 2013
  33. 33. @raffi qcon SF 2013
  34. 34. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  35. 35. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  36. 36. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  37. 37. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  38. 38. STORAGE & RETRIEVAL MySQL Monorail TFE LOGIC Tweet ROUTING User T-Bird API Timeline Flock Web Social Graph Memcache DMs Redis PRESENTATION @raffi qcon SF 2013
  39. 39. team ⇢ small and 5-7 people ⇢ “sit” together ⇢ dedicated ⇢ can publicly accept responsibility ⇢ autonomous @raffi qcon SF 2013
  40. 40. http://tattly.com/products/everyday-im-hustlin @raffi qcon SF 2013
  41. 41. contracts ⇢ stick to the interfaces ⇢ publicly accountable ⇢ focus on results @raffi qcon SF 2013
  42. 42. @raffi qcon SF 2013
  43. 43. @raffi qcon SF 2013
  44. 44. @raffi qcon SF 2013
  45. 45. @raffi qcon SF 2013
  46. 46. @raffi qcon SF 2013
  47. 47. @raffi qcon SF 2013
  48. 48. #branchingout ⇢ the engineer is the atomic unit of the atomic unit ⇢ individuals dictate teams ⇢ vote with your feet @raffi qcon SF 2013
  49. 49. @raffi qcon SF 2013
  50. 50. @raffi qcon SF 2013
  51. 51. @raffi qcon SF 2013
  52. 52. @raffi qcon SF 2013
  53. 53. We want Twitter to be the best place in the world for engineers to work. @raffi qcon SF 2013
  54. 54. thanks! @raffi qcon SF 2013
  55. 55. Watch the video with slide synchronization on InfoQ.com! http://www.infoq.com/presentations/twitterscalability-culture

×