How Typepad changed their architecture without taking down the service

•

3 j'aime•1,395 vues

Are you pushing the envelope of what your web application can handle? Do your engineers feel the impending need to overhaul and retrofit your system before it unexpectedly keels over on you? Come hear Six Apart talk about the tools, software and most importantly, the process it has been using to completely rewrite the backend of TypePad without disrupting thousands of users and paying customers.

Technologie

Changing Your Tires at 100mph Scaling Typepad

Oversights ,[object Object],[object Object],[object Object]

Lessons ,[object Object],[object Object],[object Object]

Technical Details ,[object Object],[object Object],[object Object],[object Object],= LAPP

Original Storage Setup 0 MySQL MySQL 1 2 User App Database Storage NFS NFS NFS Apache mod_perl Postgres

Single Server Solution App Database Storage NFS Apache mod_perl Postgres

Meanwhile…. ,[object Object],[object Object],[object Object]

Mighty Crash ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Replicated and Partitioned ,[object Object],[object Object],[object Object],[object Object],[object Object]

“ HA” Database Configuration ,[object Object],[object Object],[object Object],[object Object],[object Object]

Redefinition App Database Storage NFS Apache mod_perl User General Global Postgres 0 MySQL

Additional User Clusters App Database Storage NFS Apache mod_perl User General Global MySQL Postgres 0 MySQL 1 2 MySQL

The Tricky Part ,[object Object],[object Object],[object Object],[object Object]

Data Checks ,[object Object],[object Object]

All Users Moved App Database Storage NFS Apache mod_perl User General Global MySQL Postgres 0 MySQL MySQL 1 2

Additional 'Misc' Cluster App Database Storage NFS Apache mod_perl User General Global MySQL Postgres 0 MySQL MySQL 1 2 MySQL

Postgres Eliminated App Database Storage NFS Apache mod_perl User General Global MySQL 0 MySQL MySQL 1 2 MySQL

Migration to Mogile ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Migration Process ,[object Object],[object Object],[object Object]

Old Architecture Blogs Storage NFS Apache2

Addition of MogileFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored

Scenarios ,[object Object],[object Object]

Serving From NFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 1

Serving From NFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 1

Serving From NFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 1

Serving From NFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 1

Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 1

Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 1

Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 1

Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 3 4 1 2

Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 3 4 5 1 2

Serving From Mogile ,[object Object],[object Object],[object Object],Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 5 6 1

Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 5 6 7 1

Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 5 6 7 8 1

Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 5 6 7 9 8 1

More Memcached ,[object Object],[object Object],[object Object],[object Object]

Use the Schwartz ,[object Object],[object Object],[object Object],[object Object]

Gains ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Recommandé

etcd based PostgreSQL HA Clusterwinsletts

マイクロサービスバックエンドAPIのためのRESTとgRPCdisc99_

Writing Rust Command Line ApplicationsAll Things Open

Алексей Петров "PHP at Scale: Knowing enough to be dangerous!"Fwdays

Scaling big with Apache KafkaNikolay Stoitsev

Apache Gobblin: Bridging Batch and Streaming Data Integration. Big Data Meetu...Shirshanka Das

What's new with Apache Camel 3? | DevNation Tech TalkRed Hat Developers

High Concurrency Architecture and Laravel Performance TuningAlbert Chen

Recommandé

etcd based PostgreSQL HA Clusterwinsletts

マイクロサービスバックエンドAPIのためのRESTとgRPCdisc99_

Writing Rust Command Line ApplicationsAll Things Open

Алексей Петров "PHP at Scale: Knowing enough to be dangerous!"Fwdays

Scaling big with Apache KafkaNikolay Stoitsev

Apache Gobblin: Bridging Batch and Streaming Data Integration. Big Data Meetu...Shirshanka Das

What's new with Apache Camel 3? | DevNation Tech TalkRed Hat Developers

High Concurrency Architecture and Laravel Performance TuningAlbert Chen

Monitoring Docker with ELKDaniel Berman

Redis aclDaeMyung Kang

Tuning Solr & Pipeline for LogsSematext Group, Inc.

A Kong retrospective: from 0.10 to 0.13Thibault Charbonnier

Fluentd - Flexible, Stable, ScalableShu Ting Tseng

Tips from Support: Always Carry a Towel and Don’t Panic!Perforce

HTTP::Parser::XS - writing a fast & secure XS moduleKazuho Oku

PostgreSQL @Alibaba Cloud / Xianming Dou (Alibaba Cloud)Ontico

Gobblin on-awsVasanth Rajamani

Writing a fast HTTP parserfukamachi

RedisConf17 - Too Big to Failover - A cautionary tale of scaling RedisRedis Labs

Gears of Perforce: AAA Game Development ChallengesPerforce

A Cassandra driver from and for the Lua communityThibault Charbonnier

Spring Boot to Quarkus: A real app migration experience | DevNation Tech TalkRed Hat Developers

gRPC & KubernetesKausal

Dexador Risesfukamachi

Return on Ignite 2019: Azure, .NET, A.I. & DataMSDEVMTL

Logstash family introductionOwen Wu

Solr for Indexing and Searching LogsSematext Group, Inc.

Developing high-performance network servers in LispVladimir Sedach

214Mikhail Miguel

Steve Goes to Nashvillelivintrue

Contenu connexe

Tendances

Monitoring Docker with ELKDaniel Berman

Redis aclDaeMyung Kang

Tuning Solr & Pipeline for LogsSematext Group, Inc.

A Kong retrospective: from 0.10 to 0.13Thibault Charbonnier

Fluentd - Flexible, Stable, ScalableShu Ting Tseng

Tips from Support: Always Carry a Towel and Don’t Panic!Perforce

HTTP::Parser::XS - writing a fast & secure XS moduleKazuho Oku

PostgreSQL @Alibaba Cloud / Xianming Dou (Alibaba Cloud)Ontico

Gobblin on-awsVasanth Rajamani

Writing a fast HTTP parserfukamachi

RedisConf17 - Too Big to Failover - A cautionary tale of scaling RedisRedis Labs

Gears of Perforce: AAA Game Development ChallengesPerforce

A Cassandra driver from and for the Lua communityThibault Charbonnier

Spring Boot to Quarkus: A real app migration experience | DevNation Tech TalkRed Hat Developers

gRPC & KubernetesKausal

Dexador Risesfukamachi

Return on Ignite 2019: Azure, .NET, A.I. & DataMSDEVMTL

Logstash family introductionOwen Wu

Solr for Indexing and Searching LogsSematext Group, Inc.

Developing high-performance network servers in LispVladimir Sedach

Tendances (20)

Monitoring Docker with ELK

Redis acl

Tuning Solr & Pipeline for Logs

A Kong retrospective: from 0.10 to 0.13

Fluentd - Flexible, Stable, Scalable

Tips from Support: Always Carry a Towel and Don’t Panic!

HTTP::Parser::XS - writing a fast & secure XS module

PostgreSQL @Alibaba Cloud / Xianming Dou (Alibaba Cloud)

Gobblin on-aws

Writing a fast HTTP parser

RedisConf17 - Too Big to Failover - A cautionary tale of scaling Redis

Gears of Perforce: AAA Game Development Challenges

A Cassandra driver from and for the Lua community

Spring Boot to Quarkus: A real app migration experience | DevNation Tech Talk

gRPC & Kubernetes

Dexador Rises

Return on Ignite 2019: Azure, .NET, A.I. & Data

Logstash family introduction

Solr for Indexing and Searching Logs

Developing high-performance network servers in Lisp

En vedette

214Mikhail Miguel

Steve Goes to Nashvillelivintrue

Hamilton International brochureAmandaCorrigan_1979

Fine Art Nightsbailey1

DervalResearch Food Drink London Mrs20100714Diana Derval

Web20expo Filesystemsroyans

Web 2.0 Summit Flickrroyans

21 Www Web Servicesroyans

En vedette (8)

214

Steve Goes to Nashville

Hamilton International brochure

Fine Art Night

DervalResearch Food Drink London Mrs20100714

Web20expo Filesystems

Web 2.0 Summit Flickr

21 Www Web Services

Similaire à How Typepad changed their architecture without taking down the service

New Oracle Infrastructure2markleeuw

Apache Hadoop- Hadoop Basics.pptxMiraj Godha

[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화OpenStack Korea Community

Oss4b - pxc introductionFrederic Descamps

Introduction to Apache KafkaShiao-An Yuan

Performance_Up.pptwebhostingguy

The mysqlnd replication and load balancing pluginUlf Wendel

Drupal PerformanceKornel Lugosi

Introduction to MySQL InnoDB ClusterFrederic Descamps

Configuration Management and Salt55020

Capistrano and SystemDAmoniac OÜ

Capistrano && SystemDAleksandr Simonov

Supercharging your PHP pages with mod_lsapi in CloudLinux OSCloudLinux

Deployment de Railselliando dias

Fisl - DeploymentFabio Akita

MySQL for Beginners - part 1Ivan Zoratti

Intro to hadoopHaden Pereira

MySQL InnoDB Cluster and Group Replication in a NutshellFrederic Descamps

Scaling PHP appsMatteo Moretti

Site Performance - From Pinto to FerrariJoseph Scott

Similaire à How Typepad changed their architecture without taking down the service (20)

New Oracle Infrastructure2

Apache Hadoop- Hadoop Basics.pptx

[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화

Oss4b - pxc introduction

Introduction to Apache Kafka

Performance_Up.ppt

The mysqlnd replication and load balancing plugin

Drupal Performance

Introduction to MySQL InnoDB Cluster

Configuration Management and Salt

Capistrano and SystemD

Capistrano && SystemD

Supercharging your PHP pages with mod_lsapi in CloudLinux OS

Deployment de Rails

Fisl - Deployment

MySQL for Beginners - part 1

Intro to hadoop

MySQL InnoDB Cluster and Group Replication in a Nutshell

Scaling PHP apps

Site Performance - From Pinto to Ferrari

Plus de royans

Hadoop: Distributed data processingroyans

Facebooks Petabyte Scale Data Warehouse using Hive and Hadooproyans

Flickr Servicesroyans

Web20expo Scalable Web Archroyans

Flickr Phproyans

Grid – Distributed Computing at Scaleroyans

Dmk Bo2 K7 Webroyans

Web20expo Filesystemsroyans

Web Design World Flickrroyans

Flickr Servicesroyans

Filesystemsroyans

Scalable Web Archroyans

Web20expo Filesystemsroyans

Etech2005royans

Plus de royans (14)

Hadoop: Distributed data processing

Facebooks Petabyte Scale Data Warehouse using Hive and Hadoop

Flickr Services

Web20expo Scalable Web Arch

Flickr Php

Grid – Distributed Computing at Scale

Dmk Bo2 K7 Web

Web20expo Filesystems

Web Design World Flickr

Flickr Services

Filesystems

Scalable Web Arch

Web20expo Filesystems

Etech2005

Dernier

Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3

"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays

Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited

New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada

Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3

DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell

Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan

The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech

How to write a Business Continuity PlanDatabarracks

Training state-of-the-art general text embeddingZilliz

DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy

Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3

SALESFORCE EDUCATION CLOUD | FEXLE SERVICESmohitsingh558521

What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett

Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3

A Journey Into the Emotions of Software DevelopersNicole Novielli

Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos

SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero

Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University

Dernier (20)

Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx

"Debugging python applications inside k8s environment", Andrii Soldatenko

Ensuring Technical Readiness For Copilot in Microsoft 365

New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024

Digital Identity is Under Attack: FIDO Paris Seminar.pptx

DSPy a system for AI to Write Prompts and Do Fine Tuning

Generative AI for Technical Writer or Information Developers

The Ultimate Guide to Choosing WordPress Pros and Cons

How to write a Business Continuity Plan

Training state-of-the-art general text embedding

DevoxxFR 2024 Reproducible Builds with Apache Maven

Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx

SALESFORCE EDUCATION CLOUD | FEXLE SERVICES

What's New in Teams Calling, Meetings and Devices March 2024

Moving Beyond Passwords: FIDO Paris Seminar.pdf

A Journey Into the Emotions of Software Developers

Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)

SIP trunking in Janus @ Kamailio World 2024

Nell’iperspazio con Rocket: il Framework Web di Rust!

How Typepad changed their architecture without taking down the service

1. Changing Your Tires at 100mph Scaling Typepad

2. Or... Changing Your Tires at 161kph

5. Typepad Enterprise Hosted Blogs

7. Original Storage Setup 0 MySQL MySQL 1 2 User App Database Storage NFS NFS NFS Apache mod_perl Postgres

8. Single Server Solution App Database Storage NFS Apache mod_perl Postgres

10.

11.

12.

13. Redefinition App Database Storage NFS Apache mod_perl User General Global Postgres 0 MySQL

14. Additional User Clusters App Database Storage NFS Apache mod_perl User General Global MySQL Postgres 0 MySQL 1 2 MySQL

15.

16.

17. Additional User Clusters App Database Storage NFS Apache mod_perl User General Global MySQL Postgres 0 MySQL 1 2 MySQL

18. All Users Moved App Database Storage NFS Apache mod_perl User General Global MySQL Postgres 0 MySQL MySQL 1 2

19. Additional 'Misc' Cluster App Database Storage NFS Apache mod_perl User General Global MySQL Postgres 0 MySQL MySQL 1 2 MySQL

20. Postgres Eliminated App Database Storage NFS Apache mod_perl User General Global MySQL 0 MySQL MySQL 1 2 MySQL

21.

22. Blog Serving Blogs Storage NFS Apache2

23.

24. Old Architecture Blogs Storage NFS Apache2

25. Addition of MogileFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored

26.

27. Serving From NFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 1

28. Serving From NFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 1

29. Serving From NFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 1

30. Serving From NFS Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 1

31. Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 1

32. Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 1

33. Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 1

34. Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 3 4 1 2

35. Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 3 4 5 1 2

36.

37. Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 5 6 7 1

38. Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 5 6 7 8 1

39. Serving From Mogile Blogs Storage NFS Apache2 mod_perl2 Mogile DB Perlbal Mogstored 2 3 4 5 6 7 9 8 1

40.

41.

42.