SlideShare a Scribd company logo
1 of 27
Inside Dropbox
                Julie Kim
     kjulee114@gmail.com
Table of Contents
•   Cloud Storage Service
•   What is “Dropbox”?
•   Network Features
•   Enhance performance
•   References
Cloud Storage
      Networked online storage
      Data is stored in
         virtualized pool of storage
         (April 19, 2013 by wikipedia)

      File hosting Services




http://www.fixmypcfree.com/wp-content/uploads/2012/08/cloud.jpg
Cloud Storage
          Data access                                        Limitation of network
          Using up to date IT                                 bandwidth
           infrastructure                                     Privacy
          No tiresome                                        Hard to predict costs
             scale up, backup,
               security, etc.
          Low cost than building
           own storage




https://dt8kf6553cww8.cloudfront.net/static/images/firebox_transparent.png
DropBox
     • Cloud Storage Service provider
     • Bring photos, docs, and videos anywhere




https://www.dropbox.com/static/images/syncbox_transparent.png
Numbers for Dropbox


                                         • 100M registered Users
                                             (2012.11)

                                         • 1B files saved a day
                                             (2012.11)




https://www.dropbox.com/sh/sf6whlu5dae4869/-PGKcBGWPU/Dropbox%20Logos/Web/png/dropbox-
logotype-vertical-color.png
Network Flow

   SSL      Exchange
                        Update    …
Handshake   meta-data




                         Batch
                        Process
                        w/ACKs
             Delta
            Encoding
Network Flow


     SSL-Handshake




       Batch Process
     with acknowledgement
Network Features
Network Elements

                                             Mutual Complement




                  Meta-data store                                   File data store
              Independent Datacenter                             Amazon EC2 and S3

                       Dropbox Datacenter               Amazon EC2/S3
                              Meta-data                    Direct Links
                             Notifications                Client Storage
                             Web server                    Back-traces
                             Event Logs                    Web storage
                                                           API Storage

http://www.gatech.pa/images/icons/database.png
Packet Usage
Potential Bottleneck
• TCP Start-up Effects
• Sequential Acknowledgments
  – The more packets, The more delay
HOW TO BOOST UP
PERFORMANCE
Lan Sync?

                                                                                    Lan Sync


                                                                                    Lan Sync


                                                                                    Lan Sync


                                                Speed Syncing
                                                Immediately Update&Sync

http://4.bp.blogspot.com/-NpkPe_Ffv0k/TWB3uiLhDdI/AAAAAAAAAcw/1UIxBcGWnTM/s1600/lan-tradicional.gif
TCP PSH flag




                                                  Fast Transfer
                                                  Immediately Update&Sync
http://packetcrafter.files.wordpress.com/2011/02/tcp.png
Related Protocols
• Routing Protocols
   – Using on the Internet protocol networks



• BGP (Border Gateway Protocol)
   – External Gateway Protocol
   – Used at the edge of your network
BGP&OSPF




        BGP          External



        OSPF         Interial

http://netmonkey.ru/img/mpls/mpls-bgp-between-pe-ce.png
Related Protocols
     • OSPF
         (Open Shortest Path First)
          – Interior Gateway Protocol
          – Link-state routing
          – LSA
     • ISIS
         (Intermediate System to Intermediate System)

          – Interior Gateway Protocol
          – Link-state routing
          – DB of network topology
http://www.iekucukcay.com/wp-content/uploads/2011/09/dijkstra.gif
http://www.techweekeurope.co.uk/wp-content/uploads/2012/09/shutterstock_98826353.jpg
http://www.techweekeurope.co.uk/wp-content/uploads/2012/01/IPv6-Landscape.jpg
Related Protocols
     • OSPF
         (Open Shortest Path First)
          – Interior Gateway Protocol
          – Link-state routing
          – LSA
     • ISIS
         (Intermediate System to Intermediate System)

          – Interior Gateway Protocol
          – Link-state routing
          – DB of network topology
http://www.iekucukcay.com/wp-content/uploads/2011/09/dijkstra.gif
http://www.techweekeurope.co.uk/wp-content/uploads/2012/09/shutterstock_98826353.jpg
http://www.techweekeurope.co.uk/wp-content/uploads/2012/01/IPv6-Landscape.jpg
Related Protocols
     • MPLS
           – Multi-Protocol Label Switching
           – For high performance telecommunication




                                                  QoS&ECN




                                                                     BottomOfStack

http://www.openflow.org/wk/images/thumb/1/11/Mpls_label_eth_ip.jpg/500px-Mpls_label_eth_ip.jpg
Related Protocols
     • DWDM
           – Dense Wavelength Division Multiplexing




http://blog.zulyusof.com/wp-content/uploads/2010/08/DWDM-functional-schematic.jpg
DWDM


                                                                     TDM




                                                                     DWDM




http://ids.nic.in/JCES%20TNL%20OCT%202008/DWDM/Slide30(edited).JPG
Conclusion
• Cloud storage services is trendy cloud
  service, yet.
• It is the result of modern network
  technologies integration.
  – Fast sync vs. Congestion control
  – Support multiple physical layer, etc.
• Performance bottleneck
  – TCP handshaking delay
  – Large file with chunks and ACKs
Q&A
http://4.bp.blogspot.com/-0kyKiMfPSH4/T_upI5Rx99I/AAAAAAAAAUs/S-
                         NxlqCG7zQ/s1600/thanks20a20bunch20rgb.jpg
References
•   http://en.wikipedia.org/wiki/Cloud_storage
•   Dropbox Quick Start
•   What is LAN sync?, https://www.dropbox.com/help/137/en
•   Idilio Drago, Marco Mellia, Maurizio M. Munafò, Anna Sperotto,
    Ramin Sadre, Aiko Pras. Inside Dropbox:Understanding Personal
    Cloud Storage Services, ACM IMC’12, November 14–16, 2012
•   Caching in theory and practice,
    https://tech.dropbox.com/2012/10/caching-in-theory-and-practice/
•   http://packetlife.net/blog/2011/mar/2/tcp-flags-psh-and-urg/
•   http://compnetworking.about.com/library/glossary/bldef-dwdm.htm
•   https://www.dropbox.com/release_notes

More Related Content

What's hot

Building Lightning Fast Websites (for Twin Cities .NET User Group)
Building Lightning Fast Websites (for Twin Cities .NET User Group)Building Lightning Fast Websites (for Twin Cities .NET User Group)
Building Lightning Fast Websites (for Twin Cities .NET User Group)strommen
 
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics
 
Directory Write Leases in MagFS
Directory Write Leases in MagFSDirectory Write Leases in MagFS
Directory Write Leases in MagFSMaginatics
 
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...Maginatics
 
Couchdb + Membase = Couchbase
Couchdb + Membase = CouchbaseCouchdb + Membase = Couchbase
Couchdb + Membase = Couchbaseiammutex
 
JUDCon 2013- JBoss Data Grid and WebSockets: Delivering Real Time Push at Scale
JUDCon 2013- JBoss Data Grid and WebSockets: Delivering Real Time Push at ScaleJUDCon 2013- JBoss Data Grid and WebSockets: Delivering Real Time Push at Scale
JUDCon 2013- JBoss Data Grid and WebSockets: Delivering Real Time Push at ScaleC2B2 Consulting
 
HTTP 2.0 – What do I need to know?
HTTP 2.0 – What do I need to know? HTTP 2.0 – What do I need to know?
HTTP 2.0 – What do I need to know? Sigma Software
 
Messaging With Apache ActiveMQ
Messaging With Apache ActiveMQMessaging With Apache ActiveMQ
Messaging With Apache ActiveMQBruce Snyder
 
Membase Introduction
Membase IntroductionMembase Introduction
Membase IntroductionMembase
 
Cdn technology overview
Cdn technology overviewCdn technology overview
Cdn technology overviewYoohyun Kim
 
Memcached: What is it and what does it do? (PHP Version)
Memcached: What is it and what does it do? (PHP Version)Memcached: What is it and what does it do? (PHP Version)
Memcached: What is it and what does it do? (PHP Version)Brian Moon
 
Eugene Letuchy Erlangat Facebook
Eugene Letuchy Erlangat FacebookEugene Letuchy Erlangat Facebook
Eugene Letuchy Erlangat FacebookDario Salvelli
 
CDN and ISP Operation
CDN and ISP OperationCDN and ISP Operation
CDN and ISP OperationKae Hsu
 
Measuring CDN performance and why you're doing it wrong
Measuring CDN performance and why you're doing it wrongMeasuring CDN performance and why you're doing it wrong
Measuring CDN performance and why you're doing it wrongFastly
 
Introduction to First Commercial Memcached Service for Cloud
Introduction to First Commercial Memcached Service for CloudIntroduction to First Commercial Memcached Service for Cloud
Introduction to First Commercial Memcached Service for CloudGear6
 
Modern Distributed Messaging and RPC
Modern Distributed Messaging and RPCModern Distributed Messaging and RPC
Modern Distributed Messaging and RPCMax Alexejev
 
Introduction to WebSockets Presentation
Introduction to WebSockets PresentationIntroduction to WebSockets Presentation
Introduction to WebSockets PresentationJulien LaPointe
 

What's hot (20)

Building Lightning Fast Websites (for Twin Cities .NET User Group)
Building Lightning Fast Websites (for Twin Cities .NET User Group)Building Lightning Fast Websites (for Twin Cities .NET User Group)
Building Lightning Fast Websites (for Twin Cities .NET User Group)
 
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical HighlightsMaginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights
 
Directory Write Leases in MagFS
Directory Write Leases in MagFSDirectory Write Leases in MagFS
Directory Write Leases in MagFS
 
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
Maginatics @ SDC 2013: Architecting An Enterprise Storage Platform Using Obje...
 
Couchdb + Membase = Couchbase
Couchdb + Membase = CouchbaseCouchdb + Membase = Couchbase
Couchdb + Membase = Couchbase
 
JUDCon 2013- JBoss Data Grid and WebSockets: Delivering Real Time Push at Scale
JUDCon 2013- JBoss Data Grid and WebSockets: Delivering Real Time Push at ScaleJUDCon 2013- JBoss Data Grid and WebSockets: Delivering Real Time Push at Scale
JUDCon 2013- JBoss Data Grid and WebSockets: Delivering Real Time Push at Scale
 
Real time web apps
Real time web appsReal time web apps
Real time web apps
 
HTTP 2.0 – What do I need to know?
HTTP 2.0 – What do I need to know? HTTP 2.0 – What do I need to know?
HTTP 2.0 – What do I need to know?
 
Messaging With Apache ActiveMQ
Messaging With Apache ActiveMQMessaging With Apache ActiveMQ
Messaging With Apache ActiveMQ
 
Membase Introduction
Membase IntroductionMembase Introduction
Membase Introduction
 
Cdn technology overview
Cdn technology overviewCdn technology overview
Cdn technology overview
 
Memcached: What is it and what does it do? (PHP Version)
Memcached: What is it and what does it do? (PHP Version)Memcached: What is it and what does it do? (PHP Version)
Memcached: What is it and what does it do? (PHP Version)
 
Load balancing at tuenti
Load balancing at tuentiLoad balancing at tuenti
Load balancing at tuenti
 
Eugene Letuchy Erlangat Facebook
Eugene Letuchy Erlangat FacebookEugene Letuchy Erlangat Facebook
Eugene Letuchy Erlangat Facebook
 
CDN and ISP Operation
CDN and ISP OperationCDN and ISP Operation
CDN and ISP Operation
 
Measuring CDN performance and why you're doing it wrong
Measuring CDN performance and why you're doing it wrongMeasuring CDN performance and why you're doing it wrong
Measuring CDN performance and why you're doing it wrong
 
Introduction to First Commercial Memcached Service for Cloud
Introduction to First Commercial Memcached Service for CloudIntroduction to First Commercial Memcached Service for Cloud
Introduction to First Commercial Memcached Service for Cloud
 
How fast is it?
How fast is it?How fast is it?
How fast is it?
 
Modern Distributed Messaging and RPC
Modern Distributed Messaging and RPCModern Distributed Messaging and RPC
Modern Distributed Messaging and RPC
 
Introduction to WebSockets Presentation
Introduction to WebSockets PresentationIntroduction to WebSockets Presentation
Introduction to WebSockets Presentation
 

Viewers also liked

Back-End application for Distributed systems
Back-End application for Distributed systemsBack-End application for Distributed systems
Back-End application for Distributed systemsAtif Imam
 
Distributed systems
Distributed systemsDistributed systems
Distributed systemsRavi Yasas
 
Applications of Distributed Systems
Applications of Distributed SystemsApplications of Distributed Systems
Applications of Distributed Systemssandra sukarieh
 
7 distributed and real systems
7 distributed and real systems7 distributed and real systems
7 distributed and real systemsmyrajendra
 
Distributed Systems Real Life Applications
Distributed Systems Real Life ApplicationsDistributed Systems Real Life Applications
Distributed Systems Real Life ApplicationsAman Srivastava
 
Distributed Systems
Distributed SystemsDistributed Systems
Distributed SystemsRupsee
 

Viewers also liked (7)

Back-End application for Distributed systems
Back-End application for Distributed systemsBack-End application for Distributed systems
Back-End application for Distributed systems
 
Distributed systems
Distributed systemsDistributed systems
Distributed systems
 
Applications of Distributed Systems
Applications of Distributed SystemsApplications of Distributed Systems
Applications of Distributed Systems
 
7 distributed and real systems
7 distributed and real systems7 distributed and real systems
7 distributed and real systems
 
Distributed System
Distributed System Distributed System
Distributed System
 
Distributed Systems Real Life Applications
Distributed Systems Real Life ApplicationsDistributed Systems Real Life Applications
Distributed Systems Real Life Applications
 
Distributed Systems
Distributed SystemsDistributed Systems
Distributed Systems
 

Similar to Inside dropbox

Helen Tabunshchyk "Handling large amounts of traffic on the Edge"
Helen Tabunshchyk "Handling large amounts of traffic on the Edge"Helen Tabunshchyk "Handling large amounts of traffic on the Edge"
Helen Tabunshchyk "Handling large amounts of traffic on the Edge"Fwdays
 
Connect K of SMACK:pykafka, kafka-python or?
Connect K of SMACK:pykafka, kafka-python or?Connect K of SMACK:pykafka, kafka-python or?
Connect K of SMACK:pykafka, kafka-python or?Micron Technology
 
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EUBuilding Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EUYaron Haviv
 
Cleaning Up the Dirt of the Nineties - How New Protocols are Modernizing the Web
Cleaning Up the Dirt of the Nineties - How New Protocols are Modernizing the WebCleaning Up the Dirt of the Nineties - How New Protocols are Modernizing the Web
Cleaning Up the Dirt of the Nineties - How New Protocols are Modernizing the WebSteffen Gebert
 
Dynamic Content Acceleration: Lightning Fast Web Apps with Amazon CloudFront ...
Dynamic Content Acceleration: Lightning Fast Web Apps with Amazon CloudFront ...Dynamic Content Acceleration: Lightning Fast Web Apps with Amazon CloudFront ...
Dynamic Content Acceleration: Lightning Fast Web Apps with Amazon CloudFront ...Amazon Web Services
 
21 Www Web Services
21 Www Web Services21 Www Web Services
21 Www Web Servicesroyans
 
Oracle E-Business Suite On Oracle Cloud
Oracle E-Business Suite On Oracle CloudOracle E-Business Suite On Oracle Cloud
Oracle E-Business Suite On Oracle Cloudpasalapudi
 
(BDT318) How Netflix Handles Up To 8 Million Events Per Second
(BDT318) How Netflix Handles Up To 8 Million Events Per Second(BDT318) How Netflix Handles Up To 8 Million Events Per Second
(BDT318) How Netflix Handles Up To 8 Million Events Per SecondAmazon Web Services
 
Future services on Janet
Future services on JanetFuture services on Janet
Future services on JanetJisc
 
AWS as a Data Platform for Cloud and On-Premises Workloads | AWS Public Secto...
AWS as a Data Platform for Cloud and On-Premises Workloads | AWS Public Secto...AWS as a Data Platform for Cloud and On-Premises Workloads | AWS Public Secto...
AWS as a Data Platform for Cloud and On-Premises Workloads | AWS Public Secto...Amazon Web Services
 
Delivering on the promise of the cloud for digital media, aspera on demand
Delivering on the promise of the cloud for digital media, aspera on demandDelivering on the promise of the cloud for digital media, aspera on demand
Delivering on the promise of the cloud for digital media, aspera on demandAmazon Web Services
 
Collector Web Services
Collector Web ServicesCollector Web Services
Collector Web Servicespublisyst
 
Dynamic Content Acceleration: Amazon CloudFront and Amazon Route 53 (ARC309) ...
Dynamic Content Acceleration: Amazon CloudFront and Amazon Route 53 (ARC309) ...Dynamic Content Acceleration: Amazon CloudFront and Amazon Route 53 (ARC309) ...
Dynamic Content Acceleration: Amazon CloudFront and Amazon Route 53 (ARC309) ...Amazon Web Services
 
Hacking apache cloud stack
Hacking apache cloud stackHacking apache cloud stack
Hacking apache cloud stackNitin Mehta
 
Gaming across multiple devices
Gaming across multiple devicesGaming across multiple devices
Gaming across multiple devicesPatric Boscolo
 

Similar to Inside dropbox (20)

Helen Tabunshchyk "Handling large amounts of traffic on the Edge"
Helen Tabunshchyk "Handling large amounts of traffic on the Edge"Helen Tabunshchyk "Handling large amounts of traffic on the Edge"
Helen Tabunshchyk "Handling large amounts of traffic on the Edge"
 
Connect K of SMACK:pykafka, kafka-python or?
Connect K of SMACK:pykafka, kafka-python or?Connect K of SMACK:pykafka, kafka-python or?
Connect K of SMACK:pykafka, kafka-python or?
 
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EUBuilding Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
Building Super Fast Cloud-Native Data Platforms - Yaron Haviv, KubeCon 2017 EU
 
Otimizando servidores web
Otimizando servidores webOtimizando servidores web
Otimizando servidores web
 
WebSocket protocol
WebSocket protocolWebSocket protocol
WebSocket protocol
 
Cleaning Up the Dirt of the Nineties - How New Protocols are Modernizing the Web
Cleaning Up the Dirt of the Nineties - How New Protocols are Modernizing the WebCleaning Up the Dirt of the Nineties - How New Protocols are Modernizing the Web
Cleaning Up the Dirt of the Nineties - How New Protocols are Modernizing the Web
 
Dynamic Content Acceleration: Lightning Fast Web Apps with Amazon CloudFront ...
Dynamic Content Acceleration: Lightning Fast Web Apps with Amazon CloudFront ...Dynamic Content Acceleration: Lightning Fast Web Apps with Amazon CloudFront ...
Dynamic Content Acceleration: Lightning Fast Web Apps with Amazon CloudFront ...
 
21 Www Web Services
21 Www Web Services21 Www Web Services
21 Www Web Services
 
Oracle E-Business Suite On Oracle Cloud
Oracle E-Business Suite On Oracle CloudOracle E-Business Suite On Oracle Cloud
Oracle E-Business Suite On Oracle Cloud
 
IBM Aspera overview
IBM Aspera overview IBM Aspera overview
IBM Aspera overview
 
Future Internet
Future InternetFuture Internet
Future Internet
 
(BDT318) How Netflix Handles Up To 8 Million Events Per Second
(BDT318) How Netflix Handles Up To 8 Million Events Per Second(BDT318) How Netflix Handles Up To 8 Million Events Per Second
(BDT318) How Netflix Handles Up To 8 Million Events Per Second
 
Future services on Janet
Future services on JanetFuture services on Janet
Future services on Janet
 
AWS as a Data Platform for Cloud and On-Premises Workloads | AWS Public Secto...
AWS as a Data Platform for Cloud and On-Premises Workloads | AWS Public Secto...AWS as a Data Platform for Cloud and On-Premises Workloads | AWS Public Secto...
AWS as a Data Platform for Cloud and On-Premises Workloads | AWS Public Secto...
 
Ingest and storage options
Ingest and storage optionsIngest and storage options
Ingest and storage options
 
Delivering on the promise of the cloud for digital media, aspera on demand
Delivering on the promise of the cloud for digital media, aspera on demandDelivering on the promise of the cloud for digital media, aspera on demand
Delivering on the promise of the cloud for digital media, aspera on demand
 
Collector Web Services
Collector Web ServicesCollector Web Services
Collector Web Services
 
Dynamic Content Acceleration: Amazon CloudFront and Amazon Route 53 (ARC309) ...
Dynamic Content Acceleration: Amazon CloudFront and Amazon Route 53 (ARC309) ...Dynamic Content Acceleration: Amazon CloudFront and Amazon Route 53 (ARC309) ...
Dynamic Content Acceleration: Amazon CloudFront and Amazon Route 53 (ARC309) ...
 
Hacking apache cloud stack
Hacking apache cloud stackHacking apache cloud stack
Hacking apache cloud stack
 
Gaming across multiple devices
Gaming across multiple devicesGaming across multiple devices
Gaming across multiple devices
 

More from LINE+

Armeriaworkshop2019 openchat julie
Armeriaworkshop2019 openchat julieArmeriaworkshop2019 openchat julie
Armeriaworkshop2019 openchat julieLINE+
 
Hnavi-HDFS based log aggregater with HDFS Browser
Hnavi-HDFS based log aggregater with HDFS BrowserHnavi-HDFS based log aggregater with HDFS Browser
Hnavi-HDFS based log aggregater with HDFS BrowserLINE+
 
Herimarque - 우리 문화 유산 쉽게 찾기
Herimarque - 우리 문화 유산 쉽게 찾기Herimarque - 우리 문화 유산 쉽게 찾기
Herimarque - 우리 문화 유산 쉽게 찾기LINE+
 
Soseek-소셜커머스 메타 서비스
Soseek-소셜커머스 메타 서비스Soseek-소셜커머스 메타 서비스
Soseek-소셜커머스 메타 서비스LINE+
 
Networking in virtual machines
Networking in virtual machinesNetworking in virtual machines
Networking in virtual machinesLINE+
 
GLOA:A New Job Scheduling Algorithm for Grid Computing
GLOA:A New Job Scheduling Algorithm for Grid ComputingGLOA:A New Job Scheduling Algorithm for Grid Computing
GLOA:A New Job Scheduling Algorithm for Grid ComputingLINE+
 
Inverse kinematics
Inverse kinematicsInverse kinematics
Inverse kinematicsLINE+
 
Intelligent cloud computing
Intelligent cloud computingIntelligent cloud computing
Intelligent cloud computingLINE+
 
완료발표
완료발표완료발표
완료발표LINE+
 

More from LINE+ (9)

Armeriaworkshop2019 openchat julie
Armeriaworkshop2019 openchat julieArmeriaworkshop2019 openchat julie
Armeriaworkshop2019 openchat julie
 
Hnavi-HDFS based log aggregater with HDFS Browser
Hnavi-HDFS based log aggregater with HDFS BrowserHnavi-HDFS based log aggregater with HDFS Browser
Hnavi-HDFS based log aggregater with HDFS Browser
 
Herimarque - 우리 문화 유산 쉽게 찾기
Herimarque - 우리 문화 유산 쉽게 찾기Herimarque - 우리 문화 유산 쉽게 찾기
Herimarque - 우리 문화 유산 쉽게 찾기
 
Soseek-소셜커머스 메타 서비스
Soseek-소셜커머스 메타 서비스Soseek-소셜커머스 메타 서비스
Soseek-소셜커머스 메타 서비스
 
Networking in virtual machines
Networking in virtual machinesNetworking in virtual machines
Networking in virtual machines
 
GLOA:A New Job Scheduling Algorithm for Grid Computing
GLOA:A New Job Scheduling Algorithm for Grid ComputingGLOA:A New Job Scheduling Algorithm for Grid Computing
GLOA:A New Job Scheduling Algorithm for Grid Computing
 
Inverse kinematics
Inverse kinematicsInverse kinematics
Inverse kinematics
 
Intelligent cloud computing
Intelligent cloud computingIntelligent cloud computing
Intelligent cloud computing
 
완료발표
완료발표완료발표
완료발표
 

Recently uploaded

Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 

Recently uploaded (20)

Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 

Inside dropbox

  • 1. Inside Dropbox Julie Kim kjulee114@gmail.com
  • 2. Table of Contents • Cloud Storage Service • What is “Dropbox”? • Network Features • Enhance performance • References
  • 3. Cloud Storage  Networked online storage  Data is stored in virtualized pool of storage (April 19, 2013 by wikipedia)  File hosting Services http://www.fixmypcfree.com/wp-content/uploads/2012/08/cloud.jpg
  • 4. Cloud Storage  Data access  Limitation of network  Using up to date IT bandwidth infrastructure  Privacy  No tiresome  Hard to predict costs  scale up, backup, security, etc.  Low cost than building own storage https://dt8kf6553cww8.cloudfront.net/static/images/firebox_transparent.png
  • 5. DropBox • Cloud Storage Service provider • Bring photos, docs, and videos anywhere https://www.dropbox.com/static/images/syncbox_transparent.png
  • 6. Numbers for Dropbox • 100M registered Users (2012.11) • 1B files saved a day (2012.11) https://www.dropbox.com/sh/sf6whlu5dae4869/-PGKcBGWPU/Dropbox%20Logos/Web/png/dropbox- logotype-vertical-color.png
  • 7. Network Flow SSL Exchange Update … Handshake meta-data Batch Process w/ACKs Delta Encoding
  • 8. Network Flow SSL-Handshake Batch Process with acknowledgement
  • 10. Network Elements Mutual Complement Meta-data store File data store  Independent Datacenter  Amazon EC2 and S3 Dropbox Datacenter Amazon EC2/S3 Meta-data Direct Links Notifications Client Storage Web server Back-traces Event Logs Web storage API Storage http://www.gatech.pa/images/icons/database.png
  • 12. Potential Bottleneck • TCP Start-up Effects • Sequential Acknowledgments – The more packets, The more delay
  • 13. HOW TO BOOST UP PERFORMANCE
  • 14. Lan Sync? Lan Sync Lan Sync Lan Sync  Speed Syncing  Immediately Update&Sync http://4.bp.blogspot.com/-NpkPe_Ffv0k/TWB3uiLhDdI/AAAAAAAAAcw/1UIxBcGWnTM/s1600/lan-tradicional.gif
  • 15. TCP PSH flag  Fast Transfer  Immediately Update&Sync http://packetcrafter.files.wordpress.com/2011/02/tcp.png
  • 16. Related Protocols • Routing Protocols – Using on the Internet protocol networks • BGP (Border Gateway Protocol) – External Gateway Protocol – Used at the edge of your network
  • 17. BGP&OSPF BGP External OSPF Interial http://netmonkey.ru/img/mpls/mpls-bgp-between-pe-ce.png
  • 18. Related Protocols • OSPF (Open Shortest Path First) – Interior Gateway Protocol – Link-state routing – LSA • ISIS (Intermediate System to Intermediate System) – Interior Gateway Protocol – Link-state routing – DB of network topology http://www.iekucukcay.com/wp-content/uploads/2011/09/dijkstra.gif http://www.techweekeurope.co.uk/wp-content/uploads/2012/09/shutterstock_98826353.jpg http://www.techweekeurope.co.uk/wp-content/uploads/2012/01/IPv6-Landscape.jpg
  • 19. Related Protocols • OSPF (Open Shortest Path First) – Interior Gateway Protocol – Link-state routing – LSA • ISIS (Intermediate System to Intermediate System) – Interior Gateway Protocol – Link-state routing – DB of network topology http://www.iekucukcay.com/wp-content/uploads/2011/09/dijkstra.gif http://www.techweekeurope.co.uk/wp-content/uploads/2012/09/shutterstock_98826353.jpg http://www.techweekeurope.co.uk/wp-content/uploads/2012/01/IPv6-Landscape.jpg
  • 20. Related Protocols • MPLS – Multi-Protocol Label Switching – For high performance telecommunication QoS&ECN BottomOfStack http://www.openflow.org/wk/images/thumb/1/11/Mpls_label_eth_ip.jpg/500px-Mpls_label_eth_ip.jpg
  • 21. Related Protocols • DWDM – Dense Wavelength Division Multiplexing http://blog.zulyusof.com/wp-content/uploads/2010/08/DWDM-functional-schematic.jpg
  • 22. DWDM TDM DWDM http://ids.nic.in/JCES%20TNL%20OCT%202008/DWDM/Slide30(edited).JPG
  • 23.
  • 24. Conclusion • Cloud storage services is trendy cloud service, yet. • It is the result of modern network technologies integration. – Fast sync vs. Congestion control – Support multiple physical layer, etc. • Performance bottleneck – TCP handshaking delay – Large file with chunks and ACKs
  • 25. Q&A
  • 26. http://4.bp.blogspot.com/-0kyKiMfPSH4/T_upI5Rx99I/AAAAAAAAAUs/S- NxlqCG7zQ/s1600/thanks20a20bunch20rgb.jpg
  • 27. References • http://en.wikipedia.org/wiki/Cloud_storage • Dropbox Quick Start • What is LAN sync?, https://www.dropbox.com/help/137/en • Idilio Drago, Marco Mellia, Maurizio M. Munafò, Anna Sperotto, Ramin Sadre, Aiko Pras. Inside Dropbox:Understanding Personal Cloud Storage Services, ACM IMC’12, November 14–16, 2012 • Caching in theory and practice, https://tech.dropbox.com/2012/10/caching-in-theory-and-practice/ • http://packetlife.net/blog/2011/mar/2/tcp-flags-psh-and-urg/ • http://compnetworking.about.com/library/glossary/bldef-dwdm.htm • https://www.dropbox.com/release_notes