SlideShare a Scribd company logo
1 of 13
Jim McDonald Chief Strategy Officer, Xiotech Data Storage for the CloudBalancing Performance, Capacity and Cost
Most data follows a similar pattern Write, read, ignore “Small” amounts of data follow a much more aggressive pattern Write, write,read, write,read, read, write, read,read, read,write, write, write, write,read, write The result is that for effective cloud storage you need to have both high capacity and highperformance And it needs to be cheaper than could be done in-house Storage for the Cloud
Traditional cloud storage was viewed as a data dumping ground All about $/GB, performance “irrelevant” Cloud storage is now becoming a lot more active: File synchronisation Big data Calendars … And performance is needed for cloud computing If it can’t do it faster and cheaper it won’t win Why are the Requirements Changing?
An Unfortunate Side-effect of Capacity Growth
Over the past 10 years, on a performance/GB basis, drives have gone down 50x What Does This Mean?
A standard enterprise drive can handle roughly: An Exchange server with 125 users @ 2.4GB/user A 300GB database with 12 transactions per second A virtual desktop implementation with 3 users @ 100GB/user The capacity Vs. performance numbers are very imbalanced against performance For internal IT this is wasted expenditure For cloud service providers this is unobtainable revenue Performance is the Limiting Factor
Snapshots Thin provisioning Deduplication (not compression) Traditional tiering Housekeeping Things which Lower Performance
Traditional tiering is a great example of sacrificing performance for capacity Because tiering focuses on capacity Current tiering algorithms are especially bad for heavily-loaded environments Think sat nav before traffic information Enterprise storage: 10,000 IOPS Traditional Tiering Archive storage: 2,000 IOPS Performance Current tiering solutions are fine if you just want capacity (But if you just want capacity don’t bother with tiering)
Add disks Fine, as long as you don’t use the capacity Increase the performance per disk Cache (sometimes) Better understanding of drives Intelligent data placement algorithms Tier for performance Use all of the performance of all of the drives How to Fix This:Increase Performance
Cloud test suite provides clean copies of every current version of Microsoft Windows Desktop and server, all language patches, all valid combinations of patches (several thousand instances) Automatically uploads program and runs tests, stores results in centralised area, then destroys the VMs Performance is the enabler: The time taken to create and destroy the VMs is at the cost of the service provider and not the customer So if it can be reduced the service provider makes more money The time taken to run the tests is a fixed rate So if it can be reduced the service provider makes more money Example:Cloud Test Suite
Stop thinking like it’s 2000 “If I could get all the old data off my enterprise drives I’d be rich” Capacity is not expensive any more, performance is Measure anything other than archive storage in terms of performance not capacity Be wary of capacity-increasing (and performance-decreasing) “added value” features Do you really need more capacity and less performance? Closing Thoughts
Questions?
Thank You

More Related Content

What's hot

Web scale architecture design
Web scale architecture designWeb scale architecture design
Web scale architecture design
NepalAdz
 

What's hot (19)

Multi-Cloud Economics by Cloudyn Feb 2014
Multi-Cloud Economics by Cloudyn Feb 2014Multi-Cloud Economics by Cloudyn Feb 2014
Multi-Cloud Economics by Cloudyn Feb 2014
 
Дмитро Волошин "High[Page]load"
Дмитро Волошин "High[Page]load"Дмитро Волошин "High[Page]load"
Дмитро Волошин "High[Page]load"
 
Radical Cloud Consolidation on The Ball
Radical Cloud Consolidation on The BallRadical Cloud Consolidation on The Ball
Radical Cloud Consolidation on The Ball
 
Reducing Database Costs via Shard Consolidation
Reducing Database Costs via Shard ConsolidationReducing Database Costs via Shard Consolidation
Reducing Database Costs via Shard Consolidation
 
Cloud Computing Soup To Nuts
Cloud Computing Soup To NutsCloud Computing Soup To Nuts
Cloud Computing Soup To Nuts
 
Intro to Cloud Architecture
Intro to Cloud ArchitectureIntro to Cloud Architecture
Intro to Cloud Architecture
 
GDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft Azure
GDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft AzureGDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft Azure
GDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft Azure
 
Drupal in the cloud with Windows Azure
Drupal in the cloud with Windows AzureDrupal in the cloud with Windows Azure
Drupal in the cloud with Windows Azure
 
Cloud computing
Cloud computing Cloud computing
Cloud computing
 
Web scale architecture design
Web scale architecture designWeb scale architecture design
Web scale architecture design
 
AWS Customer Presentation - HotPads
AWS Customer Presentation - HotPadsAWS Customer Presentation - HotPads
AWS Customer Presentation - HotPads
 
Geezeo AWS Presentation
Geezeo AWS PresentationGeezeo AWS Presentation
Geezeo AWS Presentation
 
Automated System Migration, Backup, Replication and Recovery as a Service
Automated System Migration, Backup,  Replication and Recovery as a ServiceAutomated System Migration, Backup,  Replication and Recovery as a Service
Automated System Migration, Backup, Replication and Recovery as a Service
 
Eclipse OpenJ9 - SpringOne 2018 Lightning talk
Eclipse OpenJ9 - SpringOne 2018 Lightning talkEclipse OpenJ9 - SpringOne 2018 Lightning talk
Eclipse OpenJ9 - SpringOne 2018 Lightning talk
 
Zeus CloudCamp Austin Slides
Zeus CloudCamp Austin SlidesZeus CloudCamp Austin Slides
Zeus CloudCamp Austin Slides
 
Handling your backups
Handling your backupsHandling your backups
Handling your backups
 
Cassandra Bootstrap from Backups
Cassandra Bootstrap from BackupsCassandra Bootstrap from Backups
Cassandra Bootstrap from Backups
 
The Evolution of Hosting and What's Next in Cloud Architecture - EE Conf 2018
The Evolution of Hosting and What's Next in Cloud Architecture - EE Conf 2018 The Evolution of Hosting and What's Next in Cloud Architecture - EE Conf 2018
The Evolution of Hosting and What's Next in Cloud Architecture - EE Conf 2018
 
Fine tuning Hybrid Mobile App
Fine tuning Hybrid Mobile AppFine tuning Hybrid Mobile App
Fine tuning Hybrid Mobile App
 

Similar to Data storage for the cloud ce11

Extreme Tiered Storage Flash, Disk, And Cloud
Extreme Tiered Storage Flash, Disk, And CloudExtreme Tiered Storage Flash, Disk, And Cloud
Extreme Tiered Storage Flash, Disk, And Cloud
Stephen Foskett
 
Cloudcomputingsouptonuts 090506063306 Phpapp02
Cloudcomputingsouptonuts 090506063306 Phpapp02Cloudcomputingsouptonuts 090506063306 Phpapp02
Cloudcomputingsouptonuts 090506063306 Phpapp02
Nexshore
 
http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151
xlight
 

Similar to Data storage for the cloud ce11 (20)

Analytics on AWS - IP Expo 2013
Analytics on AWS - IP Expo 2013Analytics on AWS - IP Expo 2013
Analytics on AWS - IP Expo 2013
 
AWS June Webinar Series - Getting Started: Amazon Redshift
AWS June Webinar Series - Getting Started: Amazon RedshiftAWS June Webinar Series - Getting Started: Amazon Redshift
AWS June Webinar Series - Getting Started: Amazon Redshift
 
Handling Data in Mega Scale Systems
Handling Data in Mega Scale SystemsHandling Data in Mega Scale Systems
Handling Data in Mega Scale Systems
 
Soluzioni di Database completamente gestite: NoSQL, relazionali e Data Warehouse
Soluzioni di Database completamente gestite: NoSQL, relazionali e Data WarehouseSoluzioni di Database completamente gestite: NoSQL, relazionali e Data Warehouse
Soluzioni di Database completamente gestite: NoSQL, relazionali e Data Warehouse
 
Building Analytic Apps for SaaS: “Analytics as a Service”
Building Analytic Apps for SaaS: “Analytics as a Service”Building Analytic Apps for SaaS: “Analytics as a Service”
Building Analytic Apps for SaaS: “Analytics as a Service”
 
Evaluating Storage for VDI Projects
Evaluating Storage for VDI ProjectsEvaluating Storage for VDI Projects
Evaluating Storage for VDI Projects
 
Getting Started with Amazon Redshift
 Getting Started with Amazon Redshift Getting Started with Amazon Redshift
Getting Started with Amazon Redshift
 
Extreme Tiered Storage Flash, Disk, And Cloud
Extreme Tiered Storage Flash, Disk, And CloudExtreme Tiered Storage Flash, Disk, And Cloud
Extreme Tiered Storage Flash, Disk, And Cloud
 
Building Low Cost Scalable Web Applications Tools & Techniques
Building Low Cost Scalable Web Applications   Tools & TechniquesBuilding Low Cost Scalable Web Applications   Tools & Techniques
Building Low Cost Scalable Web Applications Tools & Techniques
 
Oracle Database 11g Lower Your Costs
Oracle Database 11g Lower Your CostsOracle Database 11g Lower Your Costs
Oracle Database 11g Lower Your Costs
 
S de2784 footprint-reduction-edge2015-v2
S de2784 footprint-reduction-edge2015-v2S de2784 footprint-reduction-edge2015-v2
S de2784 footprint-reduction-edge2015-v2
 
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010
 
Hadoop and Voldemort @ LinkedIn
Hadoop and Voldemort @ LinkedInHadoop and Voldemort @ LinkedIn
Hadoop and Voldemort @ LinkedIn
 
AWS Summit Stockholm 2014 – B5 – The TCO of cloud applications
AWS Summit Stockholm 2014 – B5 – The TCO of cloud applicationsAWS Summit Stockholm 2014 – B5 – The TCO of cloud applications
AWS Summit Stockholm 2014 – B5 – The TCO of cloud applications
 
Private cloud with z enterprise
Private cloud with z enterprisePrivate cloud with z enterprise
Private cloud with z enterprise
 
Cloudcomputingsouptonuts 090506063306 Phpapp02
Cloudcomputingsouptonuts 090506063306 Phpapp02Cloudcomputingsouptonuts 090506063306 Phpapp02
Cloudcomputingsouptonuts 090506063306 Phpapp02
 
http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151
 
How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWS
 
Frb Briefing Database
Frb Briefing DatabaseFrb Briefing Database
Frb Briefing Database
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
 

Recently uploaded

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
MateoGardella
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
SanaAli374401
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
MateoGardella
 

Recently uploaded (20)

Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 

Data storage for the cloud ce11

  • 1. Jim McDonald Chief Strategy Officer, Xiotech Data Storage for the CloudBalancing Performance, Capacity and Cost
  • 2. Most data follows a similar pattern Write, read, ignore “Small” amounts of data follow a much more aggressive pattern Write, write,read, write,read, read, write, read,read, read,write, write, write, write,read, write The result is that for effective cloud storage you need to have both high capacity and highperformance And it needs to be cheaper than could be done in-house Storage for the Cloud
  • 3. Traditional cloud storage was viewed as a data dumping ground All about $/GB, performance “irrelevant” Cloud storage is now becoming a lot more active: File synchronisation Big data Calendars … And performance is needed for cloud computing If it can’t do it faster and cheaper it won’t win Why are the Requirements Changing?
  • 4. An Unfortunate Side-effect of Capacity Growth
  • 5. Over the past 10 years, on a performance/GB basis, drives have gone down 50x What Does This Mean?
  • 6. A standard enterprise drive can handle roughly: An Exchange server with 125 users @ 2.4GB/user A 300GB database with 12 transactions per second A virtual desktop implementation with 3 users @ 100GB/user The capacity Vs. performance numbers are very imbalanced against performance For internal IT this is wasted expenditure For cloud service providers this is unobtainable revenue Performance is the Limiting Factor
  • 7. Snapshots Thin provisioning Deduplication (not compression) Traditional tiering Housekeeping Things which Lower Performance
  • 8. Traditional tiering is a great example of sacrificing performance for capacity Because tiering focuses on capacity Current tiering algorithms are especially bad for heavily-loaded environments Think sat nav before traffic information Enterprise storage: 10,000 IOPS Traditional Tiering Archive storage: 2,000 IOPS Performance Current tiering solutions are fine if you just want capacity (But if you just want capacity don’t bother with tiering)
  • 9. Add disks Fine, as long as you don’t use the capacity Increase the performance per disk Cache (sometimes) Better understanding of drives Intelligent data placement algorithms Tier for performance Use all of the performance of all of the drives How to Fix This:Increase Performance
  • 10. Cloud test suite provides clean copies of every current version of Microsoft Windows Desktop and server, all language patches, all valid combinations of patches (several thousand instances) Automatically uploads program and runs tests, stores results in centralised area, then destroys the VMs Performance is the enabler: The time taken to create and destroy the VMs is at the cost of the service provider and not the customer So if it can be reduced the service provider makes more money The time taken to run the tests is a fixed rate So if it can be reduced the service provider makes more money Example:Cloud Test Suite
  • 11. Stop thinking like it’s 2000 “If I could get all the old data off my enterprise drives I’d be rich” Capacity is not expensive any more, performance is Measure anything other than archive storage in terms of performance not capacity Be wary of capacity-increasing (and performance-decreasing) “added value” features Do you really need more capacity and less performance? Closing Thoughts