SlideShare une entreprise Scribd logo
1  sur  13
Jim McDonald Chief Strategy Officer, Xiotech Data Storage for the CloudBalancing Performance, Capacity and Cost
Most data follows a similar pattern Write, read, ignore “Small” amounts of data follow a much more aggressive pattern Write, write,read, write,read, read, write, read,read, read,write, write, write, write,read, write The result is that for effective cloud storage you need to have both high capacity and highperformance And it needs to be cheaper than could be done in-house Storage for the Cloud
Traditional cloud storage was viewed as a data dumping ground All about $/GB, performance “irrelevant” Cloud storage is now becoming a lot more active: File synchronisation Big data Calendars … And performance is needed for cloud computing If it can’t do it faster and cheaper it won’t win Why are the Requirements Changing?
An Unfortunate Side-effect of Capacity Growth
Over the past 10 years, on a performance/GB basis, drives have gone down 50x What Does This Mean?
A standard enterprise drive can handle roughly: An Exchange server with 125 users @ 2.4GB/user A 300GB database with 12 transactions per second A virtual desktop implementation with 3 users @ 100GB/user The capacity Vs. performance numbers are very imbalanced against performance For internal IT this is wasted expenditure For cloud service providers this is unobtainable revenue Performance is the Limiting Factor
Snapshots Thin provisioning Deduplication (not compression) Traditional tiering Housekeeping Things which Lower Performance
Traditional tiering is a great example of sacrificing performance for capacity Because tiering focuses on capacity Current tiering algorithms are especially bad for heavily-loaded environments Think sat nav before traffic information Enterprise storage: 10,000 IOPS Traditional Tiering Archive storage: 2,000 IOPS Performance Current tiering solutions are fine if you just want capacity (But if you just want capacity don’t bother with tiering)
Add disks Fine, as long as you don’t use the capacity Increase the performance per disk Cache (sometimes) Better understanding of drives Intelligent data placement algorithms Tier for performance Use all of the performance of all of the drives How to Fix This:Increase Performance
Cloud test suite provides clean copies of every current version of Microsoft Windows Desktop and server, all language patches, all valid combinations of patches (several thousand instances) Automatically uploads program and runs tests, stores results in centralised area, then destroys the VMs Performance is the enabler: The time taken to create and destroy the VMs is at the cost of the service provider and not the customer So if it can be reduced the service provider makes more money The time taken to run the tests is a fixed rate So if it can be reduced the service provider makes more money Example:Cloud Test Suite
Stop thinking like it’s 2000 “If I could get all the old data off my enterprise drives I’d be rich” Capacity is not expensive any more, performance is Measure anything other than archive storage in terms of performance not capacity Be wary of capacity-increasing (and performance-decreasing) “added value” features Do you really need more capacity and less performance? Closing Thoughts
Questions?
Thank You

Contenu connexe

Tendances

Web scale architecture design
Web scale architecture designWeb scale architecture design
Web scale architecture design
NepalAdz
 

Tendances (19)

Дмитро Волошин "High[Page]load"
Дмитро Волошин "High[Page]load"Дмитро Волошин "High[Page]load"
Дмитро Волошин "High[Page]load"
 
Multi-Cloud Economics by Cloudyn Feb 2014
Multi-Cloud Economics by Cloudyn Feb 2014Multi-Cloud Economics by Cloudyn Feb 2014
Multi-Cloud Economics by Cloudyn Feb 2014
 
Radical Cloud Consolidation on The Ball
Radical Cloud Consolidation on The BallRadical Cloud Consolidation on The Ball
Radical Cloud Consolidation on The Ball
 
Reducing Database Costs via Shard Consolidation
Reducing Database Costs via Shard ConsolidationReducing Database Costs via Shard Consolidation
Reducing Database Costs via Shard Consolidation
 
Cloud Computing Soup To Nuts
Cloud Computing Soup To NutsCloud Computing Soup To Nuts
Cloud Computing Soup To Nuts
 
Intro to Cloud Architecture
Intro to Cloud ArchitectureIntro to Cloud Architecture
Intro to Cloud Architecture
 
GDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft Azure
GDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft AzureGDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft Azure
GDG Ternopil TechTalks Web #1 2015 - Data storages in Microsoft Azure
 
Drupal in the cloud with Windows Azure
Drupal in the cloud with Windows AzureDrupal in the cloud with Windows Azure
Drupal in the cloud with Windows Azure
 
Cloud computing
Cloud computing Cloud computing
Cloud computing
 
Web scale architecture design
Web scale architecture designWeb scale architecture design
Web scale architecture design
 
AWS Customer Presentation - HotPads
AWS Customer Presentation - HotPadsAWS Customer Presentation - HotPads
AWS Customer Presentation - HotPads
 
Geezeo AWS Presentation
Geezeo AWS PresentationGeezeo AWS Presentation
Geezeo AWS Presentation
 
Automated System Migration, Backup, Replication and Recovery as a Service
Automated System Migration, Backup,  Replication and Recovery as a ServiceAutomated System Migration, Backup,  Replication and Recovery as a Service
Automated System Migration, Backup, Replication and Recovery as a Service
 
Eclipse OpenJ9 - SpringOne 2018 Lightning talk
Eclipse OpenJ9 - SpringOne 2018 Lightning talkEclipse OpenJ9 - SpringOne 2018 Lightning talk
Eclipse OpenJ9 - SpringOne 2018 Lightning talk
 
Zeus CloudCamp Austin Slides
Zeus CloudCamp Austin SlidesZeus CloudCamp Austin Slides
Zeus CloudCamp Austin Slides
 
Handling your backups
Handling your backupsHandling your backups
Handling your backups
 
Cassandra Bootstrap from Backups
Cassandra Bootstrap from BackupsCassandra Bootstrap from Backups
Cassandra Bootstrap from Backups
 
The Evolution of Hosting and What's Next in Cloud Architecture - EE Conf 2018
The Evolution of Hosting and What's Next in Cloud Architecture - EE Conf 2018 The Evolution of Hosting and What's Next in Cloud Architecture - EE Conf 2018
The Evolution of Hosting and What's Next in Cloud Architecture - EE Conf 2018
 
Fine tuning Hybrid Mobile App
Fine tuning Hybrid Mobile AppFine tuning Hybrid Mobile App
Fine tuning Hybrid Mobile App
 

En vedette

Data storage in the Cloud
Data storage in the CloudData storage in the Cloud
Data storage in the Cloud
Bogdan Mustata
 

En vedette (8)

Data storage for the cloud ce11
Data storage for the cloud ce11Data storage for the cloud ce11
Data storage for the cloud ce11
 
Cloud Storage Options: The True Costs
Cloud Storage Options:  The True CostsCloud Storage Options:  The True Costs
Cloud Storage Options: The True Costs
 
Data storage in the Cloud
Data storage in the CloudData storage in the Cloud
Data storage in the Cloud
 
Future of Data Storage in the Cloud
Future of Data Storage in the CloudFuture of Data Storage in the Cloud
Future of Data Storage in the Cloud
 
cloud computing ppt
cloud computing pptcloud computing ppt
cloud computing ppt
 
Reuters: Pictures of the Year 2016 (Part 2)
Reuters: Pictures of the Year 2016 (Part 2)Reuters: Pictures of the Year 2016 (Part 2)
Reuters: Pictures of the Year 2016 (Part 2)
 
The Six Highest Performing B2B Blog Post Formats
The Six Highest Performing B2B Blog Post FormatsThe Six Highest Performing B2B Blog Post Formats
The Six Highest Performing B2B Blog Post Formats
 
The Outcome Economy
The Outcome EconomyThe Outcome Economy
The Outcome Economy
 

Similaire à Data storage for the cloud ce11

Extreme Tiered Storage Flash, Disk, And Cloud
Extreme Tiered Storage Flash, Disk, And CloudExtreme Tiered Storage Flash, Disk, And Cloud
Extreme Tiered Storage Flash, Disk, And Cloud
Stephen Foskett
 
Cloudcomputingsouptonuts 090506063306 Phpapp02
Cloudcomputingsouptonuts 090506063306 Phpapp02Cloudcomputingsouptonuts 090506063306 Phpapp02
Cloudcomputingsouptonuts 090506063306 Phpapp02
Nexshore
 
http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151
xlight
 

Similaire à Data storage for the cloud ce11 (20)

Analytics on AWS - IP Expo 2013
Analytics on AWS - IP Expo 2013Analytics on AWS - IP Expo 2013
Analytics on AWS - IP Expo 2013
 
AWS June Webinar Series - Getting Started: Amazon Redshift
AWS June Webinar Series - Getting Started: Amazon RedshiftAWS June Webinar Series - Getting Started: Amazon Redshift
AWS June Webinar Series - Getting Started: Amazon Redshift
 
Handling Data in Mega Scale Systems
Handling Data in Mega Scale SystemsHandling Data in Mega Scale Systems
Handling Data in Mega Scale Systems
 
Soluzioni di Database completamente gestite: NoSQL, relazionali e Data Warehouse
Soluzioni di Database completamente gestite: NoSQL, relazionali e Data WarehouseSoluzioni di Database completamente gestite: NoSQL, relazionali e Data Warehouse
Soluzioni di Database completamente gestite: NoSQL, relazionali e Data Warehouse
 
Building Analytic Apps for SaaS: “Analytics as a Service”
Building Analytic Apps for SaaS: “Analytics as a Service”Building Analytic Apps for SaaS: “Analytics as a Service”
Building Analytic Apps for SaaS: “Analytics as a Service”
 
Evaluating Storage for VDI Projects
Evaluating Storage for VDI ProjectsEvaluating Storage for VDI Projects
Evaluating Storage for VDI Projects
 
Getting Started with Amazon Redshift
 Getting Started with Amazon Redshift Getting Started with Amazon Redshift
Getting Started with Amazon Redshift
 
Extreme Tiered Storage Flash, Disk, And Cloud
Extreme Tiered Storage Flash, Disk, And CloudExtreme Tiered Storage Flash, Disk, And Cloud
Extreme Tiered Storage Flash, Disk, And Cloud
 
Building Low Cost Scalable Web Applications Tools & Techniques
Building Low Cost Scalable Web Applications   Tools & TechniquesBuilding Low Cost Scalable Web Applications   Tools & Techniques
Building Low Cost Scalable Web Applications Tools & Techniques
 
Oracle Database 11g Lower Your Costs
Oracle Database 11g Lower Your CostsOracle Database 11g Lower Your Costs
Oracle Database 11g Lower Your Costs
 
S de2784 footprint-reduction-edge2015-v2
S de2784 footprint-reduction-edge2015-v2S de2784 footprint-reduction-edge2015-v2
S de2784 footprint-reduction-edge2015-v2
 
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010
Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010
 
Hadoop and Voldemort @ LinkedIn
Hadoop and Voldemort @ LinkedInHadoop and Voldemort @ LinkedIn
Hadoop and Voldemort @ LinkedIn
 
AWS Summit Stockholm 2014 – B5 – The TCO of cloud applications
AWS Summit Stockholm 2014 – B5 – The TCO of cloud applicationsAWS Summit Stockholm 2014 – B5 – The TCO of cloud applications
AWS Summit Stockholm 2014 – B5 – The TCO of cloud applications
 
Private cloud with z enterprise
Private cloud with z enterprisePrivate cloud with z enterprise
Private cloud with z enterprise
 
Cloudcomputingsouptonuts 090506063306 Phpapp02
Cloudcomputingsouptonuts 090506063306 Phpapp02Cloudcomputingsouptonuts 090506063306 Phpapp02
Cloudcomputingsouptonuts 090506063306 Phpapp02
 
http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151http://www.hfadeel.com/Blog/?p=151
http://www.hfadeel.com/Blog/?p=151
 
How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWS
 
Frb Briefing Database
Frb Briefing DatabaseFrb Briefing Database
Frb Briefing Database
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
 

Dernier

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
AnaAcapella
 

Dernier (20)

Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 

Data storage for the cloud ce11

  • 1. Jim McDonald Chief Strategy Officer, Xiotech Data Storage for the CloudBalancing Performance, Capacity and Cost
  • 2. Most data follows a similar pattern Write, read, ignore “Small” amounts of data follow a much more aggressive pattern Write, write,read, write,read, read, write, read,read, read,write, write, write, write,read, write The result is that for effective cloud storage you need to have both high capacity and highperformance And it needs to be cheaper than could be done in-house Storage for the Cloud
  • 3. Traditional cloud storage was viewed as a data dumping ground All about $/GB, performance “irrelevant” Cloud storage is now becoming a lot more active: File synchronisation Big data Calendars … And performance is needed for cloud computing If it can’t do it faster and cheaper it won’t win Why are the Requirements Changing?
  • 4. An Unfortunate Side-effect of Capacity Growth
  • 5. Over the past 10 years, on a performance/GB basis, drives have gone down 50x What Does This Mean?
  • 6. A standard enterprise drive can handle roughly: An Exchange server with 125 users @ 2.4GB/user A 300GB database with 12 transactions per second A virtual desktop implementation with 3 users @ 100GB/user The capacity Vs. performance numbers are very imbalanced against performance For internal IT this is wasted expenditure For cloud service providers this is unobtainable revenue Performance is the Limiting Factor
  • 7. Snapshots Thin provisioning Deduplication (not compression) Traditional tiering Housekeeping Things which Lower Performance
  • 8. Traditional tiering is a great example of sacrificing performance for capacity Because tiering focuses on capacity Current tiering algorithms are especially bad for heavily-loaded environments Think sat nav before traffic information Enterprise storage: 10,000 IOPS Traditional Tiering Archive storage: 2,000 IOPS Performance Current tiering solutions are fine if you just want capacity (But if you just want capacity don’t bother with tiering)
  • 9. Add disks Fine, as long as you don’t use the capacity Increase the performance per disk Cache (sometimes) Better understanding of drives Intelligent data placement algorithms Tier for performance Use all of the performance of all of the drives How to Fix This:Increase Performance
  • 10. Cloud test suite provides clean copies of every current version of Microsoft Windows Desktop and server, all language patches, all valid combinations of patches (several thousand instances) Automatically uploads program and runs tests, stores results in centralised area, then destroys the VMs Performance is the enabler: The time taken to create and destroy the VMs is at the cost of the service provider and not the customer So if it can be reduced the service provider makes more money The time taken to run the tests is a fixed rate So if it can be reduced the service provider makes more money Example:Cloud Test Suite
  • 11. Stop thinking like it’s 2000 “If I could get all the old data off my enterprise drives I’d be rich” Capacity is not expensive any more, performance is Measure anything other than archive storage in terms of performance not capacity Be wary of capacity-increasing (and performance-decreasing) “added value” features Do you really need more capacity and less performance? Closing Thoughts