SlideShare une entreprise Scribd logo
1  sur  20
The Architect’s View

         Chris M Evans
   Director, Langton Blue Ltd
 blog.thestoragearchitect.com
        @chrismevans
Introduction
• I am an independent consultant 
• I have no marketing budget – no giveaways 
• I don’t know everything (although my wife
  says I think I do) 
• Let’s make this interactive 

    I realise I am between you and lunch….
The Need for Virtualisation….
Our Topic for Today…
• Last time I presented you the past….
Our Topic for Today…
• Today I give you – The Future!
How is Virtualisation Driving Storage Use?
• High I/O density
   – Consolidation of servers and IOPS into single LUNs
   – VDI desktop consolidation
   – Array based copy (VAAI)
• High Concentration of Risk
   – Multiple dependent systems in one server/cluster
• Consistent Performance
   – No I/O spikes – bad for any workload, catastrophic for gaming &
     financial workloads
• I/O Blender
   – Virtualisation creates highly random workload

Increased levels of virtualisation require significant improvements in
                              I/O density
Requirements
• Consistent high performance
  – Low latency – 1ms or less
  – High IOPS > 500K
  – Reliability – no failures
• Management
  – APIs & RESTful interfaces
  – Private Cloud integration
• Advanced Features in Arrays
  – VAAI, VASA support
Enter Flash!
•   Solid State Storage
•   Very high IOPS – both read and write
•   Low latency
•   Low Power
•   “enterprise” SLC and consumer “MLC” grade
•   SAS/SATA form factor compatible
•   Great at managing random workload….

But…..

• Relatively high cost (SLC especially so)
• Finite lifetime – they will wear out and fail
How Can Flash Be Used?
• In-Server
   – PCIe SSD – Fusion-IO, VFCache, etc
   – SAS SSD devices
   – Very high low latency, local performance
   – Data is isolated in the server, not shared between
     members of a cluster
   – No redundancy in the case of failure

    Great solution if you can tolerate some failure & data loss
                            (web cache)

       In-Server SSD usage will rely on application integration
How Can Flash Be Used?
• Enhance existing storage
  – SSD in existing traditional arrays
  – Quick solution
  – Either partially or entirely fill an array
  – May not get best performance from SSD
  – Requires automated tiering to get best results
     • Dynamic Tiering, e.g. EMC’s FAST
How Can Flash Be Used?
• Dedicated SSD arrays
  – New vendors and products coming to market
  – All flash solid state devices
  – Hardware tuned to work with solid state media
     • I/O Spike avoidance
     • Wear levelling
     • RAID & controller redundancy
  – Consistent performance with scale
     • IOPS & Latency
  – Next wave of products will bring scale to match
    performance
It’s About $/IOPS not $/GB
• Cost models need to evolve
  – $/GB doesn’t work for SSD today, HDD still
    cheaper
  – Vendors using tricks (like post-dedupe and
    compression capacity) to fix $/GB numbers
• Better comparison is $/IOPS
  – Have to quantify cost benefit of faster I/O
  – Can be justified in certain workloads
Vendors With Products Today
The Drawbacks
• Is this a hammer to crack a nut?
  – All SSD means all data is expensive
  – What about low priority I/O?
  – What about inactive data?
  – What about secondary data copies?
  – What about replication?

                Is there another way?
The Mavericks
• Some vendors are taking alternative
  approaches
  – Virsto – random to sequential workload
  – Atlantis Computing – I/O reduction
  – Tintri – VMware aware storage
  – Nutanix – Hybrid storage & hypervisor
Migration of Control
• With SAN, storage arrays owned the data
   – Decided on placement
   – Managed clones and replication
   – Managed redundancy/failover
• With Virtualisation, control shifts to the
  hypervisor
   –   Storage capabilities advertised with VASA
   –   Data replication with VAAI
   –   Data placement with Storage DRS
   –   Bandwidth/throughput management with Storage I/O
       Control
Where Should Control Lie?
• Both array and hypervisor now allow for
  – Thin Provisioning
  – Tiered Storage
  – Initial and Dynamic Data placement
  – Replication

   Where should control lie? Open Question – I don’t
       have an answer, but I have an opinion!
What about DAS & NAS?
• Nothing wrong with NAS or DAS but…
  – There are no all-flash NAS arrays (yet)
  – DAS is just SSD in the server with the same issues
    of reliability of a single device
• NAS & DAS have a place, but not with high-
  performance/high-density deployments

  Ultimately the protocol is less relevant than
     the service capabilities of the storage
The Future
• SSD is here to stay
• So are Hard Drives – cheap and easy
• All-SSD arrays have to evolve
   – 90% Flash as primary storage
   – 10% HDD as archive of inactive working set
• It’s not fully clear whether storage arrays will require
  advanced functionality in all-virtualised environments
• Application vendors will be heavily involved
• Big issues still to solve
   – Long distance replication
   – Proper DR
Questions/Thoughts/Opinions?
• Follow up questions;
  – chris@brookend.com
  – http://blog.thestoragearchitect.com
  – @chrismevans

Contenu connexe

Tendances

Scale Computing & the Time-Starved Administrator’s Guide to Simplifying the S...
Scale Computing & the Time-Starved Administrator’s Guide to Simplifying the S...Scale Computing & the Time-Starved Administrator’s Guide to Simplifying the S...
Scale Computing & the Time-Starved Administrator’s Guide to Simplifying the S...actualtechmedia
 
Presentazione PureStorage @ VMUGIT UserCon 2015
Presentazione PureStorage @ VMUGIT UserCon 2015Presentazione PureStorage @ VMUGIT UserCon 2015
Presentazione PureStorage @ VMUGIT UserCon 2015VMUG IT
 
Mtc learnings from isv & enterprise interaction
Mtc learnings from isv & enterprise  interactionMtc learnings from isv & enterprise  interaction
Mtc learnings from isv & enterprise interactionGovind Kanshi
 
Mtc learnings from isv & enterprise (dated - Dec -2014)
Mtc learnings from isv & enterprise (dated - Dec -2014)Mtc learnings from isv & enterprise (dated - Dec -2014)
Mtc learnings from isv & enterprise (dated - Dec -2014)Govind Kanshi
 
Webinar: Exposing Myths of Flash Storage for Virtualization
Webinar: Exposing Myths of Flash Storage for VirtualizationWebinar: Exposing Myths of Flash Storage for Virtualization
Webinar: Exposing Myths of Flash Storage for VirtualizationStorage Switzerland
 
Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711
Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711
Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711Dave Anselmi
 
Optimize MySQL performance for developers
Optimize MySQL performance for developersOptimize MySQL performance for developers
Optimize MySQL performance for developersjackbillow
 
Nimble storage
Nimble storageNimble storage
Nimble storagedvmug1
 
Nimble Storage presentation used during the SWITCHPOINT NV/SA Quarterly Exper...
Nimble Storage presentation used during the SWITCHPOINT NV/SA Quarterly Exper...Nimble Storage presentation used during the SWITCHPOINT NV/SA Quarterly Exper...
Nimble Storage presentation used during the SWITCHPOINT NV/SA Quarterly Exper...SWITCHPOINT NV/SA
 
Scaling apps for the big time
Scaling apps for the big timeScaling apps for the big time
Scaling apps for the big timeproitconsult
 
20130714 php matsuri - highly available php
20130714   php matsuri - highly available php20130714   php matsuri - highly available php
20130714 php matsuri - highly available phpGraham Weldon
 
Storage Systems For Scalable systems
Storage Systems For Scalable systemsStorage Systems For Scalable systems
Storage Systems For Scalable systemselliando dias
 
Optimizing Flash Storage for SQL Databases
Optimizing Flash Storage for SQL DatabasesOptimizing Flash Storage for SQL Databases
Optimizing Flash Storage for SQL DatabasesStorage Switzerland
 
Scaling Techniques to Increase Magento Capacity
Scaling Techniques to Increase Magento CapacityScaling Techniques to Increase Magento Capacity
Scaling Techniques to Increase Magento CapacityClustrix
 
Hardware planning & sizing for sql server
Hardware planning & sizing for sql serverHardware planning & sizing for sql server
Hardware planning & sizing for sql serverDavide Mauri
 
Mongo db groundup-0-nosql-intro-syedawasekhirni
Mongo db groundup-0-nosql-intro-syedawasekhirniMongo db groundup-0-nosql-intro-syedawasekhirni
Mongo db groundup-0-nosql-intro-syedawasekhirniDr. Awase Khirni Syed
 
10 things, an Oracle DBA should care about when moving to PostgreSQL
10 things, an Oracle DBA should care about when moving to PostgreSQL10 things, an Oracle DBA should care about when moving to PostgreSQL
10 things, an Oracle DBA should care about when moving to PostgreSQLPostgreSQL-Consulting
 
NetApp Pure Storage - A Business Intelligence PPT
NetApp Pure Storage - A Business Intelligence PPTNetApp Pure Storage - A Business Intelligence PPT
NetApp Pure Storage - A Business Intelligence PPTShridhar Shriraghavan
 
Mongo db model relationships with documents
Mongo db model relationships with documentsMongo db model relationships with documents
Mongo db model relationships with documentsDr. Awase Khirni Syed
 

Tendances (20)

Scale Computing & the Time-Starved Administrator’s Guide to Simplifying the S...
Scale Computing & the Time-Starved Administrator’s Guide to Simplifying the S...Scale Computing & the Time-Starved Administrator’s Guide to Simplifying the S...
Scale Computing & the Time-Starved Administrator’s Guide to Simplifying the S...
 
Presentazione PureStorage @ VMUGIT UserCon 2015
Presentazione PureStorage @ VMUGIT UserCon 2015Presentazione PureStorage @ VMUGIT UserCon 2015
Presentazione PureStorage @ VMUGIT UserCon 2015
 
Mtc learnings from isv & enterprise interaction
Mtc learnings from isv & enterprise  interactionMtc learnings from isv & enterprise  interaction
Mtc learnings from isv & enterprise interaction
 
Mtc learnings from isv & enterprise (dated - Dec -2014)
Mtc learnings from isv & enterprise (dated - Dec -2014)Mtc learnings from isv & enterprise (dated - Dec -2014)
Mtc learnings from isv & enterprise (dated - Dec -2014)
 
Webinar: Exposing Myths of Flash Storage for Virtualization
Webinar: Exposing Myths of Flash Storage for VirtualizationWebinar: Exposing Myths of Flash Storage for Virtualization
Webinar: Exposing Myths of Flash Storage for Virtualization
 
Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711
Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711
Scaling RDBMS on AWS- ClustrixDB @AWS Meetup 20160711
 
Optimize MySQL performance for developers
Optimize MySQL performance for developersOptimize MySQL performance for developers
Optimize MySQL performance for developers
 
Nimble storage
Nimble storageNimble storage
Nimble storage
 
Nimble Storage presentation used during the SWITCHPOINT NV/SA Quarterly Exper...
Nimble Storage presentation used during the SWITCHPOINT NV/SA Quarterly Exper...Nimble Storage presentation used during the SWITCHPOINT NV/SA Quarterly Exper...
Nimble Storage presentation used during the SWITCHPOINT NV/SA Quarterly Exper...
 
Scaling apps for the big time
Scaling apps for the big timeScaling apps for the big time
Scaling apps for the big time
 
Qcon talk
Qcon talkQcon talk
Qcon talk
 
20130714 php matsuri - highly available php
20130714   php matsuri - highly available php20130714   php matsuri - highly available php
20130714 php matsuri - highly available php
 
Storage Systems For Scalable systems
Storage Systems For Scalable systemsStorage Systems For Scalable systems
Storage Systems For Scalable systems
 
Optimizing Flash Storage for SQL Databases
Optimizing Flash Storage for SQL DatabasesOptimizing Flash Storage for SQL Databases
Optimizing Flash Storage for SQL Databases
 
Scaling Techniques to Increase Magento Capacity
Scaling Techniques to Increase Magento CapacityScaling Techniques to Increase Magento Capacity
Scaling Techniques to Increase Magento Capacity
 
Hardware planning & sizing for sql server
Hardware planning & sizing for sql serverHardware planning & sizing for sql server
Hardware planning & sizing for sql server
 
Mongo db groundup-0-nosql-intro-syedawasekhirni
Mongo db groundup-0-nosql-intro-syedawasekhirniMongo db groundup-0-nosql-intro-syedawasekhirni
Mongo db groundup-0-nosql-intro-syedawasekhirni
 
10 things, an Oracle DBA should care about when moving to PostgreSQL
10 things, an Oracle DBA should care about when moving to PostgreSQL10 things, an Oracle DBA should care about when moving to PostgreSQL
10 things, an Oracle DBA should care about when moving to PostgreSQL
 
NetApp Pure Storage - A Business Intelligence PPT
NetApp Pure Storage - A Business Intelligence PPTNetApp Pure Storage - A Business Intelligence PPT
NetApp Pure Storage - A Business Intelligence PPT
 
Mongo db model relationships with documents
Mongo db model relationships with documentsMongo db model relationships with documents
Mongo db model relationships with documents
 

En vedette

The Rise of Open Storage
The Rise of Open StorageThe Rise of Open Storage
The Rise of Open StorageChris Evans
 
TECHunplugged Austin 2016
TECHunplugged Austin 2016TECHunplugged Austin 2016
TECHunplugged Austin 2016Chris Evans
 
TECHunplugged London 2016 - Real World Storage
TECHunplugged London 2016 - Real World StorageTECHunplugged London 2016 - Real World Storage
TECHunplugged London 2016 - Real World StorageChris Evans
 
Learn BEM: CSS Naming Convention
Learn BEM: CSS Naming ConventionLearn BEM: CSS Naming Convention
Learn BEM: CSS Naming ConventionIn a Rocket
 
How to Build a Dynamic Social Media Plan
How to Build a Dynamic Social Media PlanHow to Build a Dynamic Social Media Plan
How to Build a Dynamic Social Media PlanPost Planner
 
SEO: Getting Personal
SEO: Getting PersonalSEO: Getting Personal
SEO: Getting PersonalKirsty Hulse
 
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika AldabaLightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldabaux singapore
 

En vedette (8)

The Rise of Open Storage
The Rise of Open StorageThe Rise of Open Storage
The Rise of Open Storage
 
TECHunplugged Austin 2016
TECHunplugged Austin 2016TECHunplugged Austin 2016
TECHunplugged Austin 2016
 
TECHunplugged London 2016 - Real World Storage
TECHunplugged London 2016 - Real World StorageTECHunplugged London 2016 - Real World Storage
TECHunplugged London 2016 - Real World Storage
 
Learn BEM: CSS Naming Convention
Learn BEM: CSS Naming ConventionLearn BEM: CSS Naming Convention
Learn BEM: CSS Naming Convention
 
How to Build a Dynamic Social Media Plan
How to Build a Dynamic Social Media PlanHow to Build a Dynamic Social Media Plan
How to Build a Dynamic Social Media Plan
 
SEO: Getting Personal
SEO: Getting PersonalSEO: Getting Personal
SEO: Getting Personal
 
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika AldabaLightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
Lightning Talk #9: How UX and Data Storytelling Can Shape Policy by Mika Aldaba
 
Succession “Losers”: What Happens to Executives Passed Over for the CEO Job?
Succession “Losers”: What Happens to Executives Passed Over for the CEO Job? Succession “Losers”: What Happens to Executives Passed Over for the CEO Job?
Succession “Losers”: What Happens to Executives Passed Over for the CEO Job?
 

Similaire à London VMUG Presentation 19th July 2012

Using flash on the server side
Using flash on the server sideUsing flash on the server side
Using flash on the server sideHoward Marks
 
TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...
TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...
TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...NetApp
 
Kb 40 kevin_klineukug_reading20070717[1]
Kb 40 kevin_klineukug_reading20070717[1]Kb 40 kevin_klineukug_reading20070717[1]
Kb 40 kevin_klineukug_reading20070717[1]shuwutong
 
Webinar: Overcoming the Storage Challenges Cassandra and Couchbase Create
Webinar: Overcoming the Storage Challenges Cassandra and Couchbase CreateWebinar: Overcoming the Storage Challenges Cassandra and Couchbase Create
Webinar: Overcoming the Storage Challenges Cassandra and Couchbase CreateStorage Switzerland
 
Virtualizing Tier One Applications - Varrow
Virtualizing Tier One Applications - VarrowVirtualizing Tier One Applications - Varrow
Virtualizing Tier One Applications - VarrowAndrew Miller
 
Pascal benois performance_troubleshooting-spsbe18
Pascal benois performance_troubleshooting-spsbe18Pascal benois performance_troubleshooting-spsbe18
Pascal benois performance_troubleshooting-spsbe18BIWUG
 
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...Andrew Miller
 
Make your first CloudStack Cloud successful
Make your first CloudStack Cloud successfulMake your first CloudStack Cloud successful
Make your first CloudStack Cloud successfulTim Mackey
 
NoSQL A brief look at Apache Cassandra Distributed Database
NoSQL A brief look at Apache Cassandra Distributed DatabaseNoSQL A brief look at Apache Cassandra Distributed Database
NoSQL A brief look at Apache Cassandra Distributed DatabaseJoe Alex
 
Next Generation Software-Defined Storage
Next Generation Software-Defined StorageNext Generation Software-Defined Storage
Next Generation Software-Defined StorageStorMagic
 
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?Clustrix
 
Software defined storage real or bs-2014
Software defined storage real or bs-2014Software defined storage real or bs-2014
Software defined storage real or bs-2014Howard Marks
 
AWS Summit 2013 | Auckland - Building Web Scale Applications with AWS
AWS Summit 2013 | Auckland - Building Web Scale Applications with AWSAWS Summit 2013 | Auckland - Building Web Scale Applications with AWS
AWS Summit 2013 | Auckland - Building Web Scale Applications with AWSAmazon Web Services
 
VMworld 2014: Virtualize Active Directory, the Right Way!
VMworld 2014: Virtualize Active Directory, the Right Way!VMworld 2014: Virtualize Active Directory, the Right Way!
VMworld 2014: Virtualize Active Directory, the Right Way!VMworld
 
Sql Start! 2020 - SQL Server Lift & Shift su Azure
Sql Start! 2020 - SQL Server Lift & Shift su AzureSql Start! 2020 - SQL Server Lift & Shift su Azure
Sql Start! 2020 - SQL Server Lift & Shift su AzureMarco Obinu
 
SQL, NoSQL, BigData in Data Architecture
SQL, NoSQL, BigData in Data ArchitectureSQL, NoSQL, BigData in Data Architecture
SQL, NoSQL, BigData in Data ArchitectureVenu Anuganti
 
SD Big Data Monthly Meetup #4 - Session 2 - WANDisco
SD Big Data Monthly Meetup #4 - Session 2 - WANDiscoSD Big Data Monthly Meetup #4 - Session 2 - WANDisco
SD Big Data Monthly Meetup #4 - Session 2 - WANDiscoBig Data Joe™ Rossi
 
Development of concurrent services using In-Memory Data Grids
Development of concurrent services using In-Memory Data GridsDevelopment of concurrent services using In-Memory Data Grids
Development of concurrent services using In-Memory Data Gridsjlorenzocima
 

Similaire à London VMUG Presentation 19th July 2012 (20)

Using flash on the server side
Using flash on the server sideUsing flash on the server side
Using flash on the server side
 
TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...
TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...
TechTarget Event - Storage Architectures for the Modern Data Center - Howard ...
 
Storage for VDI
Storage for VDIStorage for VDI
Storage for VDI
 
Kb 40 kevin_klineukug_reading20070717[1]
Kb 40 kevin_klineukug_reading20070717[1]Kb 40 kevin_klineukug_reading20070717[1]
Kb 40 kevin_klineukug_reading20070717[1]
 
Webinar: Overcoming the Storage Challenges Cassandra and Couchbase Create
Webinar: Overcoming the Storage Challenges Cassandra and Couchbase CreateWebinar: Overcoming the Storage Challenges Cassandra and Couchbase Create
Webinar: Overcoming the Storage Challenges Cassandra and Couchbase Create
 
Virtualizing Tier One Applications - Varrow
Virtualizing Tier One Applications - VarrowVirtualizing Tier One Applications - Varrow
Virtualizing Tier One Applications - Varrow
 
Pascal benois performance_troubleshooting-spsbe18
Pascal benois performance_troubleshooting-spsbe18Pascal benois performance_troubleshooting-spsbe18
Pascal benois performance_troubleshooting-spsbe18
 
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
Varrow Q4 Lunch & Learn Presentation - Virtualizing Business Critical Applica...
 
Make your first CloudStack Cloud successful
Make your first CloudStack Cloud successfulMake your first CloudStack Cloud successful
Make your first CloudStack Cloud successful
 
NoSQL A brief look at Apache Cassandra Distributed Database
NoSQL A brief look at Apache Cassandra Distributed DatabaseNoSQL A brief look at Apache Cassandra Distributed Database
NoSQL A brief look at Apache Cassandra Distributed Database
 
Next Generation Software-Defined Storage
Next Generation Software-Defined StorageNext Generation Software-Defined Storage
Next Generation Software-Defined Storage
 
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?
Tech Talk Series, Part 2: Why is sharding not smart to do in MySQL?
 
Software defined storage real or bs-2014
Software defined storage real or bs-2014Software defined storage real or bs-2014
Software defined storage real or bs-2014
 
AWS Summit 2013 | Auckland - Building Web Scale Applications with AWS
AWS Summit 2013 | Auckland - Building Web Scale Applications with AWSAWS Summit 2013 | Auckland - Building Web Scale Applications with AWS
AWS Summit 2013 | Auckland - Building Web Scale Applications with AWS
 
VMworld 2014: Virtualize Active Directory, the Right Way!
VMworld 2014: Virtualize Active Directory, the Right Way!VMworld 2014: Virtualize Active Directory, the Right Way!
VMworld 2014: Virtualize Active Directory, the Right Way!
 
Sql Start! 2020 - SQL Server Lift & Shift su Azure
Sql Start! 2020 - SQL Server Lift & Shift su AzureSql Start! 2020 - SQL Server Lift & Shift su Azure
Sql Start! 2020 - SQL Server Lift & Shift su Azure
 
NoSql
NoSqlNoSql
NoSql
 
SQL, NoSQL, BigData in Data Architecture
SQL, NoSQL, BigData in Data ArchitectureSQL, NoSQL, BigData in Data Architecture
SQL, NoSQL, BigData in Data Architecture
 
SD Big Data Monthly Meetup #4 - Session 2 - WANDisco
SD Big Data Monthly Meetup #4 - Session 2 - WANDiscoSD Big Data Monthly Meetup #4 - Session 2 - WANDisco
SD Big Data Monthly Meetup #4 - Session 2 - WANDisco
 
Development of concurrent services using In-Memory Data Grids
Development of concurrent services using In-Memory Data GridsDevelopment of concurrent services using In-Memory Data Grids
Development of concurrent services using In-Memory Data Grids
 

Dernier

08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 

Dernier (20)

08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 

London VMUG Presentation 19th July 2012

  • 1. The Architect’s View Chris M Evans Director, Langton Blue Ltd blog.thestoragearchitect.com @chrismevans
  • 2. Introduction • I am an independent consultant  • I have no marketing budget – no giveaways  • I don’t know everything (although my wife says I think I do)  • Let’s make this interactive  I realise I am between you and lunch….
  • 3. The Need for Virtualisation….
  • 4. Our Topic for Today… • Last time I presented you the past….
  • 5. Our Topic for Today… • Today I give you – The Future!
  • 6. How is Virtualisation Driving Storage Use? • High I/O density – Consolidation of servers and IOPS into single LUNs – VDI desktop consolidation – Array based copy (VAAI) • High Concentration of Risk – Multiple dependent systems in one server/cluster • Consistent Performance – No I/O spikes – bad for any workload, catastrophic for gaming & financial workloads • I/O Blender – Virtualisation creates highly random workload Increased levels of virtualisation require significant improvements in I/O density
  • 7. Requirements • Consistent high performance – Low latency – 1ms or less – High IOPS > 500K – Reliability – no failures • Management – APIs & RESTful interfaces – Private Cloud integration • Advanced Features in Arrays – VAAI, VASA support
  • 8. Enter Flash! • Solid State Storage • Very high IOPS – both read and write • Low latency • Low Power • “enterprise” SLC and consumer “MLC” grade • SAS/SATA form factor compatible • Great at managing random workload…. But….. • Relatively high cost (SLC especially so) • Finite lifetime – they will wear out and fail
  • 9. How Can Flash Be Used? • In-Server – PCIe SSD – Fusion-IO, VFCache, etc – SAS SSD devices – Very high low latency, local performance – Data is isolated in the server, not shared between members of a cluster – No redundancy in the case of failure Great solution if you can tolerate some failure & data loss (web cache) In-Server SSD usage will rely on application integration
  • 10. How Can Flash Be Used? • Enhance existing storage – SSD in existing traditional arrays – Quick solution – Either partially or entirely fill an array – May not get best performance from SSD – Requires automated tiering to get best results • Dynamic Tiering, e.g. EMC’s FAST
  • 11. How Can Flash Be Used? • Dedicated SSD arrays – New vendors and products coming to market – All flash solid state devices – Hardware tuned to work with solid state media • I/O Spike avoidance • Wear levelling • RAID & controller redundancy – Consistent performance with scale • IOPS & Latency – Next wave of products will bring scale to match performance
  • 12. It’s About $/IOPS not $/GB • Cost models need to evolve – $/GB doesn’t work for SSD today, HDD still cheaper – Vendors using tricks (like post-dedupe and compression capacity) to fix $/GB numbers • Better comparison is $/IOPS – Have to quantify cost benefit of faster I/O – Can be justified in certain workloads
  • 14. The Drawbacks • Is this a hammer to crack a nut? – All SSD means all data is expensive – What about low priority I/O? – What about inactive data? – What about secondary data copies? – What about replication? Is there another way?
  • 15. The Mavericks • Some vendors are taking alternative approaches – Virsto – random to sequential workload – Atlantis Computing – I/O reduction – Tintri – VMware aware storage – Nutanix – Hybrid storage & hypervisor
  • 16. Migration of Control • With SAN, storage arrays owned the data – Decided on placement – Managed clones and replication – Managed redundancy/failover • With Virtualisation, control shifts to the hypervisor – Storage capabilities advertised with VASA – Data replication with VAAI – Data placement with Storage DRS – Bandwidth/throughput management with Storage I/O Control
  • 17. Where Should Control Lie? • Both array and hypervisor now allow for – Thin Provisioning – Tiered Storage – Initial and Dynamic Data placement – Replication Where should control lie? Open Question – I don’t have an answer, but I have an opinion!
  • 18. What about DAS & NAS? • Nothing wrong with NAS or DAS but… – There are no all-flash NAS arrays (yet) – DAS is just SSD in the server with the same issues of reliability of a single device • NAS & DAS have a place, but not with high- performance/high-density deployments Ultimately the protocol is less relevant than the service capabilities of the storage
  • 19. The Future • SSD is here to stay • So are Hard Drives – cheap and easy • All-SSD arrays have to evolve – 90% Flash as primary storage – 10% HDD as archive of inactive working set • It’s not fully clear whether storage arrays will require advanced functionality in all-virtualised environments • Application vendors will be heavily involved • Big issues still to solve – Long distance replication – Proper DR
  • 20. Questions/Thoughts/Opinions? • Follow up questions; – chris@brookend.com – http://blog.thestoragearchitect.com – @chrismevans