SlideShare une entreprise Scribd logo
1  sur  28
Hush…tell you something novel
    about flash memory !
           Zhichao Liang
      frankey0207@gmail.com
Outline
•   Background
•   Some tests
•   Possible applications
•   Some extensions
Outline
•   Background
•   Some tests
•   Possible applications
•   Some extensions
Background
• Flash manufacturers provide conservative and
  often vague guidelines about performance,
  energy consumption and reliability.
• The lack of detail complicates the design of
  systems which fully exploit flash memory’s
  capabilities.
Outline
•   Background
•   Some tests
•   Possible applications
•   Some extensions
Test subjects




Characterizing Flash Memory: Anomalies, Observations, and
Applications by Laura M. Grupp, Adrian M. Caulfield, Joel Coburn
  etc.(MIRCO’09)
The tests
Quantify known and unknown idiosyncrasies
• Performance
• Energy Efficiency
• Reliability
Read Latency
• The read latency varies little by manufacturer or chip, and are
  in good agreement with values from publicly available
  datasheets.
Erase Latency
• Erase latency exhibits a smaller gap, but manufacturer B
  enjoys an advantage for SLC and E for MLC.
Program Latency
• MLC chips have, on average, longer and enormously variable
  program latencies.
Program Speed Anomaly
• Programming speed varies dramatically between pages in
  MLC devices in a predictable pattern.
Performance Increase Anomaly
• Performance varies predictably as the devices begin to wear
  out.
Power
• The table presents peak power, average power, idle power,
  and per-operation energy for each operation.
Program Energy
• Fast and slow pages show a disparity similar to the one we
  observed for program time.
Reliability
• Flash memory can corrupt data in three main
  ways: wear-out, program disturb and read
  disturb.
• 10 erase-program-read cycles + 990 erase-
  program.
• 1 million erases for SLC and 100,000 erases for
  MLC.
Error Rates
• The difference between SLC and MLC is stark.
Disparity in MLC
• MLC chips show large variation in error rates among pages in
  a single block.
Program Disturb
• Erase a block and repeatedly program half of one page to 0.
Read Disturb
• Write a test pattern to several blocks on the flash chip and
  repeatedly read the pattern back.
Summary
• Fast pages and slow pages in MLC
• High energy-consumption pages and low
  energy-consumption pages in MLC
• Better program performance as wear out for
  SLC and MLC
• High error-rate pages and low error-rate pages
  in MLC
• Program disturb and read disturb
Outline
•   Background
•   Some tests
•   Possible applications
•   Some extensions
A variation-aware FTL
• Mango adds a priority to incoming IO request and it
  will do its best to use fast pages for the high-priority
  writes.
• This variation-aware FTL is evaluated in two
  scenarios: Swap&Netbook.
• For Swap, it can significantly increase responsiveness
  for swap requests.
• For Netbook, it can slightly reduce the energy drain
  on the battery.
Flash-aware data encoding
• Womcode is a coding
  techniques makes
  rewriting wom
  possible!

• Effective lifetime:
  - SLC: 2*(2/3) = 33% increase
  - MLC: (2*(2/3) + 1)*(1/2) = 17% increase
Outline
•   Background
•   Some tests
•   Possible applications
•   Some extensions
Gordon
• A system architecture for data-centric
  applications that combines low-power
  processors, flash memory, and data-centric
  programming.
• Performance & Reduced Power Consumption

Gordon: Using Flash Memory to Build Fast, Power-
efficient Clusters for Data-intensive Applications by Adrian M.
   Caufield Laura M. Grupp and Steven Swanson(ASPLOS’09)
Gordon Node
• 256GB flash storage, a flash storage controller, 2GB of ECC
  DDR2 SDRAM, a 1.9Ghz Intel Atom processor and other
  supporting circuitry.
Gordon Enclosure
• A enclosure holds 16 nodes(4TB storage) and provides
  14.4GB/s of aggregate IO bandwidth.
Q&A

Contenu connexe

En vedette (9)

Flash memory device inside
Flash memory device insideFlash memory device inside
Flash memory device inside
 
Flash memory as a hard drive replacement
Flash  memory  as a  hard  drive replacementFlash  memory  as a  hard  drive replacement
Flash memory as a hard drive replacement
 
A new era in embedded flash memory, Anobit presentation fms 2011 -
A new era in embedded flash memory, Anobit presentation fms 2011 -A new era in embedded flash memory, Anobit presentation fms 2011 -
A new era in embedded flash memory, Anobit presentation fms 2011 -
 
Nvmw 2014 extending main memory with flash-the optimized swap approach
Nvmw 2014  extending main memory with flash-the optimized swap approachNvmw 2014  extending main memory with flash-the optimized swap approach
Nvmw 2014 extending main memory with flash-the optimized swap approach
 
Nand flash memory
Nand flash memoryNand flash memory
Nand flash memory
 
Flash Memory Storage
Flash Memory StorageFlash Memory Storage
Flash Memory Storage
 
Memory(RAM ROM FLASH MEMORY)
Memory(RAM ROM FLASH MEMORY)Memory(RAM ROM FLASH MEMORY)
Memory(RAM ROM FLASH MEMORY)
 
Flash memory
Flash memoryFlash memory
Flash memory
 
Flash memory
Flash memoryFlash memory
Flash memory
 

Similaire à Hush…tell you something novel about flash memory

Magnet Shuffle Service: Push-based Shuffle at LinkedIn
Magnet Shuffle Service: Push-based Shuffle at LinkedInMagnet Shuffle Service: Push-based Shuffle at LinkedIn
Magnet Shuffle Service: Push-based Shuffle at LinkedIn
Databricks
 

Similaire à Hush…tell you something novel about flash memory (20)

Flash Storage Technology 101
Flash Storage Technology 101Flash Storage Technology 101
Flash Storage Technology 101
 
Make Oracle scream with Flash Storage - Kaminario
Make Oracle scream with Flash Storage - KaminarioMake Oracle scream with Flash Storage - Kaminario
Make Oracle scream with Flash Storage - Kaminario
 
OMI - The Missing Piece of a Modular, Flexible and Composable Computing World
OMI - The Missing Piece of a Modular, Flexible and Composable Computing WorldOMI - The Missing Piece of a Modular, Flexible and Composable Computing World
OMI - The Missing Piece of a Modular, Flexible and Composable Computing World
 
Chap2 slides
Chap2 slidesChap2 slides
Chap2 slides
 
Breaking the Memory Wall
Breaking the Memory WallBreaking the Memory Wall
Breaking the Memory Wall
 
Key Note Session IDUG DB2 Seminar, 16th April London - Julian Stuhler .Trito...
Key Note Session  IDUG DB2 Seminar, 16th April London - Julian Stuhler .Trito...Key Note Session  IDUG DB2 Seminar, 16th April London - Julian Stuhler .Trito...
Key Note Session IDUG DB2 Seminar, 16th April London - Julian Stuhler .Trito...
 
Reliability of NAND-Based SSDs What Field Studies Tell Us.pptx
Reliability of NAND-Based SSDs What Field Studies Tell Us.pptxReliability of NAND-Based SSDs What Field Studies Tell Us.pptx
Reliability of NAND-Based SSDs What Field Studies Tell Us.pptx
 
A Time Traveller's Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller's Guide to DB2: Technology Themes for 2014 and BeyondA Time Traveller's Guide to DB2: Technology Themes for 2014 and Beyond
A Time Traveller's Guide to DB2: Technology Themes for 2014 and Beyond
 
Empirically Derived Abstractions in Uncore Power Modeling for a Server-Class...
Empirically Derived Abstractions in Uncore Power Modeling for a  Server-Class...Empirically Derived Abstractions in Uncore Power Modeling for a  Server-Class...
Empirically Derived Abstractions in Uncore Power Modeling for a Server-Class...
 
Fastest Servlets in the West
Fastest Servlets in the WestFastest Servlets in the West
Fastest Servlets in the West
 
Scaling apps for the big time
Scaling apps for the big timeScaling apps for the big time
Scaling apps for the big time
 
Factored Operating Systems paper review
Factored Operating Systems paper reviewFactored Operating Systems paper review
Factored Operating Systems paper review
 
What is the right Industrial Storage? MLC vs Ultra MLC vs SLC
What is the right Industrial Storage? MLC vs Ultra MLC vs SLCWhat is the right Industrial Storage? MLC vs Ultra MLC vs SLC
What is the right Industrial Storage? MLC vs Ultra MLC vs SLC
 
Maha an energy efficient malleable hardware accelerator for data intensive a...
Maha  an energy efficient malleable hardware accelerator for data intensive a...Maha  an energy efficient malleable hardware accelerator for data intensive a...
Maha an energy efficient malleable hardware accelerator for data intensive a...
 
USRG2014 Poster
USRG2014 PosterUSRG2014 Poster
USRG2014 Poster
 
Lakefield: Hybrid Cores in 3D Package
Lakefield: Hybrid Cores in 3D PackageLakefield: Hybrid Cores in 3D Package
Lakefield: Hybrid Cores in 3D Package
 
Trends in computer architecture
Trends in computer architectureTrends in computer architecture
Trends in computer architecture
 
Magnet Shuffle Service: Push-based Shuffle at LinkedIn
Magnet Shuffle Service: Push-based Shuffle at LinkedInMagnet Shuffle Service: Push-based Shuffle at LinkedIn
Magnet Shuffle Service: Push-based Shuffle at LinkedIn
 
Introduction to Parallel Computing
Introduction to Parallel ComputingIntroduction to Parallel Computing
Introduction to Parallel Computing
 
Java Performance Tuning
Java Performance TuningJava Performance Tuning
Java Performance Tuning
 

Plus de Zhichao Liang

A novel method to extend flash memory lifetime in flash based dbms
A novel method to extend flash memory lifetime in flash based dbmsA novel method to extend flash memory lifetime in flash based dbms
A novel method to extend flash memory lifetime in flash based dbms
Zhichao Liang
 

Plus de Zhichao Liang (14)

微软Bot framework简介
微软Bot framework简介微软Bot framework简介
微软Bot framework简介
 
青云虚拟机部署私有Docker Registry
青云虚拟机部署私有Docker Registry青云虚拟机部署私有Docker Registry
青云虚拟机部署私有Docker Registry
 
开源Pass平台flynn功能简介
开源Pass平台flynn功能简介开源Pass平台flynn功能简介
开源Pass平台flynn功能简介
 
青云CoreOS虚拟机部署kubernetes
青云CoreOS虚拟机部署kubernetes 青云CoreOS虚拟机部署kubernetes
青云CoreOS虚拟机部署kubernetes
 
Introduction of own cloud
Introduction of own cloudIntroduction of own cloud
Introduction of own cloud
 
Power drill列存储底层设计
Power drill列存储底层设计Power drill列存储底层设计
Power drill列存储底层设计
 
C store底层存储设计
C store底层存储设计C store底层存储设计
C store底层存储设计
 
Storage Class Memory: Technology Overview & System Impacts
Storage Class Memory: Technology Overview & System ImpactsStorage Class Memory: Technology Overview & System Impacts
Storage Class Memory: Technology Overview & System Impacts
 
A simple introduction to redis
A simple introduction to redisA simple introduction to redis
A simple introduction to redis
 
Memcached简介
Memcached简介Memcached简介
Memcached简介
 
Some key value stores using log-structure
Some key value stores using log-structureSome key value stores using log-structure
Some key value stores using log-structure
 
A novel method to extend flash memory lifetime in flash based dbms
A novel method to extend flash memory lifetime in flash based dbmsA novel method to extend flash memory lifetime in flash based dbms
A novel method to extend flash memory lifetime in flash based dbms
 
Sub join a query optimization algorithm for flash-based database
Sub join a query optimization algorithm for flash-based databaseSub join a query optimization algorithm for flash-based database
Sub join a query optimization algorithm for flash-based database
 
Survey of distributed storage system
Survey of distributed storage systemSurvey of distributed storage system
Survey of distributed storage system
 

Dernier

Dernier (20)

Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 

Hush…tell you something novel about flash memory

  • 1. Hush…tell you something novel about flash memory ! Zhichao Liang frankey0207@gmail.com
  • 2. Outline • Background • Some tests • Possible applications • Some extensions
  • 3. Outline • Background • Some tests • Possible applications • Some extensions
  • 4. Background • Flash manufacturers provide conservative and often vague guidelines about performance, energy consumption and reliability. • The lack of detail complicates the design of systems which fully exploit flash memory’s capabilities.
  • 5. Outline • Background • Some tests • Possible applications • Some extensions
  • 6. Test subjects Characterizing Flash Memory: Anomalies, Observations, and Applications by Laura M. Grupp, Adrian M. Caulfield, Joel Coburn etc.(MIRCO’09)
  • 7. The tests Quantify known and unknown idiosyncrasies • Performance • Energy Efficiency • Reliability
  • 8. Read Latency • The read latency varies little by manufacturer or chip, and are in good agreement with values from publicly available datasheets.
  • 9. Erase Latency • Erase latency exhibits a smaller gap, but manufacturer B enjoys an advantage for SLC and E for MLC.
  • 10. Program Latency • MLC chips have, on average, longer and enormously variable program latencies.
  • 11. Program Speed Anomaly • Programming speed varies dramatically between pages in MLC devices in a predictable pattern.
  • 12. Performance Increase Anomaly • Performance varies predictably as the devices begin to wear out.
  • 13. Power • The table presents peak power, average power, idle power, and per-operation energy for each operation.
  • 14. Program Energy • Fast and slow pages show a disparity similar to the one we observed for program time.
  • 15. Reliability • Flash memory can corrupt data in three main ways: wear-out, program disturb and read disturb. • 10 erase-program-read cycles + 990 erase- program. • 1 million erases for SLC and 100,000 erases for MLC.
  • 16. Error Rates • The difference between SLC and MLC is stark.
  • 17. Disparity in MLC • MLC chips show large variation in error rates among pages in a single block.
  • 18. Program Disturb • Erase a block and repeatedly program half of one page to 0.
  • 19. Read Disturb • Write a test pattern to several blocks on the flash chip and repeatedly read the pattern back.
  • 20. Summary • Fast pages and slow pages in MLC • High energy-consumption pages and low energy-consumption pages in MLC • Better program performance as wear out for SLC and MLC • High error-rate pages and low error-rate pages in MLC • Program disturb and read disturb
  • 21. Outline • Background • Some tests • Possible applications • Some extensions
  • 22. A variation-aware FTL • Mango adds a priority to incoming IO request and it will do its best to use fast pages for the high-priority writes. • This variation-aware FTL is evaluated in two scenarios: Swap&Netbook. • For Swap, it can significantly increase responsiveness for swap requests. • For Netbook, it can slightly reduce the energy drain on the battery.
  • 23. Flash-aware data encoding • Womcode is a coding techniques makes rewriting wom possible! • Effective lifetime: - SLC: 2*(2/3) = 33% increase - MLC: (2*(2/3) + 1)*(1/2) = 17% increase
  • 24. Outline • Background • Some tests • Possible applications • Some extensions
  • 25. Gordon • A system architecture for data-centric applications that combines low-power processors, flash memory, and data-centric programming. • Performance & Reduced Power Consumption Gordon: Using Flash Memory to Build Fast, Power- efficient Clusters for Data-intensive Applications by Adrian M. Caufield Laura M. Grupp and Steven Swanson(ASPLOS’09)
  • 26. Gordon Node • 256GB flash storage, a flash storage controller, 2GB of ECC DDR2 SDRAM, a 1.9Ghz Intel Atom processor and other supporting circuitry.
  • 27. Gordon Enclosure • A enclosure holds 16 nodes(4TB storage) and provides 14.4GB/s of aggregate IO bandwidth.
  • 28. Q&A