SlideShare une entreprise Scribd logo
1  sur  57
Télécharger pour lire hors ligne
Thursday, November 3, 11
Thursday, November 3, 11
Data Grids and
                            Data Caching
                                Galder Zamarreño
                             Senior Software Engineer
                                   Red Hat, Inc
                              3rd October 2011, Soft Shake

Thursday, November 3, 11
Galder Zamarreño

                           •   R&D Engineer, Red Hat Inc.
                           •   Infinispan developer
                           •   5+ years exp. with distributed data systems
                           •   Twitter: @galderz
                           •   Blog: zamarreno.com



Thursday, November 3, 11
Agenda

                           •   What is Infinispan?
                           •   Infinispan as in-memory cache
                           •   Infinispan as in-memory data grid
                           •   Data-as-a-Service with Infinispan
                           •   Who uses Infinispan?



Thursday, November 3, 11
Introducing



Thursday, November 3, 11
What is Infinispan?

                           An in-memory, highly
                           available, elastic, and open
                           source (LGPL) data grid
                           platform

Thursday, November 3, 11
Infinispan can be
                                used as...

Thursday, November 3, 11
Local in-memory cache

                           Boost performance caching
                           data which is hard to calculate
                           or expensive to retrieve


Thursday, November 3, 11
ConcurrentHashMap ?

                           Infinispan provides greater
                           concurrency with MVCC, has
                           built-in eviction...etc


Thursday, November 3, 11
Local cache example




Thursday, November 3, 11
A local cache might
                            not be enough...

Thursday, November 3, 11
Clustered caches


                           Scale up your application and
                           maintain cache consistency


Thursday, November 3, 11
Consistency in a
                           clustered cache...

Thursday, November 3, 11
Invalidation




Thursday, November 3, 11
Invalidation




Thursday, November 3, 11
Invalidation




Thursday, November 3, 11
Cache-oriented
                            operations...

Thursday, November 3, 11
putForExternalRead()
                                         put()                   putForExternalRead()

                                 Use for updating state          Use to cache state read from
                                                                       external source

                            Regular lock acquisition timeout               Fail-fast


                               Could throw an exception                  Fails quietly


                           Could cause existing transaction to     Will never affect existing
                                          fail                           transactions




Thursday, November 3, 11
Accessing
                           Infinispan caches

Thursday, November 3, 11
Embedded Access




Thursday, November 3, 11
Infinispan is not
                             just a cache!

Thursday, November 3, 11
In-memory data grid

                           It’s a Fast, Available,
                           Distributed, Elastic data store,
                           not just a cache!


Thursday, November 3, 11
Invalidation won’t
                           work for data grids!

Thursday, November 3, 11
Data distribution




Thursday, November 3, 11
Replication




Thursday, November 3, 11
Distribution
                           • With number of copies = 2




Thursday, November 3, 11
How is data
                           distributed??

Thursday, November 3, 11
Consistent Hashing




Thursday, November 3, 11
Solving unequal
                             distribution

Thursday, November 3, 11
Virtual Nodes




Thursday, November 3, 11
Accessing
                           Infinispan data grid

Thursday, November 3, 11
Remote Access

                                   • Via protocols :
                                    • REST
                                    • Hot Rod




Thursday, November 3, 11
Hot Rod clients




Thursday, November 3, 11
Infinispan as
                           cloud data store

Thursday, November 3, 11
Traditional 3-tier App




Thursday, November 3, 11
Typical IaaS App




Thursday, November 3, 11
Traditional PaaS App




Thursday, November 3, 11
Where’s your data
                              stored??

Thursday, November 3, 11
Clouds are
                           ephemeral!!

Thursday, November 3, 11
State




Thursday, November 3, 11
Virtualizing Data

                           Some public services exist
                           (i.e. Amazon RDS), but not all
                           cloud deployments are public!


Thursday, November 3, 11
Build your own
                           Data-as-a-Service!

Thursday, November 3, 11
Characteristics of DaaS


                           Elastic, scalable and highly
                           available!


Thursday, November 3, 11
DaaS with
                           Infinispan

Thursday, November 3, 11
Architecture




                                          Manage and Monitor
Thursday, November 3, 11
Who uses
                           Infinispan?

Thursday, November 3, 11
As a cache...


                           Hibernate 2nd level cache,
                           Torquebox Rails cache...


Thursday, November 3, 11
As a temporary store...


                           Http session cache & EJB
                           SFSB cache, in JBoss AS7


Thursday, November 3, 11
As data grid...


                           Real-time trading app of a well
                           known stock exchange


Thursday, November 3, 11
What’s next?


Thursday, November 3, 11
Towards EDG

                           Solidifying Infinispan towards
                           integration with Red Hat’s
                           Enterprise Data Grid


Thursday, November 3, 11
Plus more data grid...

                           Enhancing Hot Rod protocol,
                           Hibernate Object/Grid Mapper
                           ...etc


Thursday, November 3, 11
Summary

                           Infinispan as fast powerful
                           local cache that can be
                           clustered!


Thursday, November 3, 11
Summary

                           But also a F.A.D.E. data grid,
                           accessible in embedded or
                           remote fashion


Thursday, November 3, 11
Summary

                           Build your own Infinispan
                           based Data-as-a-Service in
                           your private cloud!


Thursday, November 3, 11
Questions
                           infinispan.org - @infinispan

                           speakerrate.com/galder

                           More on data grids at 5pm!

Thursday, November 3, 11

Contenu connexe

En vedette

In memory grids IMDG
In memory grids IMDGIn memory grids IMDG
In memory grids IMDG
Prateek Jain
 
Multi modularized project setup with gulp, typescript and angular.js
Multi modularized project setup with gulp, typescript and angular.jsMulti modularized project setup with gulp, typescript and angular.js
Multi modularized project setup with gulp, typescript and angular.js
David Amend
 
Tales From the Field: The Wrong Way of Using Cassandra (Carlos Rolo, Pythian)...
Tales From the Field: The Wrong Way of Using Cassandra (Carlos Rolo, Pythian)...Tales From the Field: The Wrong Way of Using Cassandra (Carlos Rolo, Pythian)...
Tales From the Field: The Wrong Way of Using Cassandra (Carlos Rolo, Pythian)...
DataStax
 
Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347
Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347
Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347
Manik Surtani
 

En vedette (20)

In Memory Data Grids, Demystified!
In Memory Data Grids, Demystified! In Memory Data Grids, Demystified!
In Memory Data Grids, Demystified!
 
In memory grids IMDG
In memory grids IMDGIn memory grids IMDG
In memory grids IMDG
 
Apache ignite Datagrid
Apache ignite DatagridApache ignite Datagrid
Apache ignite Datagrid
 
Multi modularized project setup with gulp, typescript and angular.js
Multi modularized project setup with gulp, typescript and angular.jsMulti modularized project setup with gulp, typescript and angular.js
Multi modularized project setup with gulp, typescript and angular.js
 
Cassandra on Castle
Cassandra on CastleCassandra on Castle
Cassandra on Castle
 
Infinispan – the open source data grid platform by Mircea Markus
Infinispan – the open source data grid platform by Mircea MarkusInfinispan – the open source data grid platform by Mircea Markus
Infinispan – the open source data grid platform by Mircea Markus
 
Infinispan,Lucene,Hibername OGM
Infinispan,Lucene,Hibername OGMInfinispan,Lucene,Hibername OGM
Infinispan,Lucene,Hibername OGM
 
What's New in Infinispan 6.0
What's New in Infinispan 6.0What's New in Infinispan 6.0
What's New in Infinispan 6.0
 
Tales From the Field: The Wrong Way of Using Cassandra (Carlos Rolo, Pythian)...
Tales From the Field: The Wrong Way of Using Cassandra (Carlos Rolo, Pythian)...Tales From the Field: The Wrong Way of Using Cassandra (Carlos Rolo, Pythian)...
Tales From the Field: The Wrong Way of Using Cassandra (Carlos Rolo, Pythian)...
 
Infinispan
InfinispanInfinispan
Infinispan
 
Infinispan Data Grid Platform
Infinispan Data Grid PlatformInfinispan Data Grid Platform
Infinispan Data Grid Platform
 
London JBUG April 2015 - Performance Tuning Apps with WildFly Application Server
London JBUG April 2015 - Performance Tuning Apps with WildFly Application ServerLondon JBUG April 2015 - Performance Tuning Apps with WildFly Application Server
London JBUG April 2015 - Performance Tuning Apps with WildFly Application Server
 
Apache conbigdata2015 christiantzolov-federated sql on hadoop and beyond- lev...
Apache conbigdata2015 christiantzolov-federated sql on hadoop and beyond- lev...Apache conbigdata2015 christiantzolov-federated sql on hadoop and beyond- lev...
Apache conbigdata2015 christiantzolov-federated sql on hadoop and beyond- lev...
 
Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347
Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347
Infinispan, Data Grids, NoSQL, Cloud Storage and JSR 347
 
JBoss Community Introduction
JBoss Community IntroductionJBoss Community Introduction
JBoss Community Introduction
 
Building Wall St Risk Systems with Apache Geode
Building Wall St Risk Systems with Apache GeodeBuilding Wall St Risk Systems with Apache Geode
Building Wall St Risk Systems with Apache Geode
 
Архитектура Apache Ignite .NET
Архитектура Apache Ignite .NETАрхитектура Apache Ignite .NET
Архитектура Apache Ignite .NET
 
Infinispan Servers: Beyond peer-to-peer data grids
Infinispan Servers: Beyond peer-to-peer data gridsInfinispan Servers: Beyond peer-to-peer data grids
Infinispan Servers: Beyond peer-to-peer data grids
 
Apache Geode - The First Six Months
Apache Geode -  The First Six MonthsApache Geode -  The First Six Months
Apache Geode - The First Six Months
 
Infinispan from POC to Production
Infinispan from POC to ProductionInfinispan from POC to Production
Infinispan from POC to Production
 

Similaire à Data Grids and Data Caching

Riak Use Cases : Dissecting The Solutions To Hard Problems
Riak Use Cases : Dissecting The Solutions To Hard ProblemsRiak Use Cases : Dissecting The Solutions To Hard Problems
Riak Use Cases : Dissecting The Solutions To Hard Problems
Andy Gross
 

Similaire à Data Grids and Data Caching (8)

soft-shake.ch - Data grids and Data Caching
soft-shake.ch - Data grids and Data Cachingsoft-shake.ch - Data grids and Data Caching
soft-shake.ch - Data grids and Data Caching
 
A PHP Christmas Miracle - 3 Frameworks, 1 app
A PHP Christmas Miracle - 3 Frameworks, 1 appA PHP Christmas Miracle - 3 Frameworks, 1 app
A PHP Christmas Miracle - 3 Frameworks, 1 app
 
Silverchair Strategies
Silverchair StrategiesSilverchair Strategies
Silverchair Strategies
 
Fast & Furious: Speed in the Opera browser
Fast & Furious: Speed in the Opera browserFast & Furious: Speed in the Opera browser
Fast & Furious: Speed in the Opera browser
 
Apple Preso Ohio
 Apple Preso Ohio  Apple Preso Ohio
Apple Preso Ohio
 
Zookeeper at the bigdata roundtable
Zookeeper at the bigdata roundtableZookeeper at the bigdata roundtable
Zookeeper at the bigdata roundtable
 
No More Mobile Marketing Gimmicks
No More Mobile Marketing GimmicksNo More Mobile Marketing Gimmicks
No More Mobile Marketing Gimmicks
 
Riak Use Cases : Dissecting The Solutions To Hard Problems
Riak Use Cases : Dissecting The Solutions To Hard ProblemsRiak Use Cases : Dissecting The Solutions To Hard Problems
Riak Use Cases : Dissecting The Solutions To Hard Problems
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Dernier (20)

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 

Data Grids and Data Caching