The document discusses caching strategies at Netflix and Pivotal Cloud Cache (PCC). It notes that Netflix relies heavily on caches to provide a low latency data layer for its stateless services. PCC is Pivotal's distributed in-memory cache optimized for Pivotal Cloud Foundry apps that provides high availability, scalability, and fault tolerance. The document outlines PCC's topology and components, discusses caching design patterns like look-aside caching, and provides an example of live coding with PCC.

1. Scalable Smart Caching for Spring
Developers
By Nikhil Chandrappa and Pulkit Chandra
Pivotal

2. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Internet Scale Caching @ Netflix
“The Netflix customer experience relies
heavily on caches to provide a
high-volume, low latency, globally
available data layer that backs our
stateless services.
Throughout a typical customer
experience, from sitting down on the
couch through playing a movie, caches
play a role in every interaction.”
#CachesEverywhere

3. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Internet Scale Caching @ Netflix

4. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Internet Scale Caching @ Netflix

5. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Pivotal Cloud Cache (PCC)
● Distributed In-Memory cache optimized for PCF Apps
● Automated Provisioning and Management
● High Availability and Linear Scalability
● Fault Tolerant, No Single Point of Failure
● Disk based Persistence
● WAN replication between PCF Foundations
● PCF-AZ aware!

6. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Caching Design Patterns
Look-Aside Cache

7. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Design Pattern: In-line Caching
7
Fast KV Store front-ending RDBMS
1000s of
transactions per
second
100s of
transactions per
second

8. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Developer Essentials

9. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
PCC Topology
12
Cache
Server
Cache
Server
Cache
Server
Locator
1 2 33 1
Locator
PCC
Client
Connection Pool
54.209.251.110 54.209.251.111 54.209.251.112
Locator
Cache
Server
2
54.209.251.113
● Cluster Spanning Multi PCF
AZs
● PCC Native Redundancy
prevents data loss
● BOSH resurrects the lost
VM
PCF
AZ 1
PCF
AZ 2

10. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
PCC Members
Cache Server
● In-Memory Storage for Data Regions
Cache
Server
Cache
Server
Cache
Server
Locator
Locator
● Cluster Discovery & Config
● Load Balancing for Servers
Cache
Server
Cache
Server
Cache
Server
Locator

11. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Regions
1
1
● Synonymous to a Table in
NoSQL terminology
● Stores Data in <Key,Value>
pairs with unique Keys
● Divided into buckets across
Cache Members

12. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Regions
1
2
Replicated Partitioned
GEM
Server
GEM
Server
GEM
Server
GEM
Server
GEM
Server
GEM
Server
HASH

13. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Cluster Scaling Out
1
3
cf update-service pcc-dev-cluster -c '{"num_servers": 6}'

14. Unless otherwise indicated, these slides are © 2013-2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license:
http://creativecommons.org/licenses/by-nc/3.0/
Live Coding:
PCC Look-Aside Caching

15. > Stay Connected.
#springone@s1p