The document discusses building real-time targeting capabilities at Capital One. It introduces two speakers, Ryan Zotti and Subbu Thiruppathy, and describes challenges around striving for speed in everything. It then covers how to achieve fast model data, training, deployment, and scoring through techniques like using the most up-to-date data, distributed computing in the cloud, automatic model refitting, and response times under 100 milliseconds.
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Building Real Time Targeting Capabilities - Ryan Zotti, Subbu Thiruppathy - Capital One
1. Building Real Time Targeting Capabilities
Capital One | Fast Marketing
July 20, 2016 | H20 Open Tour | NYC
2. Ryan Zotti
Senior Data Engineer
Subbu Thiruppathy
Senior Software Engineer
EXPERTISE
FUN FACT
Big Data, Python, R, Java,
Machine Learning, AWS
FUN FACT
Big Data, Java, AKKA
Play, AWS
Built a self driving
remote controlled car
Recipient of Capital One’s
most prestigious honor
EXPERTISE
9. Most current, up-to-date data
Available as soon as it’s ready
Low latency at scale
FAST MODEL DATA
10. Most current, up-to-date data
Available as soon as it’s ready
Low latency at scale
FAST MODEL DATA
11. Most current, up-to-date data
Available as soon as it’s ready
Low latency at scale
FAST MODEL DATA
12. Most current, up-to-date data
Available as soon as it’s ready
Low latency at scale
FAST MODEL DATA
13. Distributed computing to crunch data fast
Elastic scaling with the public cloud
Speed from parallelism
FAST MODEL TRAINING
14. Distributed computing to crunch data fast
Elastic scaling with the public cloud
Speed from parallelism
FAST MODEL TRAINING
15. Distributed computing to crunch data fast
Elastic scaling with the public cloud
Speed from parallelism
FAST MODEL TRAINING
16. Distributed computing to crunch data fast
Elastic scaling with the public cloud
Speed from parallelism
FAST MODEL TRAINING
17. Model adapts to evolving customer landscape
Automatically refit the model and daily deploy
Seamlessly integrate with existing Java tech stack
FAST MODEL DEPLOYMENT
18. Model adapts to evolving customer landscape
Automatically refit the model and daily deploy
Seamlessly integrate with existing Java tech stack
FAST MODEL DEPLOYMENT
19. Model adapts to evolving customer landscape
Automatically refit the model and daily deploy
Seamlessly integrate with existing Java tech stack
FAST MODEL DEPLOYMENT
20. Model adapts to evolving customer landscape
Automatically refit the model and daily deploy
Seamlessly integrate with existing Java tech stack
FAST MODEL DEPLOYMENT
21. Response < 100 milliseconds
JVM-based model (i.e. POJO)
Predictive power vs. runtime complexity (speed)
Gradient boosting provided the best balance
FAST MODEL SCORING
22. Response < 100 milliseconds
JVM-based model (i.e. POJO)
Predictive power vs. runtime complexity (speed)
Gradient boosting provided the best balance
FAST MODEL SCORING
23. Response < 100 milliseconds
JVM-based model (i.e. POJO)
Predictive power vs. runtime complexity (speed)
Gradient boosting provided the best balance
FAST MODEL SCORING
24. Response < 100 milliseconds
JVM-based model (i.e. POJO)
Predictive power vs. runtime complexity (speed)
Gradient boosting provided the best balance
FAST MODEL SCORING
25. Response < 100 milliseconds
JVM-based model (i.e. POJO)
Predictive power vs. runtime complexity (speed)
Gradient boosting provided the best balance
FAST MODEL SCORING
27. Explore new technologies continuously
Ability to switch new models “on-the-fly”
Make the API faster
Incorporate new data sources
Resiliency, failover capabilities
Websites have evolved over time. And so has our website, check out what it looks like today!
SUBBU
Capital One’s Credit Card Homepage has changed over time, so have our data and modeling needs
SUBBU
How can we make the card home page experience better
Today everyone sees the same experience
Future experience needs to be fast and targeted
How fast is fast data?
RYAN
Tesla travels 0-60 MPH in 3.2 seconds
RYAN
A blink of an eye takes 300-400 milliseconds
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
Solution: Sparking Water
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
RYAN
SUBBU
WHERE ARE WE GOING NEXT?
SUBBU
Lessons Learned
SUBBU
Simple: network hops?
Tech changes:
Cloud: consumers are on cloud (faster vs on-prem), developer empowerment, on demand servers
Small teams: