The document discusses Intuit's vision to transform customers' lives by unleashing the power of data. It describes Intuit's Analytics Cloud (IAC), which provides a data platform and foundational services to derive value from data. The IAC allows for real-time and batch data ingestion from various sources and provides services like business lookups, unified customer profiles, and personalization. An example use case of using tax data to personalize the tax preparation experience is also mentioned. The document outlines Intuit's journey to building the IAC, including initially lifting existing systems to the cloud and now focusing on real-time streaming capabilities. Key practices for planning, deploying and managing the IAC are also listed.
1. Intuit Confidential and Proprietary 1
Tilmann Bruckhaus
Group Engineering Manager
Intuit Data Engineering and Analytics (IDEA)
Intuit Analytics Cloud 101
2. Intuit Confidential and Proprietary 2
Tilmann Bruckhaus
Group Engineering Manager Intuit
tilmann_bruckhaus@intuit.com
Follow me on twitter: @tillirix
3.
4. Intuit’s big vision for data
Transform the lives of our customers by unleashing the
power of data
Customer
Inspired
5. Era of Windows Era of Web Era of the CloudEra of DOS
Spanning three decades of data
Compliant
data
Mobile First
1980s 1990s 2000s
• Employees: 150
• Customers: 1.3M customers
• Revenue: $33M
• Employees: 4,500
• Customers: 5.6M
• Revenue: $1.04B
• Employees: 7,700
• Customers: 37M
• Revenue: $4.2B
20162010
Regulatory data Transactional data Batch data Real time data Complex, secure data
6. The Intuit Analytics Cloud (IAC)
Data-Driven Users Data-Driven Products
CG SBG Generic
Data products
derive value
from IAC
IntuitAnalyticsCloud
Real Time
Ingest
Batch
Ingest
IAC = Data + Infrastructure + Foundational Services
Business Lookup Unified Profile Personalization A/B Testing …
Real Time Data Layer
Intermediate Data
Source Data
Online
Accountant
8. Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
9. Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
10. Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
11. Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
12. Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
13. Key Practices for Planning, Deploying and Managing
❏ Data security
❏ Data governance
❏ Managed metadata
❏ Committed schemas
❏ Auto Deploy
❏ Monitored Operations
14. The Big Data Lake Journey at Intuit
On Premise
First Generation IAC
Batch BatchCloud
Lift & Shift
15. ˝
The Big Data Lake Journey at Intuit
Real-Time IAC in the Cloud
On Premise
First Generation IAC
Batch BatchCloud
Lift & Shift
Cloud Streaming
16. ˝
The Big Data Lake Journey at Intuit
Real-Time IAC in the Cloud
Cloud Challenges
❏ Service Security
❏ Whitelisting
❏ Restacking
❏ Auto Deploy
❏ Service Monitoring
On Premise
First Generation IAC
Batch BatchCloud
Lift & Shift
Cloud Streaming
17. ˝
The Big Data Lake Journey at Intuit
Real-Time IAC in the Cloud
Cloud Challenges
❏ Service Security
❏ Whitelisting
❏ Restacking
❏ Auto Deploy
❏ Service Monitoring
Streaming Challenges
❏ Stateful processes
❏ Performance
❏ Elastic scaling
❏ Replay
❏ Event ordering
On Premise
First Generation IAC
Batch BatchCloud
Lift & Shift
Cloud Streaming