Contenu connexe Similaire à Extreme Excel: How a 35-Year-Old Desktop App Smashed Through the Big Data Barrier (20) Extreme Excel: How a 35-Year-Old Desktop App Smashed Through the Big Data Barrier1. Extreme Excel
How a 35-Year-Old Desktop App Smashed
Through the Big Data Barrier
Rachel Beddor
Solution Architect
2. © Kyligence Inc. 2021
The Great Unifier!
Easy-to-Use
Widely Available
Why Microsoft Excel?
Fun Fact
3. © Kyligence Inc. 2021
Excel Superhero
Keeping everyone happy and
moving business forward
VS.
Slowing down and crashing Excel
Big Data Villain
4. © Kyligence Inc. 2021
Challenges with Excel and Big Data
Limited Number of
Dimensions
Limited Scalability Slow Response
Time
Difficult to Access
Data
7. © Kyligence Inc. 2021, Confidential.
OLAP Approach – Precomputation
Data Volume
Response
Time
Precomputation
Run-Time Computation
What was the average rating of horror films in April 1998?
9. © Kyligence Inc. 2021
Good at:
Designed for analysis – BI reporting, data discovery etc.
Quickly answering questions like:
What are our top 5 best-selling products in each state/city?
Which products should be put together?
What is our profit for beer in the US this year?
OLAP (Online Analytical Processing)
Not good at:
• Update/delete frequently
• Transactional data
10. © Kyligence Inc. 2021, Confidential.
Timeout – The Cloud
is
• More than just for storage!
• The cloud also enables you to “rent”
computers to do processing with
• Major players (USA): Amazon (AWS),
Microsoft (Azure), Google (Google
Cloud Platform)
Did you know? Amazon’s Cloud business, AWS, made up 52% of
Amazon’s Operating Income last quarter (Q4 2020) - CNBC
11. © Kyligence Inc. 2021, Confidential.
Kyligence Approach – Cluster Computing
• Reduce load by distributing over
several computers
• Improves performance and data
management
An army of computers at your disposal!
13. © Kyligence Inc. 2021
Kyligence = Kylin + Intelligence
Mission: Develop an AI-Assisted
SQL/OLAP Platform for Interactive
Analytics at Unprecedented Scale
• Founded in 2016 by the creators of Apache Kylin
• CRN Top-10 big data startups in 2018
• Global Presence: San Jose, Shanghai, Beijing, Seattle,
New York
• VCs: Fidelity International, Shunwei Capital,
Broadband Capital, Coatue, Redpoint, Cisco
14. © Kyligence Inc. 2021
Kyligence Extreme Analytics
Support All Data Platforms
• Data Warehouse
• Data Lake
• Streaming Data
• Cloud Storage
Intelligent Precomputation
• Multi-dimensional cubes
and table Indexes
• AI-assisted query
optimization
Support All BI Tools
• Excel
• Power BI
• Tableau
• MicroStrategy
Massive Concurrency
• 1,000s+ concurrent queries
• 10s-100s analysts running
multi-threaded programs
15. © Kyligence Inc. 2021
Cloud Native Analytics
Unified Semantic Layer
Low Latency Queries
Any BI Tool
Any Cloud
Any Data Platform
Data
Warehouse
Streaming Data
Data Lake
AI Augmented Engine
Precomputation Layer
Distributed Cubes
& Table Indexes
Multi-dimensional
Modeling
Security &
Governance
Finance
Marketing
Sales
17. © Kyligence Inc. 2021
Kyligence Pivot to Snowflake Architecture
• Leverage MDX for semantic consistency
• Seamless user experience
• Zero client configuration
• Calculate once, consume many
• Supports AWS and Azure
Database Events Files IoT
Unified Semantic Layer
MDX
Engine
Access
Control
Enterprise
Security
Query
Pushdown
18. © Kyligence Inc. 2021, Confidential.
Summary – Cloud Makes Excel Extreme
is
• Cloud: more than just for storage!
• OLAP for Cloud for Extreme Scale and Concurrency
• Kyligence Support for Distributed OLAP
• Kyligence Pivot to Snowflake