SlideShare une entreprise Scribd logo
1  sur  32
Télécharger pour lire hors ligne
Welcome
Delivering rapid-fire analytics with
Snowflake and Tableau
# d a t a 1 9
Harald Erb
Sales Engineer, Central Europe
Agenda
What is Snowflake?
Demo #1: Fresh Data for Tableau via Snowpipe
Demo #2: Monitor Account Utilization in Snowflake
Take away & Call to Action
What is Snowflake?
© 2019 Snowflake Computing Inc. All Rights Reserved
THE SNOWFLAKE TIMELINE
SQL Data Warehouse built for the cloud
6
Founded 2012
by industry
veterans
Over 2,200
active customers
Raised over $950M in
venture funding from
leading investors
First customers 2014,
general availability 2015
Gartner and
Forrester “Leader”
Queries processed in Snowflake per day:
# rows in largest single table:
Largest number of tables single DB:
Single customer most data:
Single customer most users:
> 60.000.000
68.000.000.000.000
200,000
> 40 PB
> 10,000
Benoit
Dageville
Thierry
Cruanes
© 2019 Snowflake Computing Inc. All Rights Reserved
KNOWN CHALLENGES…
7
Complexity
Manage both
infrastructure
and data
Limited
Scalability
Can’t support all
data, users and
workloads
Diversity
Unable to
consolidate
siloed datasets
Inadequate
Elasticity
Stuck with rigid,
inflexible
architectures
Rigid Cost
Forced to
keep the lights on
24/7
© 2019 Snowflake Computing Inc. All Rights Reserved
NEW ARCHITECTURE FOR DATA WAREHOUSING
Multi-Cluster, Shared Data, in the Cloud
8
Traditional Architectures Snowflake
Cluster of nodes with a
single shared disk.
Limited by disk size and
I/O throughput
(Traditional DW’s based
on RDBMS)
Shared-Disk (SMP)
Cluster of nodes each of which has its
own disk – data distributed across the
nodes. Not elastic because data must
be redistributed when resize the
cluster (Most MPP DW‘s, Hadoop)
Shared-Nothing (MPP) Multi-Cluster, Shared Data
Multiple clusters, shared data. Compute
power and storage scale independently
of each other
© 2019 Snowflake Computing Inc. All Rights Reserved
MULTI CLUSTER, SHARED DATA ARCHITECTURE
Cloud Storage Layer
Instant, automatic Scalability & Elasticity
Compute Layer
• Multiple Warehouses without
resource contention
• Resize Warehouse instantly
(scale up/down)
• Warehouse scales out
automatically and elastically
Centralized Storage
© 2019 Snowflake Computing Inc. All Rights Reserved
REAL-WORLD USE CASE
10
Continuous
Loading (4TB/day)
S3
<5min SLA
Virtual
Warehouse
Medium
ETL &
Maintenance
Virtual Warehouse
Large
Virtual
Warehouse
2X-Large
Reporting
(Segmented)
Interactive
Dashboard
50% < 1s
85% < 2s
95% < 5s
Virtual Warehouse
Auto Scale – X-Large x 5
3+ PB of raw data
1,5 PB data stored in Database (8x compression ratio)
25M micro partitions
Prod DB
© 2019 Snowflake Computing Inc. All Rights Reserved
Concurrency Simplicity
Fully managed with a
pay-as-you-go model.
Works on any data
Multiple groups access
data simultaneously
with no performance degradation
Multi petabyte-scale, up to 200x
faster performance
and 1/10th the cost
200x
Performance
THE SNOWFLAKE DIFFERENCE
© 2019 Snowflake Computing Inc. All Rights Reserved
NEW FEATURES RELEASED
Sources:
snowflake.com/about/press-and-news
data.solita.fi/a-curated-list-of-new-snowflake-features-released-at-snowflake-summit-2019
> Snowflake Data Pipelines
• Auto-Ingest
• Streams and Tasks
• Snowflake Connector for Kafka
> Core Data Warehouse
• New web-based SQL Editor through acquisition
of tech company Numeracy
• Materialized Views
• JavaScript Store Procedures, hierarchical SQL
• External Tables, Hive Metastore integration,
Credential-less external stages
> Multi-cloud strategy
• Snowflake on Google Cloud is set to launch in
preview in Fall 2019
• Snowflake announced Database Replication
and Database Failover. If a disaster occurs in
one region or on one cloud service, businesses
can immediately access and control Snowflake
data they have replicated in a different region or
cloud service.
> Secure Data Sharing
• Snowflake Data Exchange
Demo #1: Fresh Data for
Tableau via Snowpipe
DEMO SCENARIODEMO SCENARIO
DATA SCHEMA
Snowflake Web UI – SQL Editor
3rd Party SQL Editor (DBeaver)
3 ys historical data
~184.000.000 rows
DATA ARCHITECTURE
Data Sources
Extract, Load &
Transform Tools
(ELT)
Extract,
Transform &
Load Tools
(ETL)
Database
Migration
Services
Snowflake
DW
Data Flow Tools
Tables, CSV, JSON, XML, Avro, Parquet
Virtual
Warehouses
Corporate
Applications
Databases
Cloud
Services
Web
Devices
Azure Blob
Amazon S3
Snowpipe
Data Lake feeds
Data Feed Options with Snowflake
• Snowpipe processed 'Messages' or files;
structured or semi-structured
• Snowpipe designed for continuous ingest –
typically < 1 min latency
• Potential downstream ELT e.g. hourly
• Time-travel can provide static vs dynamic views
• (Future – Downstream pipe processing, Direct
streaming connectivity)
Data Lake
Live Query
creativecommons.tankerkoenig.de
LAST DATA LOAD = JUNE 7
LOADING ADDITIONAL FILES INTO AWS S3
USING AWS NOTIFICATIONS FOR SNOWPIPE
CREATING A SNOWPIPE TO LOAD DATA FROM S3
NEW DATA AUTOMATICALLY LOADED FROM S3
FRESH DATA READY FOR TABLEAU!
Demo #2: Monitor Account
Utilization in Snowflake
PAY FOR WHAT YOU USE…DOWN TO THE SEC.
ETL and
Processing
Morning Noon Night
WorkloadReporting
Ad-hoc
Analytics
Morning Noon Night
Workload
Morning Noon Night
Workload
Data Scientist
Morning Noon Night
Workload
Snowflake Web UI – Account Billing & Usage
Scott Smith‘s Blog incl. Download of Sample Workbook: tableau.com/about/blog/2019/5/monitor-understand-snowflake-account-usage
CONNECT TO SNOWFLAKE DIRECTLY
AND ANALYZE/FORECAST ACCOUNT UTILIZATION
Take away &
Call to Action
LEARN MORE: BEST PRACTICES
E-Paper Download: resources.snowflake.com/ebooks/best-practices-for-using-tableau-with-snowflake
E-Book Content:
• Creating efficient Tableau workbooks
• Connecting to Snowflake
• Working with semi-structured data
• Working with Snowflake Time Travel
• Working with Snowflake Data
Sharing
• Implementing role-based security
• Using custom aggregations
• Scaling Snowflake warehouses
• Caching
• Other performance considerations
• Measuring performance
TRY: TABLEAU & SNOWFLAKE QUICK START
This Quick Start deploys Tableau
Server in the Amazon Web
Services (AWS) Cloud and
configures it to work with
Snowflake in about 30 minutes.
More information: aws.amazon.com/quickstart/architecture/tableau-snowflake/
SESSION TAKE AWAY
What you don’t have to worry when working with the Snowflake
Cloud Data Warehouse
Installing, provisioning and maintaining
hardware and software:
• Snowflake is a cloud-built DW as a service.
• Just create an account and load some data.
• You can then just connect from Tableau and start
querying.
Working out the capacity of your DW:
• Snowflake is a fully elastic platform, so it can scale
to handle all of your data and all of your users.
• Just size your compute (virtual warehouses) up
and down on the fly to handle peaks and lulls in
your data usage.
• Turn your warehouses completely off to save
money when not used
Learning new tools and a new query language:
• Snowflake is a fully ANSI SQL-compliant DW à all skills
and tools, such as Tableau, will easily connect
• Snowflake provides connectors for ODBC, JDBC, Python,
Spark and Node.js
• Even semi-structured data can be accessed via SQL
Optimizing and maintaining your data:
• Snowflake is a highly-scalable, columnar data platform
allowing users to run analytic queries quickly and easily.
• It is not required to index or distribute data across
partitions, it is all transparently managed by the platform.
• Snowflake also provides inherent data protection
capabilities, there is no need to worry about snapshots,
backups or other administrative tasks.
Please complete the
session survey from
the My Evaluations
menu in your
Tableau Conference
Europe 2019 app
Thank you!
harald.erb@snowflake.com
Delivering rapid-fire Analytics with Snowflake and Tableau

Contenu connexe

Tendances

Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...
Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...
Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...
HostedbyConfluent
 

Tendances (20)

Data Lake: A simple introduction
Data Lake: A simple introductionData Lake: A simple introduction
Data Lake: A simple introduction
 
Snowflake Datawarehouse Architecturing
Snowflake Datawarehouse ArchitecturingSnowflake Datawarehouse Architecturing
Snowflake Datawarehouse Architecturing
 
Technical Deck Delta Live Tables.pdf
Technical Deck Delta Live Tables.pdfTechnical Deck Delta Live Tables.pdf
Technical Deck Delta Live Tables.pdf
 
Demystifying Data Warehouse as a Service
Demystifying Data Warehouse as a ServiceDemystifying Data Warehouse as a Service
Demystifying Data Warehouse as a Service
 
Snowflake Architecture.pptx
Snowflake Architecture.pptxSnowflake Architecture.pptx
Snowflake Architecture.pptx
 
Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)
 
Demystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFWDemystifying Data Warehousing as a Service - DFW
Demystifying Data Warehousing as a Service - DFW
 
Introduction to Data Engineering
Introduction to Data EngineeringIntroduction to Data Engineering
Introduction to Data Engineering
 
Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...
Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...
Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...
 
adb.pdf
adb.pdfadb.pdf
adb.pdf
 
A 30 day plan to start ending your data struggle with Snowflake
A 30 day plan to start ending your data struggle with SnowflakeA 30 day plan to start ending your data struggle with Snowflake
A 30 day plan to start ending your data struggle with Snowflake
 
Let’s get to know Snowflake
Let’s get to know SnowflakeLet’s get to know Snowflake
Let’s get to know Snowflake
 
20100430 introduction to business objects data services
20100430 introduction to business objects data services20100430 introduction to business objects data services
20100430 introduction to business objects data services
 
Lakehouse in Azure
Lakehouse in AzureLakehouse in Azure
Lakehouse in Azure
 
AWS Partner Data Analytics on AWS_Handout.pdf
AWS Partner Data Analytics on AWS_Handout.pdfAWS Partner Data Analytics on AWS_Handout.pdf
AWS Partner Data Analytics on AWS_Handout.pdf
 
Demystifying data engineering
Demystifying data engineeringDemystifying data engineering
Demystifying data engineering
 
Elastic Data Warehousing
Elastic Data WarehousingElastic Data Warehousing
Elastic Data Warehousing
 
The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need BothThe Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
 
Data Architecture, Solution Architecture, Platform Architecture — What’s the ...
Data Architecture, Solution Architecture, Platform Architecture — What’s the ...Data Architecture, Solution Architecture, Platform Architecture — What’s the ...
Data Architecture, Solution Architecture, Platform Architecture — What’s the ...
 
5 Steps for Architecting a Data Lake
5 Steps for Architecting a Data Lake5 Steps for Architecting a Data Lake
5 Steps for Architecting a Data Lake
 

Similaire à Delivering rapid-fire Analytics with Snowflake and Tableau

Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
StampedeCon
 

Similaire à Delivering rapid-fire Analytics with Snowflake and Tableau (20)

Laboratorio práctico: Data warehouse en la nube
Laboratorio práctico: Data warehouse en la nubeLaboratorio práctico: Data warehouse en la nube
Laboratorio práctico: Data warehouse en la nube
 
Best-Practices-for-Using-Tableau-With-Snowflake.pdf
Best-Practices-for-Using-Tableau-With-Snowflake.pdfBest-Practices-for-Using-Tableau-With-Snowflake.pdf
Best-Practices-for-Using-Tableau-With-Snowflake.pdf
 
Demystifying Data Warehouse as a Service (DWaaS)
Demystifying Data Warehouse as a Service (DWaaS)Demystifying Data Warehouse as a Service (DWaaS)
Demystifying Data Warehouse as a Service (DWaaS)
 
How the Development Bank of Singapore solves on-prem compute capacity challen...
How the Development Bank of Singapore solves on-prem compute capacity challen...How the Development Bank of Singapore solves on-prem compute capacity challen...
How the Development Bank of Singapore solves on-prem compute capacity challen...
 
ME_Snowflake_Introduction_for new students.pptx
ME_Snowflake_Introduction_for new students.pptxME_Snowflake_Introduction_for new students.pptx
ME_Snowflake_Introduction_for new students.pptx
 
From Data Warehouse to Lakehouse
From Data Warehouse to LakehouseFrom Data Warehouse to Lakehouse
From Data Warehouse to Lakehouse
 
Enabling big data & AI workloads on the object store at DBS
Enabling big data & AI workloads on the object store at DBS Enabling big data & AI workloads on the object store at DBS
Enabling big data & AI workloads on the object store at DBS
 
Amazon Elastic Map Reduce - Ian Meyers
Amazon Elastic Map Reduce - Ian MeyersAmazon Elastic Map Reduce - Ian Meyers
Amazon Elastic Map Reduce - Ian Meyers
 
NEW LAUNCH! Introducing AWS Snowball Edge and AWS Snowmobile
NEW LAUNCH! Introducing AWS Snowball Edge and AWS SnowmobileNEW LAUNCH! Introducing AWS Snowball Edge and AWS Snowmobile
NEW LAUNCH! Introducing AWS Snowball Edge and AWS Snowmobile
 
Azure Stream Analytics
Azure Stream AnalyticsAzure Stream Analytics
Azure Stream Analytics
 
Delivering Data Democratization in the Cloud with Snowflake
Delivering Data Democratization in the Cloud with SnowflakeDelivering Data Democratization in the Cloud with Snowflake
Delivering Data Democratization in the Cloud with Snowflake
 
DM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled ArchitectureDM Radio Webinar: Adopting a Streaming-Enabled Architecture
DM Radio Webinar: Adopting a Streaming-Enabled Architecture
 
Couchbase and Apache Spark
Couchbase and Apache SparkCouchbase and Apache Spark
Couchbase and Apache Spark
 
Gcp dataflow
Gcp dataflowGcp dataflow
Gcp dataflow
 
IBM Cloud Day January 2021 - A well architected data lake
IBM Cloud Day January 2021 - A well architected data lakeIBM Cloud Day January 2021 - A well architected data lake
IBM Cloud Day January 2021 - A well architected data lake
 
ADV Slides: Platforming Your Data for Success – Databases, Hadoop, Managed Ha...
ADV Slides: Platforming Your Data for Success – Databases, Hadoop, Managed Ha...ADV Slides: Platforming Your Data for Success – Databases, Hadoop, Managed Ha...
ADV Slides: Platforming Your Data for Success – Databases, Hadoop, Managed Ha...
 
Cloud-native Semantic Layer on Data Lake
Cloud-native Semantic Layer on Data LakeCloud-native Semantic Layer on Data Lake
Cloud-native Semantic Layer on Data Lake
 
Snowflake for Data Engineering
Snowflake for Data EngineeringSnowflake for Data Engineering
Snowflake for Data Engineering
 
Introducing Azure SQL Data Warehouse
Introducing Azure SQL Data WarehouseIntroducing Azure SQL Data Warehouse
Introducing Azure SQL Data Warehouse
 
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
 

Plus de Harald Erb

Plus de Harald Erb (11)

Dataiku & Snowflake Meetup Berlin 2020
Dataiku & Snowflake Meetup Berlin 2020Dataiku & Snowflake Meetup Berlin 2020
Dataiku & Snowflake Meetup Berlin 2020
 
Does it only have to be ML + AI?
Does it only have to be ML + AI?Does it only have to be ML + AI?
Does it only have to be ML + AI?
 
Machine Learning - Eine Challenge für Architekten
Machine Learning - Eine Challenge für ArchitektenMachine Learning - Eine Challenge für Architekten
Machine Learning - Eine Challenge für Architekten
 
DOAG Big Data Days 2017 - Cloud Journey
DOAG Big Data Days 2017 - Cloud JourneyDOAG Big Data Days 2017 - Cloud Journey
DOAG Big Data Days 2017 - Cloud Journey
 
Do you know what k-Means? Cluster-Analysen
Do you know what k-Means? Cluster-Analysen Do you know what k-Means? Cluster-Analysen
Do you know what k-Means? Cluster-Analysen
 
Exploratory Analysis in the Data Lab - Team-Sport or for Nerds only?
Exploratory Analysis in the Data Lab - Team-Sport or for Nerds only?Exploratory Analysis in the Data Lab - Team-Sport or for Nerds only?
Exploratory Analysis in the Data Lab - Team-Sport or for Nerds only?
 
Big Data Discovery + Analytics = Datengetriebene Innovation!
Big Data Discovery + Analytics = Datengetriebene Innovation!Big Data Discovery + Analytics = Datengetriebene Innovation!
Big Data Discovery + Analytics = Datengetriebene Innovation!
 
Big Data Discovery
Big Data DiscoveryBig Data Discovery
Big Data Discovery
 
DOAG News 2012 - Analytische Mehrwerte mit Big Data
DOAG News 2012 - Analytische Mehrwerte mit Big DataDOAG News 2012 - Analytische Mehrwerte mit Big Data
DOAG News 2012 - Analytische Mehrwerte mit Big Data
 
Oracle Unified Information Architeture + Analytics by Example
Oracle Unified Information Architeture + Analytics by ExampleOracle Unified Information Architeture + Analytics by Example
Oracle Unified Information Architeture + Analytics by Example
 
Endeca Web Acquisition Toolkit - Integration verteilter Web-Anwendungen und a...
Endeca Web Acquisition Toolkit - Integration verteilter Web-Anwendungen und a...Endeca Web Acquisition Toolkit - Integration verteilter Web-Anwendungen und a...
Endeca Web Acquisition Toolkit - Integration verteilter Web-Anwendungen und a...
 

Dernier

Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
amitlee9823
 
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
amitlee9823
 
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
amitlee9823
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
AroojKhan71
 
Probability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsProbability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter Lessons
JoseMangaJr1
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
amitlee9823
 
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 

Dernier (20)

Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfAccredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
 
Predicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science ProjectPredicting Loan Approval: A Data Science Project
Predicting Loan Approval: A Data Science Project
 
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men  🔝Bangalore🔝   Esc...
➥🔝 7737669865 🔝▻ Bangalore Call-girls in Women Seeking Men 🔝Bangalore🔝 Esc...
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
Vip Mumbai Call Girls Marol Naka Call On 9920725232 With Body to body massage...
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Probability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsProbability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter Lessons
 
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceBDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Bommasandra Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 

Delivering rapid-fire Analytics with Snowflake and Tableau

  • 1.
  • 3. Delivering rapid-fire analytics with Snowflake and Tableau # d a t a 1 9 Harald Erb Sales Engineer, Central Europe
  • 4. Agenda What is Snowflake? Demo #1: Fresh Data for Tableau via Snowpipe Demo #2: Monitor Account Utilization in Snowflake Take away & Call to Action
  • 6. © 2019 Snowflake Computing Inc. All Rights Reserved THE SNOWFLAKE TIMELINE SQL Data Warehouse built for the cloud 6 Founded 2012 by industry veterans Over 2,200 active customers Raised over $950M in venture funding from leading investors First customers 2014, general availability 2015 Gartner and Forrester “Leader” Queries processed in Snowflake per day: # rows in largest single table: Largest number of tables single DB: Single customer most data: Single customer most users: > 60.000.000 68.000.000.000.000 200,000 > 40 PB > 10,000 Benoit Dageville Thierry Cruanes
  • 7. © 2019 Snowflake Computing Inc. All Rights Reserved KNOWN CHALLENGES… 7 Complexity Manage both infrastructure and data Limited Scalability Can’t support all data, users and workloads Diversity Unable to consolidate siloed datasets Inadequate Elasticity Stuck with rigid, inflexible architectures Rigid Cost Forced to keep the lights on 24/7
  • 8. © 2019 Snowflake Computing Inc. All Rights Reserved NEW ARCHITECTURE FOR DATA WAREHOUSING Multi-Cluster, Shared Data, in the Cloud 8 Traditional Architectures Snowflake Cluster of nodes with a single shared disk. Limited by disk size and I/O throughput (Traditional DW’s based on RDBMS) Shared-Disk (SMP) Cluster of nodes each of which has its own disk – data distributed across the nodes. Not elastic because data must be redistributed when resize the cluster (Most MPP DW‘s, Hadoop) Shared-Nothing (MPP) Multi-Cluster, Shared Data Multiple clusters, shared data. Compute power and storage scale independently of each other
  • 9. © 2019 Snowflake Computing Inc. All Rights Reserved MULTI CLUSTER, SHARED DATA ARCHITECTURE Cloud Storage Layer Instant, automatic Scalability & Elasticity Compute Layer • Multiple Warehouses without resource contention • Resize Warehouse instantly (scale up/down) • Warehouse scales out automatically and elastically Centralized Storage
  • 10. © 2019 Snowflake Computing Inc. All Rights Reserved REAL-WORLD USE CASE 10 Continuous Loading (4TB/day) S3 <5min SLA Virtual Warehouse Medium ETL & Maintenance Virtual Warehouse Large Virtual Warehouse 2X-Large Reporting (Segmented) Interactive Dashboard 50% < 1s 85% < 2s 95% < 5s Virtual Warehouse Auto Scale – X-Large x 5 3+ PB of raw data 1,5 PB data stored in Database (8x compression ratio) 25M micro partitions Prod DB
  • 11. © 2019 Snowflake Computing Inc. All Rights Reserved Concurrency Simplicity Fully managed with a pay-as-you-go model. Works on any data Multiple groups access data simultaneously with no performance degradation Multi petabyte-scale, up to 200x faster performance and 1/10th the cost 200x Performance THE SNOWFLAKE DIFFERENCE
  • 12. © 2019 Snowflake Computing Inc. All Rights Reserved NEW FEATURES RELEASED Sources: snowflake.com/about/press-and-news data.solita.fi/a-curated-list-of-new-snowflake-features-released-at-snowflake-summit-2019 > Snowflake Data Pipelines • Auto-Ingest • Streams and Tasks • Snowflake Connector for Kafka > Core Data Warehouse • New web-based SQL Editor through acquisition of tech company Numeracy • Materialized Views • JavaScript Store Procedures, hierarchical SQL • External Tables, Hive Metastore integration, Credential-less external stages > Multi-cloud strategy • Snowflake on Google Cloud is set to launch in preview in Fall 2019 • Snowflake announced Database Replication and Database Failover. If a disaster occurs in one region or on one cloud service, businesses can immediately access and control Snowflake data they have replicated in a different region or cloud service. > Secure Data Sharing • Snowflake Data Exchange
  • 13. Demo #1: Fresh Data for Tableau via Snowpipe
  • 15. DATA SCHEMA Snowflake Web UI – SQL Editor 3rd Party SQL Editor (DBeaver) 3 ys historical data ~184.000.000 rows
  • 16. DATA ARCHITECTURE Data Sources Extract, Load & Transform Tools (ELT) Extract, Transform & Load Tools (ETL) Database Migration Services Snowflake DW Data Flow Tools Tables, CSV, JSON, XML, Avro, Parquet Virtual Warehouses Corporate Applications Databases Cloud Services Web Devices Azure Blob Amazon S3 Snowpipe Data Lake feeds Data Feed Options with Snowflake • Snowpipe processed 'Messages' or files; structured or semi-structured • Snowpipe designed for continuous ingest – typically < 1 min latency • Potential downstream ELT e.g. hourly • Time-travel can provide static vs dynamic views • (Future – Downstream pipe processing, Direct streaming connectivity) Data Lake Live Query creativecommons.tankerkoenig.de
  • 17. LAST DATA LOAD = JUNE 7
  • 19. USING AWS NOTIFICATIONS FOR SNOWPIPE
  • 20. CREATING A SNOWPIPE TO LOAD DATA FROM S3
  • 21. NEW DATA AUTOMATICALLY LOADED FROM S3
  • 22. FRESH DATA READY FOR TABLEAU!
  • 23. Demo #2: Monitor Account Utilization in Snowflake
  • 24. PAY FOR WHAT YOU USE…DOWN TO THE SEC. ETL and Processing Morning Noon Night WorkloadReporting Ad-hoc Analytics Morning Noon Night Workload Morning Noon Night Workload Data Scientist Morning Noon Night Workload Snowflake Web UI – Account Billing & Usage
  • 25. Scott Smith‘s Blog incl. Download of Sample Workbook: tableau.com/about/blog/2019/5/monitor-understand-snowflake-account-usage CONNECT TO SNOWFLAKE DIRECTLY AND ANALYZE/FORECAST ACCOUNT UTILIZATION
  • 26. Take away & Call to Action
  • 27. LEARN MORE: BEST PRACTICES E-Paper Download: resources.snowflake.com/ebooks/best-practices-for-using-tableau-with-snowflake E-Book Content: • Creating efficient Tableau workbooks • Connecting to Snowflake • Working with semi-structured data • Working with Snowflake Time Travel • Working with Snowflake Data Sharing • Implementing role-based security • Using custom aggregations • Scaling Snowflake warehouses • Caching • Other performance considerations • Measuring performance
  • 28. TRY: TABLEAU & SNOWFLAKE QUICK START This Quick Start deploys Tableau Server in the Amazon Web Services (AWS) Cloud and configures it to work with Snowflake in about 30 minutes. More information: aws.amazon.com/quickstart/architecture/tableau-snowflake/
  • 29. SESSION TAKE AWAY What you don’t have to worry when working with the Snowflake Cloud Data Warehouse Installing, provisioning and maintaining hardware and software: • Snowflake is a cloud-built DW as a service. • Just create an account and load some data. • You can then just connect from Tableau and start querying. Working out the capacity of your DW: • Snowflake is a fully elastic platform, so it can scale to handle all of your data and all of your users. • Just size your compute (virtual warehouses) up and down on the fly to handle peaks and lulls in your data usage. • Turn your warehouses completely off to save money when not used Learning new tools and a new query language: • Snowflake is a fully ANSI SQL-compliant DW à all skills and tools, such as Tableau, will easily connect • Snowflake provides connectors for ODBC, JDBC, Python, Spark and Node.js • Even semi-structured data can be accessed via SQL Optimizing and maintaining your data: • Snowflake is a highly-scalable, columnar data platform allowing users to run analytic queries quickly and easily. • It is not required to index or distribute data across partitions, it is all transparently managed by the platform. • Snowflake also provides inherent data protection capabilities, there is no need to worry about snapshots, backups or other administrative tasks.
  • 30. Please complete the session survey from the My Evaluations menu in your Tableau Conference Europe 2019 app