The culture trip snowplow implementation

•

0 j'aime•953 vues

idan_by

Données & analyses

Snow Plow meetup
Nir Sivan, Senior Software developer
The Culture trip
11/07/2016

The Culture Trip
• Website/Application which showcases the best culture, food, travel,
and art for every country around the world.
• 3m unique visitor per month ~100% YOY growth, ~30m monthly
events.
• Dealing with mapping the culture world using big data.
• Assembled from a team of previously $360m Check Inc
acquisition by Intuit.

Why we used Snow Plow?
• Data driven – supports A/B testing using lean methodology.
• Owning the data.
• Easy and cheap to maintain.
• Scalable
• Great documentation and support!

Our stack over AWS
CDN
Collector
Clojure
Collector
Web/Mobile
Client
SendGrid Email
Webhook
CDN
Collector
Amazon
S3
Snow
Plow EMR
Amazon
S3
Storage
Loader
Trackers Collectors Process Events Load Data into RedShift

Some of our testing results
• Email conversions up 137%.
• Application download conversions up 220%.
• Web site article FB shares up 165%.
• MVP testing of future releases.

Analyzing the data
We are using re-dash and QlikSense for BI

The culture trip snowplow implementation

Recommandé

Data science as a serviceidan_by

Streetlife's real time analytics stackidan_by

Memrise presentation @ London Snowplow meetup idan_by

Capturing online customer data to create better insights and targeted actions...yalisassoon

The analytics journey at Viewbix - how they came to use Snowplow and the setu...yalisassoon

Implementing improved and consistent arbitrary event tracking company-wide us...yalisassoon

Introducing Sauna - Decisioning and response platform from SnowplowGiuseppe Gaviani

Yali presentation for snowplow amsterdam meetup number 2yalisassoon

Recommandé

Data science as a serviceidan_by

Streetlife's real time analytics stackidan_by

Memrise presentation @ London Snowplow meetup idan_by

Capturing online customer data to create better insights and targeted actions...yalisassoon

The analytics journey at Viewbix - how they came to use Snowplow and the setu...yalisassoon

Implementing improved and consistent arbitrary event tracking company-wide us...yalisassoon

Introducing Sauna - Decisioning and response platform from SnowplowGiuseppe Gaviani

Yali presentation for snowplow amsterdam meetup number 2yalisassoon

Viewbix tracking journeyidan_by

Snowplow: open source game analytics powered by AWSGiuseppe Gaviani

Analytics at Carbonite: presentation to Snowplow Meetup Boston April 2016yalisassoon

Data driven video advertising campaigns - JustWatch & SnowplowGiuseppe Gaviani

Snowplow at DA Hub emerging technology showcaseyalisassoon

2016 09 measurecamp - event data modelingyalisassoon

Snowplow the evolving data pipelineyalisassoon

Snowplow: putting digital analysts at the heart of digital analytics - the fo...yalisassoon

Simply Business and Snowplow - Multichannel Attribution AnalysisStewart Duncan

Snowplow presentation for Amsterdam Meetup #3Snowplow Analytics

Understanding event datayalisassoon

Notebooks @ Netflix: From analytics to engineering with Jupyter notebooksMichelle Ufford

Apache Kylin 101SamanthaBerlant

Snowplow - Evolve your analytics stack with your businessGiuseppe Gaviani

Snowplow Analytics: from NoSQL to SQL and back againAlexander Dean

Using Apache Spark for Intelligent Services by Alexis RoosSpark Summit

Data Science at Netflix - Principles for Speed & Scale [Rev 2019 keynote]Michelle Ufford

Snowplow: where we came from and where we are going - March 2016yalisassoon

How to Design, Build and Map IT and Business Services in SplunkSplunk

Tableau Conference 2018: Binging on Data - Enabling Analytics at NetflixBlake Irvine

Putting data to workidan_by

Psychological Affects of Hearing Loss in Teensschleefy

Contenu connexe

Tendances

Viewbix tracking journeyidan_by

Snowplow: open source game analytics powered by AWSGiuseppe Gaviani

Analytics at Carbonite: presentation to Snowplow Meetup Boston April 2016yalisassoon

Data driven video advertising campaigns - JustWatch & SnowplowGiuseppe Gaviani

Snowplow at DA Hub emerging technology showcaseyalisassoon

2016 09 measurecamp - event data modelingyalisassoon

Snowplow the evolving data pipelineyalisassoon

Snowplow: putting digital analysts at the heart of digital analytics - the fo...yalisassoon

Simply Business and Snowplow - Multichannel Attribution AnalysisStewart Duncan

Snowplow presentation for Amsterdam Meetup #3Snowplow Analytics

Understanding event datayalisassoon

Notebooks @ Netflix: From analytics to engineering with Jupyter notebooksMichelle Ufford

Apache Kylin 101SamanthaBerlant

Snowplow - Evolve your analytics stack with your businessGiuseppe Gaviani

Snowplow Analytics: from NoSQL to SQL and back againAlexander Dean

Using Apache Spark for Intelligent Services by Alexis RoosSpark Summit

Data Science at Netflix - Principles for Speed & Scale [Rev 2019 keynote]Michelle Ufford

Snowplow: where we came from and where we are going - March 2016yalisassoon

How to Design, Build and Map IT and Business Services in SplunkSplunk

Tableau Conference 2018: Binging on Data - Enabling Analytics at NetflixBlake Irvine

Tendances (20)

Viewbix tracking journey

Snowplow: open source game analytics powered by AWS

Analytics at Carbonite: presentation to Snowplow Meetup Boston April 2016

Data driven video advertising campaigns - JustWatch & Snowplow

Snowplow at DA Hub emerging technology showcase

2016 09 measurecamp - event data modeling

Snowplow the evolving data pipeline

Snowplow: putting digital analysts at the heart of digital analytics - the fo...

Simply Business and Snowplow - Multichannel Attribution Analysis

Snowplow presentation for Amsterdam Meetup #3

Understanding event data

Notebooks @ Netflix: From analytics to engineering with Jupyter notebooks

Apache Kylin 101

Snowplow - Evolve your analytics stack with your business

Snowplow Analytics: from NoSQL to SQL and back again

Using Apache Spark for Intelligent Services by Alexis Roos

Data Science at Netflix - Principles for Speed & Scale [Rev 2019 keynote]

Snowplow: where we came from and where we are going - March 2016

How to Design, Build and Map IT and Business Services in Splunk

Tableau Conference 2018: Binging on Data - Enabling Analytics at Netflix

En vedette

Putting data to workidan_by

Psychological Affects of Hearing Loss in Teensschleefy

Simply Business - Near Real Time Event Processingidan_by

Social Media Manager's CalendarIoana Barbu

Drip irrigation and fertigationPooja Panwar

Slideshare pptMandy Suzanne

How to Become a Thought Leader in Your NicheLeslie Samuel

En vedette (7)

Putting data to work

Psychological Affects of Hearing Loss in Teens

Simply Business - Near Real Time Event Processing

Social Media Manager's Calendar

Drip irrigation and fertigation

Slideshare ppt

How to Become a Thought Leader in Your Niche

Similaire à The culture trip snowplow implementation

AWS re:Invent 2016: Earth on AWS—Next-Generation Open Data Platforms (STG203)Amazon Web Services

Creating a Data Driven Culture with Amazon QuickSight - Technical 201Amazon Web Services

Your app works slowly. Now what?Aleksandra (Ola) Kunysz

Mission First: How the Cloud Helps Nonprofits Simplify TechnologyAmazon Web Services

Don't think DevOps think Compliant Database DevOpsRed Gate Software

ASTQB washington-sept-2015Dan Boutin

How Gousto is moving to just-in-time personalization with SnowplowGiuseppe Gaviani

ironSource Atom BigData New-YorkShimon Tolts

Big Data Use Cases and Solutions in the AWS CloudAmazon Web Services

ironSource Atom BigData BerlinShimon Tolts

Shimon Tolts, R&D Manager, IronSource - "Data Flow Management"Dataconomy Media

AWS Enterprise Day | Closing Keynote - Data Without Limits, Dr Werner VogelsAmazon Web Services

Initiate Edinburgh 2019 - Big Data Meets AIAmazon Web Services

(ISM313) How Delaware North Migrated 90+ Apps in Four MonthsAmazon Web Services

Live Analytics with Go & AerospikeNick Manning

[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...Kaan Onuk

Microservices, Events, and Breaking the Data Monolith with KafkaVMware Tanzu

Graphs in Action: In-depth look at Neo4j in ProductionNeo4j

Hadoop Summit 2016 - Evolution of Big Data Pipelines At IntuitRekha Joshi

Séminaire Big Data Alter Way - Elasticsearch - octobre 2014ALTER WAY

Similaire à The culture trip snowplow implementation (20)

AWS re:Invent 2016: Earth on AWS—Next-Generation Open Data Platforms (STG203)

Creating a Data Driven Culture with Amazon QuickSight - Technical 201

Your app works slowly. Now what?

Mission First: How the Cloud Helps Nonprofits Simplify Technology

Don't think DevOps think Compliant Database DevOps

ASTQB washington-sept-2015

How Gousto is moving to just-in-time personalization with Snowplow

ironSource Atom BigData New-York

Big Data Use Cases and Solutions in the AWS Cloud

ironSource Atom BigData Berlin

Shimon Tolts, R&D Manager, IronSource - "Data Flow Management"

AWS Enterprise Day | Closing Keynote - Data Without Limits, Dr Werner Vogels

Initiate Edinburgh 2019 - Big Data Meets AI

(ISM313) How Delaware North Migrated 90+ Apps in Four Months

Live Analytics with Go & Aerospike

[Strata NYC 2019] Turning big data into knowledge: Managing metadata and data...

Microservices, Events, and Breaking the Data Monolith with Kafka

Graphs in Action: In-depth look at Neo4j in Production

Hadoop Summit 2016 - Evolution of Big Data Pipelines At Intuit

Séminaire Big Data Alter Way - Elasticsearch - octobre 2014

Dernier

Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh9953056974 Low Rate Call Girls In Saket, Delhi NCR

Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightDelhi Call girls

Data-Analysis for Chicago Crime Data 2023ymrp368

CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE9953056974 Low Rate Call Girls In Saket, Delhi NCR

Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Riyadh +966572737505 get cytotec

Midocean dropshipping via API with DroFxolyaivanovalion

Carero dropshipping via API with DroFx.pptxolyaivanovalion

Sampling (random) method and Non random.pptDr. Soumendra Kumar Patra

Week-01-2.ppt BBB human Computer interactionfulawalesam

Smarteg dropshipping via API with DroFx.pptxolyaivanovalion

Invezz.com - Grow your wealth with trading signalsInvezz1

BigBuy dropshipping via API with DroFx.pptxolyaivanovalion

VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...SUHANI PANDEY

Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...amitlee9823

Halmar dropshipping via API with DroFxolyaivanovalion

Accredited-Transport-Cooperatives-Jan-2021-Web.pdfadriantubila

BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxMohammedJunaid861692

Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAroojKhan71

CebaBaby dropshipping via API with DroFX.pptxolyaivanovalion

Introduction-to-Machine-Learning (1).pptxfirstjob4

Dernier (20)

Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh

Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night

Data-Analysis for Chicago Crime Data 2023

CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE

Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec

Midocean dropshipping via API with DroFx

Carero dropshipping via API with DroFx.pptx

Sampling (random) method and Non random.ppt

Week-01-2.ppt BBB human Computer interaction

Smarteg dropshipping via API with DroFx.pptx

Invezz.com - Grow your wealth with trading signals

BigBuy dropshipping via API with DroFx.pptx

VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...

Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...

Halmar dropshipping via API with DroFx

Accredited-Transport-Cooperatives-Jan-2021-Web.pdf

BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx

Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha

CebaBaby dropshipping via API with DroFX.pptx

Introduction-to-Machine-Learning (1).pptx

The culture trip snowplow implementation

1. Snow Plow meetup Nir Sivan, Senior Software developer The Culture trip 11/07/2016

2. The Culture Trip • Website/Application which showcases the best culture, food, travel, and art for every country around the world. • 3m unique visitor per month ~100% YOY growth, ~30m monthly events. • Dealing with mapping the culture world using big data. • Assembled from a team of previously $360m Check Inc acquisition by Intuit.

3. Why we used Snow Plow? • Data driven – supports A/B testing using lean methodology. • Owning the data. • Easy and cheap to maintain. • Scalable • Great documentation and support!

4. Our stack over AWS CDN Collector Clojure Collector Web/Mobile Client SendGrid Email Webhook CDN Collector Amazon S3 Snow Plow EMR Amazon S3 Storage Loader Trackers Collectors Process Events Load Data into RedShift

5. Some of our testing results • Email conversions up 137%. • Application download conversions up 220%. • Web site article FB shares up 165%. • MVP testing of future releases.

6. Analyzing the data We are using re-dash and QlikSense for BI