SlideShare une entreprise Scribd logo
1  sur  28
Télécharger pour lire hors ligne
Measuring For Engagement
1
John Egan
Lead Growth Engineer @ Pinterest
2
New Users
MAUs
Dormant Users
3
New Users
MAUs
Dormant Users
4
New Users
Dormant Users
Core
Casual
Marginal
5
New Users
MAUs
Dormant Users
6
• Retail shopping rewards app
• Led Growth Engineering team
• Grew from 1MM to 8MM users in
3 years
• Acquired for $200MM
• Visual discovery & bookmarking
• Eng lead for R&R team
• Increased mobile WAUs by 20%
• Increased mobile signups by
10%
Activation
7
Retained MAUs
• Percentage of new signups that are still using the app a month later
• Figure out what a good retention number is for your industry
8
1d7s
• Percentage of new signups that use the app 1 or more times in the week
following signup
• Quicker to run experiments with
• At Pinterest this is highly correlated with user’s long-term retention
9
Cohort Heatmap
10Source: Placeholder Numbers
Cohort Heatmap
11Source: Placeholder Numbers
Cohort Heatmap
12Source: Placeholder Numbers
Engagement
13
One Key Engagement Metric
Medium: Total Time Spent Reading (TTR)
Twitter: MAUs with 7+ visits a month (7d28s)
Uber: Weekly Trips
Facebook: WAUs with 6+ visits a week (6L7s)
Pinterest: Weekly Active Repiners or Clickers (WARCs)
14
Finding Your Key Engagement Metric
1) What are the actions a user has to take to get value from your product?
2) What is the frequency someone need to use your product
15
User States
Core: Active multiple times a week
Casual: Active once or twice a week
Marginal: Active a couple times a month
New: Joined in the past 28 days
Dormant: Not active for 28 days
Resurrected: Was dormant, but became active
again in the past 28 days
16
Badging
Holdout
Experiment
2:50 PM 100%
17
Measuring Effect on Engagement
18
*AU Ratios
19
20
DAU MAU DAU/MAU ratio
Knighthood 30,014 389,583 7.70%
RockYou Pets 50,482 582,720 8.66%
Tetris Friends 100,404 841,223 11.94%
Superpoke Pets 299,505 2,296,175 13.04%
Mobsters 539,012 3,431,063 15.71%
Vampire Wars 687,067 3,794,869 18.11%
Country Story 1,647,763 8,097,356 20.35%
Fish World 2,084,358 8,581,587 24.29%
Pet Society 5,046,347 20,480,397 24.64%
Mafia Wars 6,473,504 25,431,622 25.45%
Restaurant City
 5,033,468 17,250,419 29.18%
Cafe World 7,409,711 22,062,364 33.59%
Courtesy Social Times & Nabeel Hyatt
Retention &
Resurrection
21
Measuring Engagement for Emails/Push
• Positive measures of quality
- Must lift key engagement metric
- Minimum required CTR rates
• Negative measures of quality
- App deletions
- Spam reports
- Unsubscribes
22
Experiment Segmentation
23
All Users
24
Marginal Users (~1 month)
25
Core Users (multiple times a week)
26
Wrap Up
• 1d7s to experiment on activation
• Cohort heatmaps to track new user retention curve
• Define your key engagement metric
• Use user states to understand how engaged users are
• Make sure emails/notifications for true engagement
• Use segmentation for experiments & metrics in general
Confidential 27
John Egan
Growth Blog: jwegan.com
Email: jwegan@gmail.com
Twitter: @jwegan_com
Pinterest: pinterest.com/jwegan
28

Contenu connexe

En vedette

Recruiters Guide to Attract and Retain Millennials
Recruiters Guide to Attract and Retain MillennialsRecruiters Guide to Attract and Retain Millennials
Recruiters Guide to Attract and Retain Millennials
Chris Bennett
 
LinkeIn: How to attract and engage millennial talent
LinkeIn: How to attract and engage millennial talentLinkeIn: How to attract and engage millennial talent
LinkeIn: How to attract and engage millennial talent
Andy, Xinbin Hu
 

En vedette (19)

The 5 most powerful retention strategies for your business - SME recruitment ...
The 5 most powerful retention strategies for your business - SME recruitment ...The 5 most powerful retention strategies for your business - SME recruitment ...
The 5 most powerful retention strategies for your business - SME recruitment ...
 
12 Apps & Hacks to Level Up Your Next Presentation or Pitch
12 Apps & Hacks to Level Up Your Next Presentation or Pitch12 Apps & Hacks to Level Up Your Next Presentation or Pitch
12 Apps & Hacks to Level Up Your Next Presentation or Pitch
 
Generation Z: Connecting with Today's Teens
Generation Z: Connecting with Today's TeensGeneration Z: Connecting with Today's Teens
Generation Z: Connecting with Today's Teens
 
6 Millennial Motivators: A Guide to What Motivates Millennials at Work
6 Millennial Motivators: A Guide to What Motivates Millennials at Work6 Millennial Motivators: A Guide to What Motivates Millennials at Work
6 Millennial Motivators: A Guide to What Motivates Millennials at Work
 
Pro LinkedIn Tips for Pro Bloggers
Pro LinkedIn Tips for Pro BloggersPro LinkedIn Tips for Pro Bloggers
Pro LinkedIn Tips for Pro Bloggers
 
Recruiters Guide to Attract and Retain Millennials
Recruiters Guide to Attract and Retain MillennialsRecruiters Guide to Attract and Retain Millennials
Recruiters Guide to Attract and Retain Millennials
 
18 Statistics to Help Shape Your Millennial Training and Future Proof Your Or...
18 Statistics to Help Shape Your Millennial Training and Future Proof Your Or...18 Statistics to Help Shape Your Millennial Training and Future Proof Your Or...
18 Statistics to Help Shape Your Millennial Training and Future Proof Your Or...
 
Get to know your audience models: a planner's guide.
Get to know your audience models: a planner's guide.Get to know your audience models: a planner's guide.
Get to know your audience models: a planner's guide.
 
6 Ways To RePurpose List Type Blog Posts
6 Ways To RePurpose List Type Blog Posts6 Ways To RePurpose List Type Blog Posts
6 Ways To RePurpose List Type Blog Posts
 
Recruiting and Retaining Millennials
Recruiting and Retaining MillennialsRecruiting and Retaining Millennials
Recruiting and Retaining Millennials
 
24 Easy Ways to Generate Content Ideas
24 Easy Ways to Generate Content Ideas24 Easy Ways to Generate Content Ideas
24 Easy Ways to Generate Content Ideas
 
Observing trends with the NxtGen at MRS Kids & Youth Research
Observing trends with the NxtGen at MRS Kids & Youth ResearchObserving trends with the NxtGen at MRS Kids & Youth Research
Observing trends with the NxtGen at MRS Kids & Youth Research
 
Millennial Careers: 2020 Vision
Millennial Careers: 2020 VisionMillennial Careers: 2020 Vision
Millennial Careers: 2020 Vision
 
10 surprising instagram facts
10 surprising instagram facts10 surprising instagram facts
10 surprising instagram facts
 
Generation z
Generation zGeneration z
Generation z
 
How generation Z will shape our supply chain?
How generation Z will shape our supply chain? How generation Z will shape our supply chain?
How generation Z will shape our supply chain?
 
Generation Z Infographic | Claire Madden
Generation Z Infographic | Claire MaddenGeneration Z Infographic | Claire Madden
Generation Z Infographic | Claire Madden
 
LinkeIn: How to attract and engage millennial talent
LinkeIn: How to attract and engage millennial talentLinkeIn: How to attract and engage millennial talent
LinkeIn: How to attract and engage millennial talent
 
How to Reach the Mobile Generation (Millennial Christians)
How to Reach the Mobile Generation (Millennial Christians)How to Reach the Mobile Generation (Millennial Christians)
How to Reach the Mobile Generation (Millennial Christians)
 

Similaire à Measuring for Engagement

DENVER RITAS - End of Program Recap - FINAL
DENVER RITAS - End of Program Recap - FINALDENVER RITAS - End of Program Recap - FINAL
DENVER RITAS - End of Program Recap - FINAL
Vanessa Fromm
 

Similaire à Measuring for Engagement (20)

Opticon 2017 Hooked: How to Succeed
Opticon 2017 Hooked: How to SucceedOpticon 2017 Hooked: How to Succeed
Opticon 2017 Hooked: How to Succeed
 
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROI
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROIIncrease AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROI
Increase AUM with Marketing Automation Part 3: Marketing Analytics to Prove ROI
 
John Egan - Pinterest
John Egan - PinterestJohn Egan - Pinterest
John Egan - Pinterest
 
Day1 1615 nicholas_lovell
Day1 1615 nicholas_lovellDay1 1615 nicholas_lovell
Day1 1615 nicholas_lovell
 
Benchmarks and metrics
Benchmarks and metricsBenchmarks and metrics
Benchmarks and metrics
 
Crystal's aza presentation(1)
Crystal's aza presentation(1)Crystal's aza presentation(1)
Crystal's aza presentation(1)
 
Mobile Monetization Study: Effects of Blacklisting
Mobile Monetization Study: Effects of BlacklistingMobile Monetization Study: Effects of Blacklisting
Mobile Monetization Study: Effects of Blacklisting
 
Energy drinks usage in Vietnam
Energy drinks usage in VietnamEnergy drinks usage in Vietnam
Energy drinks usage in Vietnam
 
DENVER RITAS - End of Program Recap - FINAL
DENVER RITAS - End of Program Recap - FINALDENVER RITAS - End of Program Recap - FINAL
DENVER RITAS - End of Program Recap - FINAL
 
Marketplace Site Begin To Dominate E-Commerce Marke tin Indonesia 2015
Marketplace Site Begin To Dominate E-Commerce Marke tin Indonesia 2015Marketplace Site Begin To Dominate E-Commerce Marke tin Indonesia 2015
Marketplace Site Begin To Dominate E-Commerce Marke tin Indonesia 2015
 
Marketplace Sites Begin To Dominate E-Commerce Market In Indonesia
Marketplace Sites Begin To Dominate E-Commerce Market In Indonesia Marketplace Sites Begin To Dominate E-Commerce Market In Indonesia
Marketplace Sites Begin To Dominate E-Commerce Market In Indonesia
 
Qonversion benchmarks 1.0
Qonversion benchmarks 1.0Qonversion benchmarks 1.0
Qonversion benchmarks 1.0
 
DMANF Digital Day Chicago - Data and Analytics
DMANF Digital Day Chicago - Data and AnalyticsDMANF Digital Day Chicago - Data and Analytics
DMANF Digital Day Chicago - Data and Analytics
 
[PREMONEY 2014] Institutional Venture Partners>> Jules Maltz, "SaaS Money Met...
[PREMONEY 2014] Institutional Venture Partners>> Jules Maltz, "SaaS Money Met...[PREMONEY 2014] Institutional Venture Partners>> Jules Maltz, "SaaS Money Met...
[PREMONEY 2014] Institutional Venture Partners>> Jules Maltz, "SaaS Money Met...
 
2012 Wingstop update
2012 Wingstop update2012 Wingstop update
2012 Wingstop update
 
Wouldn’t it be great to get more users to spend more time and money in your a...
Wouldn’t it be great to get more users to spend more time and money in your a...Wouldn’t it be great to get more users to spend more time and money in your a...
Wouldn’t it be great to get more users to spend more time and money in your a...
 
Le Top 25 des marques de Fast-Food sur les réseaux sociaux
Le Top 25 des marques de Fast-Food sur les réseaux sociauxLe Top 25 des marques de Fast-Food sur les réseaux sociaux
Le Top 25 des marques de Fast-Food sur les réseaux sociaux
 
Banglalink Ennovators 2.0 champion - Team Greenovation
Banglalink Ennovators 2.0 champion - Team GreenovationBanglalink Ennovators 2.0 champion - Team Greenovation
Banglalink Ennovators 2.0 champion - Team Greenovation
 
Snapshot of consumer behaviors of Jan. 2022 EOL i-survey (en)
Snapshot of consumer behaviors of Jan. 2022  EOL i-survey (en)Snapshot of consumer behaviors of Jan. 2022  EOL i-survey (en)
Snapshot of consumer behaviors of Jan. 2022 EOL i-survey (en)
 
Astrology me final
Astrology me finalAstrology me final
Astrology me final
 

Dernier

Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Bertram Ludäscher
 
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
vexqp
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit RiyadhCytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Abortion pills in Riyadh +966572737505 get cytotec
 
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi ArabiaIn Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
ahmedjiabur940
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
gajnagarg
 
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling ManjurJual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
ptikerjasaptiker
 
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
nirzagarg
 
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
vexqp
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
ranjankumarbehera14
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
gajnagarg
 
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
vexqp
 

Dernier (20)

Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...Reconciling Conflicting Data Curation Actions:  Transparency Through Argument...
Reconciling Conflicting Data Curation Actions: Transparency Through Argument...
 
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt
 
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
 
Ranking and Scoring Exercises for Research
Ranking and Scoring Exercises for ResearchRanking and Scoring Exercises for Research
Ranking and Scoring Exercises for Research
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit RiyadhCytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
Cytotec in Jeddah+966572737505) get unwanted pregnancy kit Riyadh
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
 
Harnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptxHarnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptx
 
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi ArabiaIn Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
 
Switzerland Constitution 2002.pdf.........
Switzerland Constitution 2002.pdf.........Switzerland Constitution 2002.pdf.........
Switzerland Constitution 2002.pdf.........
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
 
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
SR-101-01012024-EN.docx  Federal Constitution  of the Swiss ConfederationSR-101-01012024-EN.docx  Federal Constitution  of the Swiss Confederation
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
 
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling ManjurJual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
 
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
 
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1Lecture_2_Deep_Learning_Overview-newone1
Lecture_2_Deep_Learning_Overview-newone1
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
 
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
怎样办理纽约州立大学宾汉姆顿分校毕业证(SUNY-Bin毕业证书)成绩单学校原版复制
 

Measuring for Engagement