SlideShare une entreprise Scribd logo
1  sur  45
Télécharger pour lire hors ligne
Shipping high impact
products, fast
Abhijeet Gaur
Sr. Product Manager, Razorpay
Product Lead, Razorpay Thirdwatch
About the speaker
Joed z as  AP
Wal Gawa
Ingatos:
Gole y, Amon y
Raray co Si
Laced san Rens
Ma,
2018
Agut, 2018 Mot  2018 an
2019
Apl,
2019
Afrabit Patr
Pot-Pamt Patr
Rens, ec an
Setmet
Ocbe,
2018
Setbe 2019
- Pest
Raray hidth
Apl -
Setbe, 2019
@abhijeetgaur16
linkedin.com/in/abhijeetgaur16
This talk will be relevant for you if:
1. Are looking to transition to a Product Manager’s role and can’t decide if it’s your jam
2. Have successfully transitioned to Product and are questioning your life choices
3. Recently started working as a PM and impostor syndrome is running high
What I am going to talk about:
1. Writing and using OKRs for the Product’s benefit
2. Using Data and building a discipline around the same
3. Writing good PRDs
4. Solving for Uncertainty: Taking Product to the Market
5. Learning new things at the job
Step 0: The PM Career Path
Time/Experience
Title
Associate PM
Product Manager
Sr. Product Manager
Principal PM/
Associate Director
Director
VP
CPO
Not really an effective way to internalise - Varies from companies and domains.
Good for HRs mostly and LinkedIn profile views
Step 0: The PM Career Path - A useful way to look at it
Responsibilities
Building features within a broader
product or a platform
Features with significant complexity
or nuance
Multiple complex feature areas with
say on on overall product strategy
and outcomes
Multiple products or product lines
with company and industry-level
impact
Large product area with a
firm’s domain specific impact.
Also people management-101
starts here
Every PM’s appraisal discussion ever...
The Position of a PM
1. Communication => Coordination
2. Coordination => Timing
3. Timing => Product Success
Applies to all kinds of Product contexts
Making Sense of the Chaos: Designing your Arena of Operation
Product Metrics
OKRs
Communication
L&D
OKRs : Tenets of building an
arena for product success
Communicating Before you start anything: OKR Framework
Objective-Key Results Framework - First Principle
1. Simple to understand. LMGTFY
2. Quantifiable OKRs => Easy to understand and assess.
3. Solves for cross-functional dependencies before they arise
4. Also, quite easy to get wrong
Bad OKR examples
● Written vaguely, talk mostly about building and launching products
● Difficult to quantify - impact assessment is a challenge
● Not-aligned to Customer success or happiness
● Not aligned to core Business unit goals
Example
- Build XYZ feature to improve customer engagement
- Introducing ABC capability in the system
- Launch and roll-out feature on X number of users
Why are they bad?
- Building is not an OKR. It doesn’t solve a business goal. The outcome needs to be
measurable to assess impact
- Launching and rolling-out is in your control. What does that launch and roll-out
achieve? What was your goal?
Product Consideration: Razorpay Thirdwatch and Instant Refunds
Core Instant Refunds OKR:
- Reduce end-to-end Refund time to X seconds
- Reduce 99th Percentile refund processing time to less than X minutes
- Achieve Y% coverage on total payment channels for Instant Refunds
Core Razorpay Thirdwatch OKRs:
- Achieve an overall X% Precision and Y% Recall for the Core AI Engine on RTO
Prediction
- Increase overall approval rate for Thirdwatch red-flagged Orders by Z% on Core
AI engine
Good OKR examples
Okay, I’ve set the OKRs, now what?
1. Sell OKRs to stakeholders. Thump your chest. Shout. Mail people. Inform them. Get a
sign-off. Execution should only start till you get an agreement.
2. Do step 1 again till it’s clear to <i>everyone</i> what you’re doing.
Note:
Good product organisations rely heavily on OKRs for cross-functional alignment.
It’s a great way to ensure collaboration at scale in high growth products
Data and Everything else
Understanding your Metrics
Data is your best friend: Understand how it flows in your product. Understand if it captures
your customer behaviour
Litmus Test of any Product metric:
● Question the existing conventions floating in the Org for the same
● Think in terms of levels of information conveyed by a Metric
● Movement of the Metric: True and False Impact Scenarios
For Example:
Refunds in Razorpay - Success rates of Refunds are always above 99.9%.
- Success Rate becomes a vanity metric
- Smarter Metric to Measure: 95th, 99th Percentile for total time of Refund
processing [L1 Metric]
- Align Operations and Tech to solve for reduction of TAT at Payment Gateway level
itself [L2, L3 Metrics]
Understanding your Metrics - (Contd.)
● Think: Alignment of Metric the context of Activation, Engagement, Retention and
Monetisation goals of the user/product
For Example:
Razorpay Thirdwatch: AI Engine Performance - How to measure?
- Effect of False Positives: Reduced customer trust on the product
- Coverage on total Frauds identified: Denotes reduction in cost by the product
Okay, I know a lot about Metrics. But where will that help me?
The Data Discipline
- Product Focus: Are we really solving the problem?
- Problem Discovery: Is there something that we are missing?
Okay, I know a lot about Metrics. But where will that help me?
Tip:
- Define dashboards for your key product Metrics:
- Set it up on your BI tool or redash or run a query yourself. Doesn’t matter.
- This should be a no-effort view of the key product metrics
- Most BI tools have a Slack integration. Leverage that.
- Publish Weekly Reports to all stakeholders on key metrics update
Communicating
Requirements
1. PRDs are not just meant for Engineers: They’re meant for everyone.
2. Lengthy. Bulky. Tough to gather a quick 10,000ft. View of the solution
The Problem with Product Requirement Documents
Length of your document
Likelihood that
your Sales
team will ever
read it
Introducing Concept Notes and User Stories
Concept Note
7-8 Page Doc that briefly covers -
● Problem Statement
● Goals and Non-Goals of the Product
● Customers
● Assumptions
● Alternate Solutions
● Solution Summary in Flowcharts/high-level diagrams
○ Edge-cases to be handled
○ Happy/Unhappy Flows
● Impact Assessment and Metrics
● Future Scope
Note: This needs to be written in a highly readable language by ANYONE in the
Organisation
User Stories
Detailed Solution Requirements, broken down at an actionable engineering task level.
1. All configurations you’d want to see on the Product
2. User Flow breakdown in the format:
a. “As a User X I want to see Y Functionality in the product”
b. This is further accompanied by Acceptance Criteria of the Product
3. Easy for you to bargain with Engineering on execution
Advantages of User Stories - Concept Note Framework over PRDs:
- A small cluster of User Stories => Easy to Communicate
- A fast barebones MVP Launch of the Product
- Non-Technical folks in Company can consume Concept Note to understand
solution
- Incremental changes in the Product => Gradual Scale-up stories, added on top of the
MVP configs itself
- Direct Translation of a User Story into JIRA tickets
- [Engineers are definitely going to hate you for that tbh, but great for bargaining
on Timelines]
GTM - 101
That one thing that you’ll definitely get wrong at least
once in your career
Launching a Product
1. Product Launch Strategy needs to be part of your Product Conceptualisation
2. Heavily reliant on multiple things going right at the same time
3. Like OKRs, quite easy to screw up but with little or no chance of recovery
Tenets of a poorly planned Product Launch
1. Uncertainty in timelines
2. Lack of Awareness of Key product stakeholders : Marketing, Sales & Operations
This leads to:
● Release without Product being ready = High number of inbound requests and
angry customers, frustrated Product Operations
● Product ready but no GTM = Stagnant Product OKRs; lack of excitement; dull
release
Tenets of a good Product Launch
1. Everyone: Marketing, Sales, Operations, Engineering is certain on the timelines
2. Adherence to the GTM Strategy decided during conceptualisation
3. Channels for customer acquisition and product discovery are set
4. Relevant Knowledge Transfer sessions are completed before Product release
5. Channels for Product Feedback are defined
a. Metrics are visible from Day-0
b. MVP/Pilot Customers
Tl;dr
It’s mostly about good communication. At all levels.
Next Level Lessons an executed GTM will teach you:
1. Understanding difference between Product-Marketing and Product & Marketing
2. Success of Product == Happy Users; How to avoid Vanity Metrics from Product
Launches
a. Early Traction != Product Success
3. Importance of Retention: Identify Secondary and Tertiary Retention Metrics
a. D-7, 14, 30 Activity of Users
b. Upsell of other products and core product usage
c. Understand Product Growth
Case Study: Launch At Scale for Instant Refunds
Strategy focused on fast scale-up:
1. MVP Launch for Key Client ABC - Barebones product launch with minimal features
2. Post MVP, Product components that were refined for Phase 1&2 roll-outs
a. Alignment of Docs for Integration
b. No-Code Integration KTs for Sales and Key-Accounts teams
c. KT Sessions for Marketing and Operations to manage inbound traction
d. Post that, parallel execution on Social Media, Ad Campaigns
3. Selling to existing customers vs Selling to new customers
a. Product Discoverability
b. Self-serve enablement Introduction at scale in Product flow
Case Study: Launch At Scale for Razorpay Thirdwatch
Key Product Challenges:
1. Diverse Customer Persona
a. SME
b. Mid-Segment E-Commerce
c. Enterprises
2. High Education product:
a. Figuring out correct branding language for Marketing
b. Sales Training: Keyword driven Sales pitches
3. Pre-Product Market Fit Problem Discovery:
a. Mainly driven by Customer Interviews
b. Bets on Ideas that increase early Product engagement
Learning as a PM
How to become a better Product Manager?
- Figuring out the Framework
- Figuring out the discipline
- Staying Motivated
- Awareness: The X-Factor
Framework Discovery
Ways of looking at the Problem:
- Discover Users
- Discover Metrics
- Set goals. With Conviction.
● Top-down vs Bottom-up Strategy
● Inside-Out vs Outside-In
Framework Discovery Examples
● Refunds Problem
● Reconciliation Challenges
● Thirdwatch User Persona Discovery
The Discipline
Toughest to Crack
- Start with Data
- Calendar driven day
- Limit extra communication
- Prioritise Execution time and Problem discovery time
Motivation
It’s easy to face a burn out as a PM. Avoid that at all cost.
● Work smartly - Efficiency is critical
● Mentally prepare yourself for the following scenarios:
○ Stagnant metrics
○ Bugs in Production
○ Angry customers
○ Internal Escalations
● Also, do follow Naval Ravikant on Twitter
Awareness: The X-Factor
Effective Modes of Learnings
- Twitter: Tech-Twitter has some really smart folks from the valley
- Easy to get recommended Blogs, Articles from Twitter itself
- Books: Learn to read fast and learn more
Note:
Exploring Podcasts these days. So, no recommendation yet.
People/Accounts to follow on Twitter for Product Management related gyan
- Shreyas Doshi (@shreyas)
- Eugene Wei (@eugenewei)
- Andrew Chen (@andrewchen)
- TheProductFolks (@TheProductfolks)
- Diwakar Kaushik (@Pentropy)
- Ankit (@ankitkr0)
- Palak Zatakia (@palakzat)
- Vindhya C (@vindytalks)
Some books that’ll really help you out [dynamic list]
- Good Strategy/Bad Strategy - Richard Rumlet
- Super Thinking - Gabriel Weinberg
- The Lean Startup - Eric Ries
- Crossing the Chasm - Geoffrey R Moore
- Sprint - Jake Knapp
- Don’t Make Me Think - Steve Krug
Fin.

Contenu connexe

Tendances

How to Run a Big Data POC in 6 weeks
How to Run a Big Data POC in 6 weeksHow to Run a Big Data POC in 6 weeks
How to Run a Big Data POC in 6 weeks
Fiona Lew
 
Software Product Management – Optimizing WHAT to Develop
Software Product Management – Optimizing WHAT to Develop Software Product Management – Optimizing WHAT to Develop
Software Product Management – Optimizing WHAT to Develop
Ernani Ferrari
 

Tendances (20)

5 Lessons Learned in Product Management by Twitch Senior PM
5 Lessons Learned in Product Management by Twitch Senior PM5 Lessons Learned in Product Management by Twitch Senior PM
5 Lessons Learned in Product Management by Twitch Senior PM
 
Guide to Product Management
Guide to Product ManagementGuide to Product Management
Guide to Product Management
 
Critical 5 to succeed as agile product manager using scrum
Critical 5 to succeed as agile product manager using scrumCritical 5 to succeed as agile product manager using scrum
Critical 5 to succeed as agile product manager using scrum
 
CPQ Deployment Tips & Tricks
CPQ Deployment Tips & Tricks CPQ Deployment Tips & Tricks
CPQ Deployment Tips & Tricks
 
Pmp quality management
Pmp quality managementPmp quality management
Pmp quality management
 
Fme project quality
Fme project qualityFme project quality
Fme project quality
 
NPD hypothesis validation toolkit
NPD hypothesis validation toolkit NPD hypothesis validation toolkit
NPD hypothesis validation toolkit
 
Lean manufacturing concepts
Lean manufacturing conceptsLean manufacturing concepts
Lean manufacturing concepts
 
CX NPD consulting
CX NPD consulting CX NPD consulting
CX NPD consulting
 
How to Run a Big Data POC in 6 weeks
How to Run a Big Data POC in 6 weeksHow to Run a Big Data POC in 6 weeks
How to Run a Big Data POC in 6 weeks
 
Agile metrics at-pmi bangalore
Agile metrics at-pmi bangaloreAgile metrics at-pmi bangalore
Agile metrics at-pmi bangalore
 
Thinking tools for solving three Agile adoption problems
Thinking tools for solving three Agile adoption problemsThinking tools for solving three Agile adoption problems
Thinking tools for solving three Agile adoption problems
 
Top Agile Metrics
Top Agile MetricsTop Agile Metrics
Top Agile Metrics
 
New Product Development (NPD)
New Product Development (NPD)New Product Development (NPD)
New Product Development (NPD)
 
Software Product Management – Optimizing WHAT to Develop
Software Product Management – Optimizing WHAT to Develop Software Product Management – Optimizing WHAT to Develop
Software Product Management – Optimizing WHAT to Develop
 
Three Stages Sprint Planning Layout
Three Stages Sprint Planning LayoutThree Stages Sprint Planning Layout
Three Stages Sprint Planning Layout
 
Lean pilots by Mariya Breyter from Dun & Bradstreet
Lean pilots by Mariya Breyter from Dun & BradstreetLean pilots by Mariya Breyter from Dun & Bradstreet
Lean pilots by Mariya Breyter from Dun & Bradstreet
 
The search for Product-Market Fit
The search for Product-Market FitThe search for Product-Market Fit
The search for Product-Market Fit
 
The How, Why and What of Metrics?
The How, Why and What of Metrics?The How, Why and What of Metrics?
The How, Why and What of Metrics?
 
Agility and planning : tools and processes
Agility and planning  : tools and processesAgility and planning  : tools and processes
Agility and planning : tools and processes
 

Similaire à Hellomeets - 15th November

Product Management Playbook product inception to launch
Product Management Playbook   product inception to launchProduct Management Playbook   product inception to launch
Product Management Playbook product inception to launch
jhassemer
 

Similaire à Hellomeets - 15th November (20)

Feature Prioritization Techniques for an Agile PMs by Microsoft PM
Feature Prioritization Techniques for an Agile PMs by Microsoft PMFeature Prioritization Techniques for an Agile PMs by Microsoft PM
Feature Prioritization Techniques for an Agile PMs by Microsoft PM
 
Measuring What Matters by Google PM
Measuring What Matters by Google PMMeasuring What Matters by Google PM
Measuring What Matters by Google PM
 
2019 InfoSec Buyer's Guide
2019 InfoSec Buyer's Guide2019 InfoSec Buyer's Guide
2019 InfoSec Buyer's Guide
 
Product Management Playbook product inception to launch
Product Management Playbook   product inception to launchProduct Management Playbook   product inception to launch
Product Management Playbook product inception to launch
 
Using Customer Research to Build Your Product
Using Customer Research to Build Your ProductUsing Customer Research to Build Your Product
Using Customer Research to Build Your Product
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO program
 
Product management
Product managementProduct management
Product management
 
How to Use Data to Drive Product Decisions by PayPal PM
How to Use Data to Drive Product Decisions by PayPal PMHow to Use Data to Drive Product Decisions by PayPal PM
How to Use Data to Drive Product Decisions by PayPal PM
 
The Product Perspective on Problem Solving by former Visa PM
The Product Perspective on Problem Solving by former Visa PMThe Product Perspective on Problem Solving by former Visa PM
The Product Perspective on Problem Solving by former Visa PM
 
ch03-Design Project.ppt
ch03-Design Project.pptch03-Design Project.ppt
ch03-Design Project.ppt
 
World Product Day 2019 / Product Tank HCMC #9: How to advocate product manage...
World Product Day 2019 / Product Tank HCMC #9: How to advocate product manage...World Product Day 2019 / Product Tank HCMC #9: How to advocate product manage...
World Product Day 2019 / Product Tank HCMC #9: How to advocate product manage...
 
Lean analytics
Lean analyticsLean analytics
Lean analytics
 
Prototyping and MVPs for startups
Prototyping and MVPs for startupsPrototyping and MVPs for startups
Prototyping and MVPs for startups
 
Dmytro Breslavets: Test fast, die cheap. Як закривати гештальти швидко та не ...
Dmytro Breslavets: Test fast, die cheap. Як закривати гештальти швидко та не ...Dmytro Breslavets: Test fast, die cheap. Як закривати гештальти швидко та не ...
Dmytro Breslavets: Test fast, die cheap. Як закривати гештальти швидко та не ...
 
From an idea to an MVP: a guide for startups
From an idea to an MVP: a guide for startupsFrom an idea to an MVP: a guide for startups
From an idea to an MVP: a guide for startups
 
The Reality of Product Management
The Reality of Product ManagementThe Reality of Product Management
The Reality of Product Management
 
How to Manage the Whole Product by former Cisco Director of PM
How to Manage the Whole Product by former Cisco Director of PMHow to Manage the Whole Product by former Cisco Director of PM
How to Manage the Whole Product by former Cisco Director of PM
 
The Butterfly Principle for Product Management by GameBench CEO
The Butterfly Principle for Product Management by GameBench CEOThe Butterfly Principle for Product Management by GameBench CEO
The Butterfly Principle for Product Management by GameBench CEO
 
Measure and optimize
Measure and optimizeMeasure and optimize
Measure and optimize
 
How to Use Data to Build Products by Tradesy Product Advisor
How to Use Data to Build Products by Tradesy Product AdvisorHow to Use Data to Build Products by Tradesy Product Advisor
How to Use Data to Build Products by Tradesy Product Advisor
 

Dernier

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
VictorSzoltysek
 

Dernier (20)

%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...Chinsurah Escorts ☎️8617697112  Starting From 5K to 15K High Profile Escorts ...
Chinsurah Escorts ☎️8617697112 Starting From 5K to 15K High Profile Escorts ...
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 
LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456
LEVEL 5   - SESSION 1 2023 (1).pptx - PDF 123456LEVEL 5   - SESSION 1 2023 (1).pptx - PDF 123456
LEVEL 5 - SESSION 1 2023 (1).pptx - PDF 123456
 
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdfThe Top App Development Trends Shaping the Industry in 2024-25 .pdf
The Top App Development Trends Shaping the Industry in 2024-25 .pdf
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
ManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide DeckManageIQ - Sprint 236 Review - Slide Deck
ManageIQ - Sprint 236 Review - Slide Deck
 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verifiedSector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
Sector 18, Noida Call girls :8448380779 Model Escorts | 100% verified
 
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM TechniquesAI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques
 
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
 
Right Money Management App For Your Financial Goals
Right Money Management App For Your Financial GoalsRight Money Management App For Your Financial Goals
Right Money Management App For Your Financial Goals
 
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
%in kaalfontein+277-882-255-28 abortion pills for sale in kaalfontein
 
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdfPayment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024
 
Optimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTVOptimizing AI for immediate response in Smart CCTV
Optimizing AI for immediate response in Smart CCTV
 
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...
 
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
 

Hellomeets - 15th November

  • 1. Shipping high impact products, fast Abhijeet Gaur Sr. Product Manager, Razorpay Product Lead, Razorpay Thirdwatch
  • 2. About the speaker Joed z as  AP Wal Gawa Ingatos: Gole y, Amon y Raray co Si Laced san Rens Ma, 2018 Agut, 2018 Mot  2018 an 2019 Apl, 2019 Afrabit Patr Pot-Pamt Patr Rens, ec an Setmet Ocbe, 2018 Setbe 2019 - Pest Raray hidth Apl - Setbe, 2019 @abhijeetgaur16 linkedin.com/in/abhijeetgaur16
  • 3. This talk will be relevant for you if: 1. Are looking to transition to a Product Manager’s role and can’t decide if it’s your jam 2. Have successfully transitioned to Product and are questioning your life choices 3. Recently started working as a PM and impostor syndrome is running high
  • 4. What I am going to talk about: 1. Writing and using OKRs for the Product’s benefit 2. Using Data and building a discipline around the same 3. Writing good PRDs 4. Solving for Uncertainty: Taking Product to the Market 5. Learning new things at the job
  • 5. Step 0: The PM Career Path Time/Experience Title Associate PM Product Manager Sr. Product Manager Principal PM/ Associate Director Director VP CPO Not really an effective way to internalise - Varies from companies and domains. Good for HRs mostly and LinkedIn profile views
  • 6. Step 0: The PM Career Path - A useful way to look at it Responsibilities Building features within a broader product or a platform Features with significant complexity or nuance Multiple complex feature areas with say on on overall product strategy and outcomes Multiple products or product lines with company and industry-level impact Large product area with a firm’s domain specific impact. Also people management-101 starts here
  • 7. Every PM’s appraisal discussion ever...
  • 8. The Position of a PM 1. Communication => Coordination 2. Coordination => Timing 3. Timing => Product Success Applies to all kinds of Product contexts
  • 9. Making Sense of the Chaos: Designing your Arena of Operation Product Metrics OKRs Communication L&D
  • 10. OKRs : Tenets of building an arena for product success
  • 11. Communicating Before you start anything: OKR Framework Objective-Key Results Framework - First Principle 1. Simple to understand. LMGTFY 2. Quantifiable OKRs => Easy to understand and assess. 3. Solves for cross-functional dependencies before they arise 4. Also, quite easy to get wrong
  • 12. Bad OKR examples ● Written vaguely, talk mostly about building and launching products ● Difficult to quantify - impact assessment is a challenge ● Not-aligned to Customer success or happiness ● Not aligned to core Business unit goals
  • 13. Example - Build XYZ feature to improve customer engagement - Introducing ABC capability in the system - Launch and roll-out feature on X number of users Why are they bad? - Building is not an OKR. It doesn’t solve a business goal. The outcome needs to be measurable to assess impact - Launching and rolling-out is in your control. What does that launch and roll-out achieve? What was your goal?
  • 14. Product Consideration: Razorpay Thirdwatch and Instant Refunds
  • 15. Core Instant Refunds OKR: - Reduce end-to-end Refund time to X seconds - Reduce 99th Percentile refund processing time to less than X minutes - Achieve Y% coverage on total payment channels for Instant Refunds Core Razorpay Thirdwatch OKRs: - Achieve an overall X% Precision and Y% Recall for the Core AI Engine on RTO Prediction - Increase overall approval rate for Thirdwatch red-flagged Orders by Z% on Core AI engine Good OKR examples
  • 16. Okay, I’ve set the OKRs, now what? 1. Sell OKRs to stakeholders. Thump your chest. Shout. Mail people. Inform them. Get a sign-off. Execution should only start till you get an agreement. 2. Do step 1 again till it’s clear to <i>everyone</i> what you’re doing. Note: Good product organisations rely heavily on OKRs for cross-functional alignment. It’s a great way to ensure collaboration at scale in high growth products
  • 18. Understanding your Metrics Data is your best friend: Understand how it flows in your product. Understand if it captures your customer behaviour Litmus Test of any Product metric: ● Question the existing conventions floating in the Org for the same ● Think in terms of levels of information conveyed by a Metric ● Movement of the Metric: True and False Impact Scenarios
  • 19. For Example: Refunds in Razorpay - Success rates of Refunds are always above 99.9%. - Success Rate becomes a vanity metric - Smarter Metric to Measure: 95th, 99th Percentile for total time of Refund processing [L1 Metric] - Align Operations and Tech to solve for reduction of TAT at Payment Gateway level itself [L2, L3 Metrics]
  • 20. Understanding your Metrics - (Contd.) ● Think: Alignment of Metric the context of Activation, Engagement, Retention and Monetisation goals of the user/product For Example: Razorpay Thirdwatch: AI Engine Performance - How to measure? - Effect of False Positives: Reduced customer trust on the product - Coverage on total Frauds identified: Denotes reduction in cost by the product
  • 21. Okay, I know a lot about Metrics. But where will that help me? The Data Discipline - Product Focus: Are we really solving the problem? - Problem Discovery: Is there something that we are missing?
  • 22. Okay, I know a lot about Metrics. But where will that help me? Tip: - Define dashboards for your key product Metrics: - Set it up on your BI tool or redash or run a query yourself. Doesn’t matter. - This should be a no-effort view of the key product metrics - Most BI tools have a Slack integration. Leverage that. - Publish Weekly Reports to all stakeholders on key metrics update
  • 24. 1. PRDs are not just meant for Engineers: They’re meant for everyone. 2. Lengthy. Bulky. Tough to gather a quick 10,000ft. View of the solution The Problem with Product Requirement Documents Length of your document Likelihood that your Sales team will ever read it
  • 25. Introducing Concept Notes and User Stories Concept Note 7-8 Page Doc that briefly covers - ● Problem Statement ● Goals and Non-Goals of the Product ● Customers ● Assumptions ● Alternate Solutions ● Solution Summary in Flowcharts/high-level diagrams ○ Edge-cases to be handled ○ Happy/Unhappy Flows ● Impact Assessment and Metrics ● Future Scope Note: This needs to be written in a highly readable language by ANYONE in the Organisation
  • 26. User Stories Detailed Solution Requirements, broken down at an actionable engineering task level. 1. All configurations you’d want to see on the Product 2. User Flow breakdown in the format: a. “As a User X I want to see Y Functionality in the product” b. This is further accompanied by Acceptance Criteria of the Product 3. Easy for you to bargain with Engineering on execution
  • 27. Advantages of User Stories - Concept Note Framework over PRDs: - A small cluster of User Stories => Easy to Communicate - A fast barebones MVP Launch of the Product - Non-Technical folks in Company can consume Concept Note to understand solution - Incremental changes in the Product => Gradual Scale-up stories, added on top of the MVP configs itself - Direct Translation of a User Story into JIRA tickets - [Engineers are definitely going to hate you for that tbh, but great for bargaining on Timelines]
  • 28. GTM - 101 That one thing that you’ll definitely get wrong at least once in your career
  • 29. Launching a Product 1. Product Launch Strategy needs to be part of your Product Conceptualisation 2. Heavily reliant on multiple things going right at the same time 3. Like OKRs, quite easy to screw up but with little or no chance of recovery
  • 30. Tenets of a poorly planned Product Launch 1. Uncertainty in timelines 2. Lack of Awareness of Key product stakeholders : Marketing, Sales & Operations This leads to: ● Release without Product being ready = High number of inbound requests and angry customers, frustrated Product Operations ● Product ready but no GTM = Stagnant Product OKRs; lack of excitement; dull release
  • 31. Tenets of a good Product Launch 1. Everyone: Marketing, Sales, Operations, Engineering is certain on the timelines 2. Adherence to the GTM Strategy decided during conceptualisation 3. Channels for customer acquisition and product discovery are set 4. Relevant Knowledge Transfer sessions are completed before Product release 5. Channels for Product Feedback are defined a. Metrics are visible from Day-0 b. MVP/Pilot Customers
  • 32. Tl;dr It’s mostly about good communication. At all levels.
  • 33. Next Level Lessons an executed GTM will teach you: 1. Understanding difference between Product-Marketing and Product & Marketing 2. Success of Product == Happy Users; How to avoid Vanity Metrics from Product Launches a. Early Traction != Product Success 3. Importance of Retention: Identify Secondary and Tertiary Retention Metrics a. D-7, 14, 30 Activity of Users b. Upsell of other products and core product usage c. Understand Product Growth
  • 34. Case Study: Launch At Scale for Instant Refunds Strategy focused on fast scale-up: 1. MVP Launch for Key Client ABC - Barebones product launch with minimal features 2. Post MVP, Product components that were refined for Phase 1&2 roll-outs a. Alignment of Docs for Integration b. No-Code Integration KTs for Sales and Key-Accounts teams c. KT Sessions for Marketing and Operations to manage inbound traction d. Post that, parallel execution on Social Media, Ad Campaigns 3. Selling to existing customers vs Selling to new customers a. Product Discoverability b. Self-serve enablement Introduction at scale in Product flow
  • 35. Case Study: Launch At Scale for Razorpay Thirdwatch Key Product Challenges: 1. Diverse Customer Persona a. SME b. Mid-Segment E-Commerce c. Enterprises 2. High Education product: a. Figuring out correct branding language for Marketing b. Sales Training: Keyword driven Sales pitches 3. Pre-Product Market Fit Problem Discovery: a. Mainly driven by Customer Interviews b. Bets on Ideas that increase early Product engagement
  • 37. How to become a better Product Manager? - Figuring out the Framework - Figuring out the discipline - Staying Motivated - Awareness: The X-Factor
  • 38. Framework Discovery Ways of looking at the Problem: - Discover Users - Discover Metrics - Set goals. With Conviction. ● Top-down vs Bottom-up Strategy ● Inside-Out vs Outside-In
  • 39. Framework Discovery Examples ● Refunds Problem ● Reconciliation Challenges ● Thirdwatch User Persona Discovery
  • 40. The Discipline Toughest to Crack - Start with Data - Calendar driven day - Limit extra communication - Prioritise Execution time and Problem discovery time
  • 41. Motivation It’s easy to face a burn out as a PM. Avoid that at all cost. ● Work smartly - Efficiency is critical ● Mentally prepare yourself for the following scenarios: ○ Stagnant metrics ○ Bugs in Production ○ Angry customers ○ Internal Escalations ● Also, do follow Naval Ravikant on Twitter
  • 42. Awareness: The X-Factor Effective Modes of Learnings - Twitter: Tech-Twitter has some really smart folks from the valley - Easy to get recommended Blogs, Articles from Twitter itself - Books: Learn to read fast and learn more Note: Exploring Podcasts these days. So, no recommendation yet.
  • 43. People/Accounts to follow on Twitter for Product Management related gyan - Shreyas Doshi (@shreyas) - Eugene Wei (@eugenewei) - Andrew Chen (@andrewchen) - TheProductFolks (@TheProductfolks) - Diwakar Kaushik (@Pentropy) - Ankit (@ankitkr0) - Palak Zatakia (@palakzat) - Vindhya C (@vindytalks)
  • 44. Some books that’ll really help you out [dynamic list] - Good Strategy/Bad Strategy - Richard Rumlet - Super Thinking - Gabriel Weinberg - The Lean Startup - Eric Ries - Crossing the Chasm - Geoffrey R Moore - Sprint - Jake Knapp - Don’t Make Me Think - Steve Krug
  • 45. Fin.