SlideShare une entreprise Scribd logo
1  sur  14
1
Sara Tresch
SVP, Digital Services
Charles Schwab
Experimentation
through Client Eyes
Charles SchwabInformation classification here (Public for events content)2
“There’s always another new
idea, another convention to
challenge, a million ways to
make investing better. We
just need to do it”
Charles Schwab, Invested 2019
Charles Schwab
Enablers Proof Points Opportunities
Information classification here (Public for events content)3
Today’s Discussion
Charles Schwab
Enablers
Information classification here (Public for events content)4
Charles Schwab
Start with a Holistic Experience
End to End
Clients come to you with a job to do.
They experience your brand thru many
different touchpoints, and an experience
design should start with this in mind.
Front to Back
Front to back experience design can be
a win-win-win. Save time for clients,
higher value rep interactions, and
operational scale.
Charles Schwab
Get it right for the Client
Information classification here (Public for events content)6
Help & Guidance Minutes Saved Client Easy Score Get Invested
A simple, focused approach creates clarity
Learn Fast to Act Fast
Continuous Discovery
Openness to change
Cross functional ideation
Client-centric goals
Continuous Delivery
Understand the hypothesis
Radical Collaboration
Ongoing Experimentation
Continuous Measurement
Deliver a Minimal Viable Solution
Fast response to client needs
Iterations based on client data
Charles Schwab
Proof Points
Information classification here (Public for events content)8
Charles Schwab
Accelerate Quality and Time
9
MVP Launch
70% Client Easy 94%
2 Design sprints 5
8 Dev sprints 2
Old Way New Way
Highly
volatile, lots of
rework
Better design that
clients LOVE
Client
frustration
Charles Schwab10
Unlock Cross Channel
Feedback Fridays
Multi-year build for B2B Experience
Recurring front line and user feedback
=> Ongoing delivery to clients and service team
=> Opportunity backlog
=> Feeds launched software tests
Charles Schwab11
Explore Big Questions…
How do we serve clients better in
digital?
“Our Digital Transformation simply means serving clients better!
That’s it. No Spin. No Complexities.”
- Walt Bettinger, President and CEO, Charles Schwab
Charles Schwab
…And Answer themFidelity&TestingValue
Storyboards
Medium # of variations
Hand Drawn Flows
Very high # of variations
Refined Screen Flows
High # of variations
Low-Fidelity Mockups
Very high # of variations
Medium-Fidelity Screens
High # of variations
Design Prototypes
Medium # of variations
Coded Prototype
Low # of variations
A/B testing
Minor Variations
Prototype Value Curve
Team ‘1’ Continuous Discovery
Charles Schwab
Opportunities
Information classification here (Public for events content)13
14
Opportunities
We are early in this journey
End to end
Experimentation
1
Turn insights into
Action
2
Improve speed
on every team
3
Empathy at Scale
4

Contenu connexe

Tendances

Introducing Program Management
Introducing Program ManagementIntroducing Program Management
Introducing Program ManagementOptimizely
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth StackOptimizely
 
Cultivating a Culture of Experimentation
Cultivating a Culture of ExperimentationCultivating a Culture of Experimentation
Cultivating a Culture of ExperimentationOptimizely
 
World Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesWorld Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesOptimizely
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8Optimizely
 
Opticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOpticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOptimizely
 
Optimizely for Developers
Optimizely for DevelopersOptimizely for Developers
Optimizely for DevelopersOptimizely
 
Optimizely Demo Deck
Optimizely Demo DeckOptimizely Demo Deck
Optimizely Demo DeckMattharth
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New WinningOptimizely
 
Definition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by OptimizelyDefinition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by OptimizelyRusseWeb
 
Optimizely x Live Demo
Optimizely x Live DemoOptimizely x Live Demo
Optimizely x Live DemoOptimizely
 
Intuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramIntuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramOptimizely
 
Maximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceMaximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceOptimizely
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Optimizely
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersOptimizely
 
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...Optimizely
 
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...Optimizely
 
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely
 
Content Targeting and Personalization: Improving Engagement at the Account Level
Content Targeting and Personalization: Improving Engagement at the Account LevelContent Targeting and Personalization: Improving Engagement at the Account Level
Content Targeting and Personalization: Improving Engagement at the Account LevelG3 Communications
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing ProgramJill Martay
 

Tendances (20)

Introducing Program Management
Introducing Program ManagementIntroducing Program Management
Introducing Program Management
 
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack[Webinar] Innovate Faster by Adopting The Modern Growth Stack
[Webinar] Innovate Faster by Adopting The Modern Growth Stack
 
Cultivating a Culture of Experimentation
Cultivating a Culture of ExperimentationCultivating a Culture of Experimentation
Cultivating a Culture of Experimentation
 
World Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ CompaniesWorld Class Optimization: Benchmarking 1,000+ Companies
World Class Optimization: Benchmarking 1,000+ Companies
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
 
Opticon 2017 Decisions at Scale
Opticon 2017 Decisions at ScaleOpticon 2017 Decisions at Scale
Opticon 2017 Decisions at Scale
 
Optimizely for Developers
Optimizely for DevelopersOptimizely for Developers
Optimizely for Developers
 
Optimizely Demo Deck
Optimizely Demo DeckOptimizely Demo Deck
Optimizely Demo Deck
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
 
Definition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by OptimizelyDefinition of A/B testing and Case Studies by Optimizely
Definition of A/B testing and Case Studies by Optimizely
 
Optimizely x Live Demo
Optimizely x Live DemoOptimizely x Live Demo
Optimizely x Live Demo
 
Intuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation ProgramIntuit - How to Scale Your Experimentation Program
Intuit - How to Scale Your Experimentation Program
 
Maximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceMaximizing Optimizely Website Performance
Maximizing Optimizely Website Performance
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into Consumers
 
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
Triple Your Experiment Velocity by Integrating Optimizely with Your Data Ware...
 
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
 
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
 
Content Targeting and Personalization: Improving Engagement at the Account Level
Content Targeting and Personalization: Improving Engagement at the Account LevelContent Targeting and Personalization: Improving Engagement at the Account Level
Content Targeting and Personalization: Improving Engagement at the Account Level
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing Program
 

Similaire à Experimentation through Clients' Eyes

Lean Startup Tools for Agile Product Teams
Lean Startup Tools for Agile Product TeamsLean Startup Tools for Agile Product Teams
Lean Startup Tools for Agile Product TeamsLitheSpeed
 
Digital Transformation Solution PowerPoint Presentation Slide
Digital Transformation Solution PowerPoint Presentation SlideDigital Transformation Solution PowerPoint Presentation Slide
Digital Transformation Solution PowerPoint Presentation SlideSlideTeam
 
Digital Transformation Solution PowerPoint Presentation Slides
Digital Transformation Solution PowerPoint Presentation SlidesDigital Transformation Solution PowerPoint Presentation Slides
Digital Transformation Solution PowerPoint Presentation SlidesSlideTeam
 
Digital Transformation Solution Powerpoint Presentation Slides
Digital Transformation Solution Powerpoint Presentation SlidesDigital Transformation Solution Powerpoint Presentation Slides
Digital Transformation Solution Powerpoint Presentation SlidesSlideTeam
 
Leanstartuptoolsforproductowners
LeanstartuptoolsforproductownersLeanstartuptoolsforproductowners
LeanstartuptoolsforproductownersRaj Indugula
 
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...constantadevelopers
 
Workshop lean startup (Open workshop)
Workshop lean startup (Open workshop)Workshop lean startup (Open workshop)
Workshop lean startup (Open workshop)Avatech Accelerator
 
Lean Startup Basics - Evidence Based Entrepreneurship
Lean Startup Basics - Evidence Based EntrepreneurshipLean Startup Basics - Evidence Based Entrepreneurship
Lean Startup Basics - Evidence Based EntrepreneurshipKelly Schwedland
 
Qualtrics-Salesforce
Qualtrics-SalesforceQualtrics-Salesforce
Qualtrics-SalesforceDaniel Wade
 
Introducing-the-Scaled-Agile-Framework-6.0.pptx
Introducing-the-Scaled-Agile-Framework-6.0.pptxIntroducing-the-Scaled-Agile-Framework-6.0.pptx
Introducing-the-Scaled-Agile-Framework-6.0.pptxFabien PETEL
 
How Enterprise SaaS Companies Justify Investment in Customer Success
How Enterprise SaaS Companies Justify Investment in Customer SuccessHow Enterprise SaaS Companies Justify Investment in Customer Success
How Enterprise SaaS Companies Justify Investment in Customer SuccessGainsight
 
Pursuing Customer Inspired Growth
Pursuing Customer Inspired GrowthPursuing Customer Inspired Growth
Pursuing Customer Inspired GrowthKearney
 
Tech Talk: Measuring Innovation
Tech Talk: Measuring InnovationTech Talk: Measuring Innovation
Tech Talk: Measuring InnovationCA Technologies
 
User Research: The Superpower Behind Experimentation Programs | VWO Webinars
User Research: The Superpower Behind Experimentation Programs | VWO WebinarsUser Research: The Superpower Behind Experimentation Programs | VWO Webinars
User Research: The Superpower Behind Experimentation Programs | VWO WebinarsVWO
 
Differentiating your professional services in a flat economy
Differentiating your professional services in a flat economyDifferentiating your professional services in a flat economy
Differentiating your professional services in a flat economyChangepoint
 
9 Steps to a World-Class VoC Program
9 Steps to a World-Class VoC Program9 Steps to a World-Class VoC Program
9 Steps to a World-Class VoC ProgramQualtrics
 
Empired Convergence 2017 - Transforming you customer experience
Empired Convergence 2017 - Transforming you customer experienceEmpired Convergence 2017 - Transforming you customer experience
Empired Convergence 2017 - Transforming you customer experienceEmpired
 
Cloudslate Berkeley Final Presentation
Cloudslate Berkeley Final PresentationCloudslate Berkeley Final Presentation
Cloudslate Berkeley Final PresentationStanford University
 
CloudSlate Lean LaunchPad Berkeley Haas School of Business
CloudSlate Lean LaunchPad Berkeley Haas School of BusinessCloudSlate Lean LaunchPad Berkeley Haas School of Business
CloudSlate Lean LaunchPad Berkeley Haas School of Businessmcharafeddine
 

Similaire à Experimentation through Clients' Eyes (20)

Lean Startup Tools for Agile Product Teams
Lean Startup Tools for Agile Product TeamsLean Startup Tools for Agile Product Teams
Lean Startup Tools for Agile Product Teams
 
Digital Transformation Solution PowerPoint Presentation Slide
Digital Transformation Solution PowerPoint Presentation SlideDigital Transformation Solution PowerPoint Presentation Slide
Digital Transformation Solution PowerPoint Presentation Slide
 
Digital Transformation Solution PowerPoint Presentation Slides
Digital Transformation Solution PowerPoint Presentation SlidesDigital Transformation Solution PowerPoint Presentation Slides
Digital Transformation Solution PowerPoint Presentation Slides
 
Digital Transformation Solution Powerpoint Presentation Slides
Digital Transformation Solution Powerpoint Presentation SlidesDigital Transformation Solution Powerpoint Presentation Slides
Digital Transformation Solution Powerpoint Presentation Slides
 
Leanstartuptoolsforproductowners
LeanstartuptoolsforproductownersLeanstartuptoolsforproductowners
Leanstartuptoolsforproductowners
 
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
Teodora Moraru, Virtono & CGO admin tools - STARTUP financing and MVP develop...
 
Workshop lean startup (Open workshop)
Workshop lean startup (Open workshop)Workshop lean startup (Open workshop)
Workshop lean startup (Open workshop)
 
Lean Startup Basics - Evidence Based Entrepreneurship
Lean Startup Basics - Evidence Based EntrepreneurshipLean Startup Basics - Evidence Based Entrepreneurship
Lean Startup Basics - Evidence Based Entrepreneurship
 
Qualtrics-Salesforce
Qualtrics-SalesforceQualtrics-Salesforce
Qualtrics-Salesforce
 
Introducing-the-Scaled-Agile-Framework-6.0.pptx
Introducing-the-Scaled-Agile-Framework-6.0.pptxIntroducing-the-Scaled-Agile-Framework-6.0.pptx
Introducing-the-Scaled-Agile-Framework-6.0.pptx
 
How Enterprise SaaS Companies Justify Investment in Customer Success
How Enterprise SaaS Companies Justify Investment in Customer SuccessHow Enterprise SaaS Companies Justify Investment in Customer Success
How Enterprise SaaS Companies Justify Investment in Customer Success
 
Pursuing Customer Inspired Growth
Pursuing Customer Inspired GrowthPursuing Customer Inspired Growth
Pursuing Customer Inspired Growth
 
Tech Talk: Measuring Innovation
Tech Talk: Measuring InnovationTech Talk: Measuring Innovation
Tech Talk: Measuring Innovation
 
How to Thrive in a Post-AOR World
How to Thrive in a Post-AOR WorldHow to Thrive in a Post-AOR World
How to Thrive in a Post-AOR World
 
User Research: The Superpower Behind Experimentation Programs | VWO Webinars
User Research: The Superpower Behind Experimentation Programs | VWO WebinarsUser Research: The Superpower Behind Experimentation Programs | VWO Webinars
User Research: The Superpower Behind Experimentation Programs | VWO Webinars
 
Differentiating your professional services in a flat economy
Differentiating your professional services in a flat economyDifferentiating your professional services in a flat economy
Differentiating your professional services in a flat economy
 
9 Steps to a World-Class VoC Program
9 Steps to a World-Class VoC Program9 Steps to a World-Class VoC Program
9 Steps to a World-Class VoC Program
 
Empired Convergence 2017 - Transforming you customer experience
Empired Convergence 2017 - Transforming you customer experienceEmpired Convergence 2017 - Transforming you customer experience
Empired Convergence 2017 - Transforming you customer experience
 
Cloudslate Berkeley Final Presentation
Cloudslate Berkeley Final PresentationCloudslate Berkeley Final Presentation
Cloudslate Berkeley Final Presentation
 
CloudSlate Lean LaunchPad Berkeley Haas School of Business
CloudSlate Lean LaunchPad Berkeley Haas School of BusinessCloudSlate Lean LaunchPad Berkeley Haas School of Business
CloudSlate Lean LaunchPad Berkeley Haas School of Business
 

Plus de Optimizely

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationOptimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing RightOptimizely
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleOptimizely
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Optimizely
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsOptimizely
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Optimizely
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingOptimizely
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideOptimizely
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOptimizely
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...Optimizely
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueOptimizely
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubOptimizely
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely
 
The Future of Software Development
The Future of Software DevelopmentThe Future of Software Development
The Future of Software DevelopmentOptimizely
 
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...Optimizely
 
Using Empathy to Build Custom Solutions at Scale
Using Empathy to Build Custom Solutions at ScaleUsing Empathy to Build Custom Solutions at Scale
Using Empathy to Build Custom Solutions at ScaleOptimizely
 
How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact Optimizely
 
Targeted Rollouts: How to Release Features to Multiple Audiences
Targeted Rollouts: How to Release Features to Multiple AudiencesTargeted Rollouts: How to Release Features to Multiple Audiences
Targeted Rollouts: How to Release Features to Multiple AudiencesOptimizely
 
Deploying Fearlessly in a Continuous World
Deploying Fearlessly in a Continuous WorldDeploying Fearlessly in a Continuous World
Deploying Fearlessly in a Continuous WorldOptimizely
 
Detecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsDetecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsOptimizely
 

Plus de Optimizely (20)

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
 
The Future of Software Development
The Future of Software DevelopmentThe Future of Software Development
The Future of Software Development
 
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
Practical Use Case: How Dosh Uses Feature Experiments To Accelerate Mobile De...
 
Using Empathy to Build Custom Solutions at Scale
Using Empathy to Build Custom Solutions at ScaleUsing Empathy to Build Custom Solutions at Scale
Using Empathy to Build Custom Solutions at Scale
 
How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact
 
Targeted Rollouts: How to Release Features to Multiple Audiences
Targeted Rollouts: How to Release Features to Multiple AudiencesTargeted Rollouts: How to Release Features to Multiple Audiences
Targeted Rollouts: How to Release Features to Multiple Audiences
 
Deploying Fearlessly in a Continuous World
Deploying Fearlessly in a Continuous WorldDeploying Fearlessly in a Continuous World
Deploying Fearlessly in a Continuous World
 
Detecting incorrectly implemented experiments
Detecting incorrectly implemented experimentsDetecting incorrectly implemented experiments
Detecting incorrectly implemented experiments
 

Dernier

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Steffen Staab
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech studentsHimanshiGarg82
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️Delhi Call girls
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxComplianceQuest1
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension AidPhilip Schwarz
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...ICS
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave
 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionSolGuruz
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️Delhi Call girls
 
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...kalichargn70th171
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdfPearlKirahMaeRagusta1
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfproinshot.com
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comFatema Valibhai
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplatePresentation.STUDIO
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...Health
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsAndolasoft Inc
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024Mind IT Systems
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providermohitmore19
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Modelsaagamshah0812
 

Dernier (20)

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
 
8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students8257 interfacing 2 in microprocessor for btech students
8257 interfacing 2 in microprocessor for btech students
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
A Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docxA Secure and Reliable Document Management System is Essential.docx
A Secure and Reliable Document Management System is Essential.docx
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
 
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...
 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with Precision
 
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️
 
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
The Guide to Integrating Generative AI into Unified Continuous Testing Platfo...
 
Define the academic and professional writing..pdf
Define the academic and professional writing..pdfDefine the academic and professional writing..pdf
Define the academic and professional writing..pdf
 
Exploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdfExploring the Best Video Editing App.pdf
Exploring the Best Video Editing App.pdf
 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.js
 
10 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 202410 Trends Likely to Shape Enterprise Technology in 2024
10 Trends Likely to Shape Enterprise Technology in 2024
 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
 
Unlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language ModelsUnlocking the Future of AI Agents with Large Language Models
Unlocking the Future of AI Agents with Large Language Models
 

Experimentation through Clients' Eyes

  • 1. 1 Sara Tresch SVP, Digital Services Charles Schwab Experimentation through Client Eyes
  • 2. Charles SchwabInformation classification here (Public for events content)2 “There’s always another new idea, another convention to challenge, a million ways to make investing better. We just need to do it” Charles Schwab, Invested 2019
  • 3. Charles Schwab Enablers Proof Points Opportunities Information classification here (Public for events content)3 Today’s Discussion
  • 4. Charles Schwab Enablers Information classification here (Public for events content)4
  • 5. Charles Schwab Start with a Holistic Experience End to End Clients come to you with a job to do. They experience your brand thru many different touchpoints, and an experience design should start with this in mind. Front to Back Front to back experience design can be a win-win-win. Save time for clients, higher value rep interactions, and operational scale.
  • 6. Charles Schwab Get it right for the Client Information classification here (Public for events content)6 Help & Guidance Minutes Saved Client Easy Score Get Invested A simple, focused approach creates clarity
  • 7. Learn Fast to Act Fast Continuous Discovery Openness to change Cross functional ideation Client-centric goals Continuous Delivery Understand the hypothesis Radical Collaboration Ongoing Experimentation Continuous Measurement Deliver a Minimal Viable Solution Fast response to client needs Iterations based on client data
  • 8. Charles Schwab Proof Points Information classification here (Public for events content)8
  • 9. Charles Schwab Accelerate Quality and Time 9 MVP Launch 70% Client Easy 94% 2 Design sprints 5 8 Dev sprints 2 Old Way New Way Highly volatile, lots of rework Better design that clients LOVE Client frustration
  • 10. Charles Schwab10 Unlock Cross Channel Feedback Fridays Multi-year build for B2B Experience Recurring front line and user feedback => Ongoing delivery to clients and service team => Opportunity backlog => Feeds launched software tests
  • 11. Charles Schwab11 Explore Big Questions… How do we serve clients better in digital? “Our Digital Transformation simply means serving clients better! That’s it. No Spin. No Complexities.” - Walt Bettinger, President and CEO, Charles Schwab
  • 12. Charles Schwab …And Answer themFidelity&TestingValue Storyboards Medium # of variations Hand Drawn Flows Very high # of variations Refined Screen Flows High # of variations Low-Fidelity Mockups Very high # of variations Medium-Fidelity Screens High # of variations Design Prototypes Medium # of variations Coded Prototype Low # of variations A/B testing Minor Variations Prototype Value Curve Team ‘1’ Continuous Discovery
  • 13. Charles Schwab Opportunities Information classification here (Public for events content)13
  • 14. 14 Opportunities We are early in this journey End to end Experimentation 1 Turn insights into Action 2 Improve speed on every team 3 Empathy at Scale 4