SlideShare a Scribd company logo
1 of 67
Experimentation
is
Håkan Forss, Agile Coach @ King, @hakanforss
© King.com Ltd 2015 – Commercially confidential
Håkan Forss
Agile Coach
@hakanforss
© King.com Ltd 2015 – Commercially confidential
We make great games
About King
Page 3
© King.com Ltd 2015 – Commercially confidential Page 4
Some stats and facts
1.000.000.000.000
474 million monthly active
users around the world
(Q3 2015)
Approximately 1.4 billion
average daily game plays across
our games (Q3 2015)
More than 1 trillion levels played!
3 games in the top 15 grossing games
on the Apple App Store and on Google Play in the US in Q3 2015
About King
© King.com Ltd 2015 – Commercially confidential
We make great games
About King
Page 5
1600Employees (approx. Q3 2015)
King has offices and studios in
Stockholm, London, Barcelona,
Bucharest, Malmo, Berlin,
Singapore, Seattle, San
Francisco, Malta, Tokyo, Seoul
and Shanghai.
© King.com Ltd 2015 – Commercially confidential
The evolution of King
About King
Page 6
• Founded in 2003
• Originally games were only
available through our site and
portals including AOL and
Yahoo!
Online skill Social Mobile
• Launched first game on
Facebook in Q2 2011
• Launched first game on mobile
H2 2012
Experimentation is
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
experiment
Verb /ɪkˈsper.ɪ.ment/
to try something in order
to discover what it is like
or find out more about it.
What is an Experiment?
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
experiment
Verb /ɪkˈsper.ɪ.ment/
to try something in order
to discover what it is like
or find out more about it.
What is an Experiment?
Good enough for now,
safe enough to try!
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
Thank you
© King.com Ltd 2015 – Commercially confidential
Puff
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
Oh, I did NOT
expect that!
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
The sound of learning
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
© King.com Ltd 2015 – Commercially confidential
Hypothesis
Prediction
Experiment
Observation
Learning
© King.com Ltd 2015 – Commercially confidential
Prediction
Observation
Observation
+
Δ
-
Δ
Hypothesis
© King.com Ltd 2015 – Commercially confidential
Expect at least 50% of the experiments
should not give the expected result
This is when we REALLY learn!
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
#fail
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
#fail
First Attempt In Learning
© King.com Ltd 2015 – Commercially confidential Page 19
© King.com Ltd 2015 – Commercially confidential
It was a cold day in January…
Experimentation in CCSS
Page 21
Ideas
How can we make the game more fun?
How can we help players more to beat challenges?
© King.com Ltd 2015 – Commercially confidential
Experimentation in CCSS
Page 22
Ideas
What is fun and helpful to players?
© King.com Ltd 2015 – Commercially confidential
The team came up with…
Experimentation in CCSS
Page 23
Hello there sir!
Ideas
© King.com Ltd 2015 – Commercially confidential
Build the MVP
Experimentation in CCSS
Page 24
Ideas
BUILD IT
Sprinkleshell
© King.com Ltd 2015 – Commercially confidential
Experimentation in CCSS
Page 25
Ideas
BUILD IT
Release
it!
Release it! - Test it in the market!
© King.com Ltd 2015 – Commercially confidential
Experimentation in CCSS
Page 26
Is it easy to understand how to use the sidekick?
Do players really use it once they understand how-to?
Ideas
BUILD IT!
Release
it!
MEASURE IT!
MEASURE IT! – does it work?
© King.com Ltd 2015 – Commercially confidential
Experimentation in CCSS
Page 27
Ideas
BUILD IT!
Release
it!
MEASURE IT!
Analyze
it!
Analyze it! - Feedback from players
© King.com Ltd 2015 – Commercially confidential
Players do like and use it only if they understand how-to
What did we learn?
Experimentation in CCSS
Page 28
Ideas
BUILD IT!
Release
it!
MEASURE IT!
Analyze
it!
LEARN
It’s hard to understand how to use
The sidekick is not visually noticeable
© King.com Ltd 2015 – Commercially confidential
Tweek it with the learning
Experimentation in CCSS
Page 29
In-game step-by-step tutorial
More visual, more attention
Ideas
BUILD IT!
Release
it!
MEASURE IT!
Analyze
it!
LEARN
Thought bubble Charge reminder
© King.com Ltd 2015 – Commercially confidential
How is it doing now?
Experimentation in CCSS
Page 30
Ideas
BUILD IT
Release
it!
MEASURE IT!
Analyze
it!
LEARN
Constant growth in Sprinkleshell usage
More than 80% of players use Sprinkleshell on a given day and level
Players use Sprinkleshell more than just a few times
Average attempts for completing hard levels decreased
© King.com Ltd 2015 – Commercially confidential Page 31
© King.com Ltd 2015 – Commercially confidential
Idea
Design &
Build it!
Verify
it!
Typical process
Page 32
Think
it!
TWEEK
IT!
Release
it!
MEASURE
IT!
Analyze
it!
LEARN
Are we
happy?
© King.com Ltd 2015 – Commercially confidential
Idea
Design &
Build it!
Verify
it!
Typical process
Page 33
Think
it!
TWEEK
IT!
Release
it!
MEASURE
IT!
Analyze
it!
LEARN
Are we
happy?
Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
A B
Usedwithpermission.CreatedbyHåkanForss@hakanforsshttp://hakanforss.wordpress.com
© King.com Ltd 2015 – Commercially confidential
Happy players
© King.com Ltd 2015 – Commercially confidential
Our main KPIs
Retention
Engagement
Monetization Conversion
Virality
© King.com Ltd 2015 – Commercially confidential
© King.com Ltd 2015 – Commercially confidential
Level monitoring
• Cohort analysis important
• Listen to your data to inform design
Culture is
© King Digital Entertainment plc 2014
Culture = ∑ ( Behaviors )
© King.com Ltd 2015 – Commercially confidential
We listen, we
learn, we share. Free to be ourselves, we
treat people like a friend.
We don’t compromise on quality.
We put our heart and soul into
everything we do.
We stand up for creativity.
We’re agile and adaptable
problem solvers.
King Values
© King.com Ltd 2015 – Commercially confidential
Recruitment
Programming skills
Experience
Open & Humble
Care & Craft
Programming skills
Experience
Open & Humble
Care & Craft
© King.com Ltd 2015 – Commercially confidential
Introduction Training
© King.com Ltd 2015 – Commercially confidential
Bootcamp
© King.com Ltd 2015 – Commercially confidential
© King.com Ltd 2015 – Commercially confidential Page 50
© King.com Ltd 2015 – Commercially confidential
Game Jams
© King.com Ltd 2015 – Commercially confidential
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential
Solving problems through experimentation and
collaboration
Develop small, incremental releases and iterate
Focus on frequent delivery to maximize learning
Transparency and visualization
Agile @ King?
© King.com Ltd 2015 – Commercially confidential 55
Agile is not a Process, It Defines Culture
© King.com Ltd 2015 – Commercially confidential 56
Team decides…
…what to ship
…how to ship
…when to ship
…and after
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential
Alignment vs Autonomy
Page 57
AutonomyAlignment
DO AS I SAY! Do whatever you
want.
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential
Alignment vs Autonomy
Page 58
High autonomyLow autonomy
LowalignmentHighalignment
Authorative
organization
Micromanaging
organization
Organization?
I hope someone
is working on
that resort...
BUILD MY
PARADISE
ISLAND!!
We need to
build a nice
paradise
island where
our visitors
can relax and
enjoy
themselves.
Innovative
organization
Dig a hole!
Let’s find the
best way to
achieve this
together.
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 59
Photos © Balazs Gardi / Red Bull Sailing Newsroom
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 60
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 61
© King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 62
Cake Artist: Lee Sin
http://cakejournal.cakejournalllc.netdna-cdn.com/wp-content/uploads/2013/08/Candy-Crush-Cake.jpg
© King.com Ltd 2015 – Commercially confidential
Creative workplace
© King.com Ltd 2015 – Commercially confidential
Placeholder for Sveav. 44 video
Thank you
© King.com Ltd 2015 – Commercially confidential
Q & AHåkan Forss
Mail: hakan.forss@king.com
Twitter: @hakanforss
Blog: http://hakanforss.wordpress.com

More Related Content

What's hot

Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...Håkan Forss
 
Toyota kata – habits for continuous improvements MIX IT 2014-04-29
Toyota kata – habits for continuous improvements MIX IT 2014-04-29Toyota kata – habits for continuous improvements MIX IT 2014-04-29
Toyota kata – habits for continuous improvements MIX IT 2014-04-29Håkan Forss
 
Toyota kata in knowledge work - European Lean Educator Conference 2014
Toyota kata in knowledge work - European Lean Educator Conference 2014Toyota kata in knowledge work - European Lean Educator Conference 2014
Toyota kata in knowledge work - European Lean Educator Conference 2014Håkan Forss
 
Make strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
Make strategy happen with Hoshin Kanri and Toyota Kata Agile AustraliaMake strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
Make strategy happen with Hoshin Kanri and Toyota Kata Agile AustraliaHåkan Forss
 
Retrospective on steroids - Toyota Kata
Retrospective on steroids - Toyota KataRetrospective on steroids - Toyota Kata
Retrospective on steroids - Toyota KataHåkan Forss
 
Toyota Kata – habits for continuous improvements Lean IT Summit 2013
Toyota Kata – habits for continuous improvements Lean IT Summit 2013Toyota Kata – habits for continuous improvements Lean IT Summit 2013
Toyota Kata – habits for continuous improvements Lean IT Summit 2013Håkan Forss
 
How to improve flow efficiency, remove the red bricks Agile2014
How to improve flow efficiency, remove the red bricks Agile2014How to improve flow efficiency, remove the red bricks Agile2014
How to improve flow efficiency, remove the red bricks Agile2014Håkan Forss
 
Flow thinking ACE! Conference 2014-06-16
Flow thinking ACE! Conference 2014-06-16Flow thinking ACE! Conference 2014-06-16
Flow thinking ACE! Conference 2014-06-16Håkan Forss
 
Stop doing Retrospective and Start your Toyota Kata
Stop doing Retrospective and Start your Toyota KataStop doing Retrospective and Start your Toyota Kata
Stop doing Retrospective and Start your Toyota KataHåkan Forss
 
Are you too busy to improve #lkse 2014-05-30
Are you too busy to improve #lkse 2014-05-30Are you too busy to improve #lkse 2014-05-30
Are you too busy to improve #lkse 2014-05-30Håkan Forss
 
The Busy Bee Paradox Agile Tour Lille 2014
The Busy Bee Paradox Agile Tour Lille 2014The Busy Bee Paradox Agile Tour Lille 2014
The Busy Bee Paradox Agile Tour Lille 2014Håkan Forss
 
The red brick cancer ACE! Conf 2013-04-16
The red brick cancer ACE! Conf 2013-04-16The red brick cancer ACE! Conf 2013-04-16
The red brick cancer ACE! Conf 2013-04-16Håkan Forss
 
The red brick cancer Lean Agile Scotland 2013-09-19
The red brick cancer Lean Agile Scotland 2013-09-19The red brick cancer Lean Agile Scotland 2013-09-19
The red brick cancer Lean Agile Scotland 2013-09-19Håkan Forss
 
Digital Copycats: Escaping Plato's Cave (SXSW17)
Digital Copycats: Escaping Plato's Cave (SXSW17)Digital Copycats: Escaping Plato's Cave (SXSW17)
Digital Copycats: Escaping Plato's Cave (SXSW17)Will Anderson
 
Cloud - AIIM Conference 2012
Cloud - AIIM Conference 2012Cloud - AIIM Conference 2012
Cloud - AIIM Conference 2012Chris Riley ☁
 

What's hot (15)

Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
Make strategy happen with hoshin kanri and toyota kata lean agile brighton 20...
 
Toyota kata – habits for continuous improvements MIX IT 2014-04-29
Toyota kata – habits for continuous improvements MIX IT 2014-04-29Toyota kata – habits for continuous improvements MIX IT 2014-04-29
Toyota kata – habits for continuous improvements MIX IT 2014-04-29
 
Toyota kata in knowledge work - European Lean Educator Conference 2014
Toyota kata in knowledge work - European Lean Educator Conference 2014Toyota kata in knowledge work - European Lean Educator Conference 2014
Toyota kata in knowledge work - European Lean Educator Conference 2014
 
Make strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
Make strategy happen with Hoshin Kanri and Toyota Kata Agile AustraliaMake strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
Make strategy happen with Hoshin Kanri and Toyota Kata Agile Australia
 
Retrospective on steroids - Toyota Kata
Retrospective on steroids - Toyota KataRetrospective on steroids - Toyota Kata
Retrospective on steroids - Toyota Kata
 
Toyota Kata – habits for continuous improvements Lean IT Summit 2013
Toyota Kata – habits for continuous improvements Lean IT Summit 2013Toyota Kata – habits for continuous improvements Lean IT Summit 2013
Toyota Kata – habits for continuous improvements Lean IT Summit 2013
 
How to improve flow efficiency, remove the red bricks Agile2014
How to improve flow efficiency, remove the red bricks Agile2014How to improve flow efficiency, remove the red bricks Agile2014
How to improve flow efficiency, remove the red bricks Agile2014
 
Flow thinking ACE! Conference 2014-06-16
Flow thinking ACE! Conference 2014-06-16Flow thinking ACE! Conference 2014-06-16
Flow thinking ACE! Conference 2014-06-16
 
Stop doing Retrospective and Start your Toyota Kata
Stop doing Retrospective and Start your Toyota KataStop doing Retrospective and Start your Toyota Kata
Stop doing Retrospective and Start your Toyota Kata
 
Are you too busy to improve #lkse 2014-05-30
Are you too busy to improve #lkse 2014-05-30Are you too busy to improve #lkse 2014-05-30
Are you too busy to improve #lkse 2014-05-30
 
The Busy Bee Paradox Agile Tour Lille 2014
The Busy Bee Paradox Agile Tour Lille 2014The Busy Bee Paradox Agile Tour Lille 2014
The Busy Bee Paradox Agile Tour Lille 2014
 
The red brick cancer ACE! Conf 2013-04-16
The red brick cancer ACE! Conf 2013-04-16The red brick cancer ACE! Conf 2013-04-16
The red brick cancer ACE! Conf 2013-04-16
 
The red brick cancer Lean Agile Scotland 2013-09-19
The red brick cancer Lean Agile Scotland 2013-09-19The red brick cancer Lean Agile Scotland 2013-09-19
The red brick cancer Lean Agile Scotland 2013-09-19
 
Digital Copycats: Escaping Plato's Cave (SXSW17)
Digital Copycats: Escaping Plato's Cave (SXSW17)Digital Copycats: Escaping Plato's Cave (SXSW17)
Digital Copycats: Escaping Plato's Cave (SXSW17)
 
Cloud - AIIM Conference 2012
Cloud - AIIM Conference 2012Cloud - AIIM Conference 2012
Cloud - AIIM Conference 2012
 

Similar to Experimentation and Agile at King

Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016Agile Greece
 
Get Past the RFP! Persuasive Writing for Ad Agency New Business
Get Past the RFP! Persuasive Writing for Ad Agency New BusinessGet Past the RFP! Persuasive Writing for Ad Agency New Business
Get Past the RFP! Persuasive Writing for Ad Agency New BusinessFuel Lines Business Development
 
Hot ticket - Marketing Presentation
Hot ticket - Marketing PresentationHot ticket - Marketing Presentation
Hot ticket - Marketing Presentationpinkellie
 
About Simplus
About SimplusAbout Simplus
About SimplusAmy Cook
 
Survival to Thrival at KIC Silicon Valley Meet Up
Survival to Thrival at KIC Silicon Valley Meet UpSurvival to Thrival at KIC Silicon Valley Meet Up
Survival to Thrival at KIC Silicon Valley Meet UpSurvival To Thrival
 
Getting Client Buy-in
Getting Client Buy-inGetting Client Buy-in
Getting Client Buy-inLiam Hughes
 
Happy and Productive Teams: A Divine Saga
Happy and Productive Teams: A Divine SagaHappy and Productive Teams: A Divine Saga
Happy and Productive Teams: A Divine SagaTechWell
 
Epiphany Autumn Conference 2015 London
Epiphany Autumn Conference 2015 LondonEpiphany Autumn Conference 2015 London
Epiphany Autumn Conference 2015 LondonEpiphany
 
Effective Social Media Measurement Strategies
Effective Social Media Measurement StrategiesEffective Social Media Measurement Strategies
Effective Social Media Measurement StrategiesDigitasLBi Nordics
 
Content marketing-summit-southeast 5-7
Content marketing-summit-southeast 5-7Content marketing-summit-southeast 5-7
Content marketing-summit-southeast 5-7Skyword Inc.
 
Marketing at the Speed of Content: How to Keep Up in a Content-Driven World
Marketing at the Speed of Content: How to Keep Up in a Content-Driven WorldMarketing at the Speed of Content: How to Keep Up in a Content-Driven World
Marketing at the Speed of Content: How to Keep Up in a Content-Driven WorldUpwork
 
Think Agility- Empowering Your Remote Workforce: A Cprime Panel
Think Agility- Empowering Your Remote Workforce: A Cprime PanelThink Agility- Empowering Your Remote Workforce: A Cprime Panel
Think Agility- Empowering Your Remote Workforce: A Cprime PanelCprime
 
How to Cultivate Brand Advocacy - Jade Smith
How to Cultivate Brand Advocacy - Jade SmithHow to Cultivate Brand Advocacy - Jade Smith
How to Cultivate Brand Advocacy - Jade Smithmultifamily-social-media
 
Building Brand Advocacy
Building Brand AdvocacyBuilding Brand Advocacy
Building Brand AdvocacyJade Smith
 
7 Form Conversion Killers (And How to Avoid Them) - Webinar Featuring Tim Ash
7 Form Conversion Killers (And How to Avoid Them) - Webinar Featuring Tim Ash 7 Form Conversion Killers (And How to Avoid Them) - Webinar Featuring Tim Ash
7 Form Conversion Killers (And How to Avoid Them) - Webinar Featuring Tim Ash Formstack
 

Similar to Experimentation and Agile at King (20)

Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
Happy and Productive Teams | Matti Klasson | Agile Greece Summit 2016
 
Get Past the RFP! Persuasive Writing for Ad Agency New Business
Get Past the RFP! Persuasive Writing for Ad Agency New BusinessGet Past the RFP! Persuasive Writing for Ad Agency New Business
Get Past the RFP! Persuasive Writing for Ad Agency New Business
 
Hot ticket - Marketing Presentation
Hot ticket - Marketing PresentationHot ticket - Marketing Presentation
Hot ticket - Marketing Presentation
 
About Simplus
About SimplusAbout Simplus
About Simplus
 
About Simplus
About SimplusAbout Simplus
About Simplus
 
Survival to Thrival at KIC Silicon Valley Meet Up
Survival to Thrival at KIC Silicon Valley Meet UpSurvival to Thrival at KIC Silicon Valley Meet Up
Survival to Thrival at KIC Silicon Valley Meet Up
 
Getting Client Buy-in
Getting Client Buy-inGetting Client Buy-in
Getting Client Buy-in
 
Your marketing dream team upwork
Your marketing dream team   upworkYour marketing dream team   upwork
Your marketing dream team upwork
 
Happy and Productive Teams: A Divine Saga
Happy and Productive Teams: A Divine SagaHappy and Productive Teams: A Divine Saga
Happy and Productive Teams: A Divine Saga
 
Epiphany Autumn Conference 2015 London
Epiphany Autumn Conference 2015 LondonEpiphany Autumn Conference 2015 London
Epiphany Autumn Conference 2015 London
 
Effective Social Media Measurement Strategies
Effective Social Media Measurement StrategiesEffective Social Media Measurement Strategies
Effective Social Media Measurement Strategies
 
Content marketing-summit-southeast 5-7
Content marketing-summit-southeast 5-7Content marketing-summit-southeast 5-7
Content marketing-summit-southeast 5-7
 
Marketing at the Speed of Content: How to Keep Up in a Content-Driven World
Marketing at the Speed of Content: How to Keep Up in a Content-Driven WorldMarketing at the Speed of Content: How to Keep Up in a Content-Driven World
Marketing at the Speed of Content: How to Keep Up in a Content-Driven World
 
Workshop titles and samples
Workshop titles and samplesWorkshop titles and samples
Workshop titles and samples
 
Conversion Mythbusting
Conversion MythbustingConversion Mythbusting
Conversion Mythbusting
 
Lessons from the i-Beam
Lessons from the i-BeamLessons from the i-Beam
Lessons from the i-Beam
 
Think Agility- Empowering Your Remote Workforce: A Cprime Panel
Think Agility- Empowering Your Remote Workforce: A Cprime PanelThink Agility- Empowering Your Remote Workforce: A Cprime Panel
Think Agility- Empowering Your Remote Workforce: A Cprime Panel
 
How to Cultivate Brand Advocacy - Jade Smith
How to Cultivate Brand Advocacy - Jade SmithHow to Cultivate Brand Advocacy - Jade Smith
How to Cultivate Brand Advocacy - Jade Smith
 
Building Brand Advocacy
Building Brand AdvocacyBuilding Brand Advocacy
Building Brand Advocacy
 
7 Form Conversion Killers (And How to Avoid Them) - Webinar Featuring Tim Ash
7 Form Conversion Killers (And How to Avoid Them) - Webinar Featuring Tim Ash 7 Form Conversion Killers (And How to Avoid Them) - Webinar Featuring Tim Ash
7 Form Conversion Killers (And How to Avoid Them) - Webinar Featuring Tim Ash
 

More from Håkan Forss

Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...Håkan Forss
 
Busy Bee Paradox Krakow 2018-03-21
Busy Bee Paradox Krakow 2018-03-21Busy Bee Paradox Krakow 2018-03-21
Busy Bee Paradox Krakow 2018-03-21Håkan Forss
 
Kata experience experimentation form to print on a3
Kata experience experimentation form to print on a3Kata experience experimentation form to print on a3
Kata experience experimentation form to print on a3Håkan Forss
 
Reflection card to print on a4
Reflection card to print on a4Reflection card to print on a4
Reflection card to print on a4Håkan Forss
 
Toyota kata – Agile saturday x 2014 02-15
Toyota kata – Agile saturday x 2014 02-15Toyota kata – Agile saturday x 2014 02-15
Toyota kata – Agile saturday x 2014 02-15Håkan Forss
 
The red brick cancer - Modern Management Methods UK 2013 11-01
The red brick cancer - Modern Management Methods UK 2013 11-01The red brick cancer - Modern Management Methods UK 2013 11-01
The red brick cancer - Modern Management Methods UK 2013 11-01Håkan Forss
 
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013Håkan Forss
 
May the Forss be with you - Lean Kanban Centeral Europe 2012
May the Forss be with you - Lean Kanban Centeral Europe 2012May the Forss be with you - Lean Kanban Centeral Europe 2012
May the Forss be with you - Lean Kanban Centeral Europe 2012Håkan Forss
 
Lean lego – the red brick cancer
Lean lego – the red brick cancerLean lego – the red brick cancer
Lean lego – the red brick cancerHåkan Forss
 

More from Håkan Forss (10)

Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
Handout to print on a3 - Toyota kata puzzle experience Lean Digital Summit Li...
 
Busy Bee Paradox Krakow 2018-03-21
Busy Bee Paradox Krakow 2018-03-21Busy Bee Paradox Krakow 2018-03-21
Busy Bee Paradox Krakow 2018-03-21
 
Kata experience experimentation form to print on a3
Kata experience experimentation form to print on a3Kata experience experimentation form to print on a3
Kata experience experimentation form to print on a3
 
Reflection card to print on a4
Reflection card to print on a4Reflection card to print on a4
Reflection card to print on a4
 
Toyota kata – Agile saturday x 2014 02-15
Toyota kata – Agile saturday x 2014 02-15Toyota kata – Agile saturday x 2014 02-15
Toyota kata – Agile saturday x 2014 02-15
 
The red brick cancer - Modern Management Methods UK 2013 11-01
The red brick cancer - Modern Management Methods UK 2013 11-01The red brick cancer - Modern Management Methods UK 2013 11-01
The red brick cancer - Modern Management Methods UK 2013 11-01
 
The two paths
The two pathsThe two paths
The two paths
 
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
Stop doing Retrospective and start your Toyota Kata - Devoxx 2013
 
May the Forss be with you - Lean Kanban Centeral Europe 2012
May the Forss be with you - Lean Kanban Centeral Europe 2012May the Forss be with you - Lean Kanban Centeral Europe 2012
May the Forss be with you - Lean Kanban Centeral Europe 2012
 
Lean lego – the red brick cancer
Lean lego – the red brick cancerLean lego – the red brick cancer
Lean lego – the red brick cancer
 

Recently uploaded

8447779800, Low rate Call girls in Kotla Mubarakpur Delhi NCR
8447779800, Low rate Call girls in Kotla Mubarakpur Delhi NCR8447779800, Low rate Call girls in Kotla Mubarakpur Delhi NCR
8447779800, Low rate Call girls in Kotla Mubarakpur Delhi NCRashishs7044
 
Independent Call Girls Andheri Nightlaila 9967584737
Independent Call Girls Andheri Nightlaila 9967584737Independent Call Girls Andheri Nightlaila 9967584737
Independent Call Girls Andheri Nightlaila 9967584737Riya Pathan
 
MAHA Global and IPR: Do Actions Speak Louder Than Words?
MAHA Global and IPR: Do Actions Speak Louder Than Words?MAHA Global and IPR: Do Actions Speak Louder Than Words?
MAHA Global and IPR: Do Actions Speak Louder Than Words?Olivia Kresic
 
Islamabad Escorts | Call 03070433345 | Escort Service in Islamabad
Islamabad Escorts | Call 03070433345 | Escort Service in IslamabadIslamabad Escorts | Call 03070433345 | Escort Service in Islamabad
Islamabad Escorts | Call 03070433345 | Escort Service in IslamabadAyesha Khan
 
Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Seta Wicaksana
 
NewBase 19 April 2024 Energy News issue - 1717 by Khaled Al Awadi.pdf
NewBase  19 April  2024  Energy News issue - 1717 by Khaled Al Awadi.pdfNewBase  19 April  2024  Energy News issue - 1717 by Khaled Al Awadi.pdf
NewBase 19 April 2024 Energy News issue - 1717 by Khaled Al Awadi.pdfKhaled Al Awadi
 
FULL ENJOY Call girls in Paharganj Delhi | 8377087607
FULL ENJOY Call girls in Paharganj Delhi | 8377087607FULL ENJOY Call girls in Paharganj Delhi | 8377087607
FULL ENJOY Call girls in Paharganj Delhi | 8377087607dollysharma2066
 
8447779800, Low rate Call girls in New Ashok Nagar Delhi NCR
8447779800, Low rate Call girls in New Ashok Nagar Delhi NCR8447779800, Low rate Call girls in New Ashok Nagar Delhi NCR
8447779800, Low rate Call girls in New Ashok Nagar Delhi NCRashishs7044
 
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,noida100girls
 
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptxContemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptxMarkAnthonyAurellano
 
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort ServiceCall US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Servicecallgirls2057
 
Cybersecurity Awareness Training Presentation v2024.03
Cybersecurity Awareness Training Presentation v2024.03Cybersecurity Awareness Training Presentation v2024.03
Cybersecurity Awareness Training Presentation v2024.03DallasHaselhorst
 
8447779800, Low rate Call girls in Saket Delhi NCR
8447779800, Low rate Call girls in Saket Delhi NCR8447779800, Low rate Call girls in Saket Delhi NCR
8447779800, Low rate Call girls in Saket Delhi NCRashishs7044
 
Intro to BCG's Carbon Emissions Benchmark_vF.pdf
Intro to BCG's Carbon Emissions Benchmark_vF.pdfIntro to BCG's Carbon Emissions Benchmark_vF.pdf
Intro to BCG's Carbon Emissions Benchmark_vF.pdfpollardmorgan
 
International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...ssuserf63bd7
 
Investment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy CheruiyotInvestment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy Cheruiyotictsugar
 
Organizational Structure Running A Successful Business
Organizational Structure Running A Successful BusinessOrganizational Structure Running A Successful Business
Organizational Structure Running A Successful BusinessSeta Wicaksana
 
/:Call Girls In Indirapuram Ghaziabad ➥9990211544 Independent Best Escorts In...
/:Call Girls In Indirapuram Ghaziabad ➥9990211544 Independent Best Escorts In.../:Call Girls In Indirapuram Ghaziabad ➥9990211544 Independent Best Escorts In...
/:Call Girls In Indirapuram Ghaziabad ➥9990211544 Independent Best Escorts In...lizamodels9
 
2024 Numerator Consumer Study of Cannabis Usage
2024 Numerator Consumer Study of Cannabis Usage2024 Numerator Consumer Study of Cannabis Usage
2024 Numerator Consumer Study of Cannabis UsageNeil Kimberley
 

Recently uploaded (20)

8447779800, Low rate Call girls in Kotla Mubarakpur Delhi NCR
8447779800, Low rate Call girls in Kotla Mubarakpur Delhi NCR8447779800, Low rate Call girls in Kotla Mubarakpur Delhi NCR
8447779800, Low rate Call girls in Kotla Mubarakpur Delhi NCR
 
Corporate Profile 47Billion Information Technology
Corporate Profile 47Billion Information TechnologyCorporate Profile 47Billion Information Technology
Corporate Profile 47Billion Information Technology
 
Independent Call Girls Andheri Nightlaila 9967584737
Independent Call Girls Andheri Nightlaila 9967584737Independent Call Girls Andheri Nightlaila 9967584737
Independent Call Girls Andheri Nightlaila 9967584737
 
MAHA Global and IPR: Do Actions Speak Louder Than Words?
MAHA Global and IPR: Do Actions Speak Louder Than Words?MAHA Global and IPR: Do Actions Speak Louder Than Words?
MAHA Global and IPR: Do Actions Speak Louder Than Words?
 
Islamabad Escorts | Call 03070433345 | Escort Service in Islamabad
Islamabad Escorts | Call 03070433345 | Escort Service in IslamabadIslamabad Escorts | Call 03070433345 | Escort Service in Islamabad
Islamabad Escorts | Call 03070433345 | Escort Service in Islamabad
 
Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...
 
NewBase 19 April 2024 Energy News issue - 1717 by Khaled Al Awadi.pdf
NewBase  19 April  2024  Energy News issue - 1717 by Khaled Al Awadi.pdfNewBase  19 April  2024  Energy News issue - 1717 by Khaled Al Awadi.pdf
NewBase 19 April 2024 Energy News issue - 1717 by Khaled Al Awadi.pdf
 
FULL ENJOY Call girls in Paharganj Delhi | 8377087607
FULL ENJOY Call girls in Paharganj Delhi | 8377087607FULL ENJOY Call girls in Paharganj Delhi | 8377087607
FULL ENJOY Call girls in Paharganj Delhi | 8377087607
 
8447779800, Low rate Call girls in New Ashok Nagar Delhi NCR
8447779800, Low rate Call girls in New Ashok Nagar Delhi NCR8447779800, Low rate Call girls in New Ashok Nagar Delhi NCR
8447779800, Low rate Call girls in New Ashok Nagar Delhi NCR
 
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
 
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptxContemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
 
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort ServiceCall US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
 
Cybersecurity Awareness Training Presentation v2024.03
Cybersecurity Awareness Training Presentation v2024.03Cybersecurity Awareness Training Presentation v2024.03
Cybersecurity Awareness Training Presentation v2024.03
 
8447779800, Low rate Call girls in Saket Delhi NCR
8447779800, Low rate Call girls in Saket Delhi NCR8447779800, Low rate Call girls in Saket Delhi NCR
8447779800, Low rate Call girls in Saket Delhi NCR
 
Intro to BCG's Carbon Emissions Benchmark_vF.pdf
Intro to BCG's Carbon Emissions Benchmark_vF.pdfIntro to BCG's Carbon Emissions Benchmark_vF.pdf
Intro to BCG's Carbon Emissions Benchmark_vF.pdf
 
International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...
 
Investment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy CheruiyotInvestment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy Cheruiyot
 
Organizational Structure Running A Successful Business
Organizational Structure Running A Successful BusinessOrganizational Structure Running A Successful Business
Organizational Structure Running A Successful Business
 
/:Call Girls In Indirapuram Ghaziabad ➥9990211544 Independent Best Escorts In...
/:Call Girls In Indirapuram Ghaziabad ➥9990211544 Independent Best Escorts In.../:Call Girls In Indirapuram Ghaziabad ➥9990211544 Independent Best Escorts In...
/:Call Girls In Indirapuram Ghaziabad ➥9990211544 Independent Best Escorts In...
 
2024 Numerator Consumer Study of Cannabis Usage
2024 Numerator Consumer Study of Cannabis Usage2024 Numerator Consumer Study of Cannabis Usage
2024 Numerator Consumer Study of Cannabis Usage
 

Experimentation and Agile at King

  • 1. Experimentation is Håkan Forss, Agile Coach @ King, @hakanforss
  • 2. © King.com Ltd 2015 – Commercially confidential Håkan Forss Agile Coach @hakanforss
  • 3. © King.com Ltd 2015 – Commercially confidential We make great games About King Page 3
  • 4. © King.com Ltd 2015 – Commercially confidential Page 4 Some stats and facts 1.000.000.000.000 474 million monthly active users around the world (Q3 2015) Approximately 1.4 billion average daily game plays across our games (Q3 2015) More than 1 trillion levels played! 3 games in the top 15 grossing games on the Apple App Store and on Google Play in the US in Q3 2015 About King
  • 5. © King.com Ltd 2015 – Commercially confidential We make great games About King Page 5 1600Employees (approx. Q3 2015) King has offices and studios in Stockholm, London, Barcelona, Bucharest, Malmo, Berlin, Singapore, Seattle, San Francisco, Malta, Tokyo, Seoul and Shanghai.
  • 6. © King.com Ltd 2015 – Commercially confidential The evolution of King About King Page 6 • Founded in 2003 • Originally games were only available through our site and portals including AOL and Yahoo! Online skill Social Mobile • Launched first game on Facebook in Q2 2011 • Launched first game on mobile H2 2012
  • 7. Experimentation is Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 8. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com experiment Verb /ɪkˈsper.ɪ.ment/ to try something in order to discover what it is like or find out more about it. What is an Experiment?
  • 9. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com experiment Verb /ɪkˈsper.ɪ.ment/ to try something in order to discover what it is like or find out more about it. What is an Experiment? Good enough for now, safe enough to try!
  • 10. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 11. Thank you © King.com Ltd 2015 – Commercially confidential Puff Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 12. Oh, I did NOT expect that! Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 13. The sound of learning Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 14. © King.com Ltd 2015 – Commercially confidential Hypothesis Prediction Experiment Observation Learning
  • 15. © King.com Ltd 2015 – Commercially confidential Prediction Observation Observation + Δ - Δ Hypothesis
  • 16. © King.com Ltd 2015 – Commercially confidential Expect at least 50% of the experiments should not give the expected result This is when we REALLY learn!
  • 17. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com #fail
  • 18. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com #fail First Attempt In Learning
  • 19. © King.com Ltd 2015 – Commercially confidential Page 19
  • 20.
  • 21. © King.com Ltd 2015 – Commercially confidential It was a cold day in January… Experimentation in CCSS Page 21 Ideas How can we make the game more fun? How can we help players more to beat challenges?
  • 22. © King.com Ltd 2015 – Commercially confidential Experimentation in CCSS Page 22 Ideas What is fun and helpful to players?
  • 23. © King.com Ltd 2015 – Commercially confidential The team came up with… Experimentation in CCSS Page 23 Hello there sir! Ideas
  • 24. © King.com Ltd 2015 – Commercially confidential Build the MVP Experimentation in CCSS Page 24 Ideas BUILD IT Sprinkleshell
  • 25. © King.com Ltd 2015 – Commercially confidential Experimentation in CCSS Page 25 Ideas BUILD IT Release it! Release it! - Test it in the market!
  • 26. © King.com Ltd 2015 – Commercially confidential Experimentation in CCSS Page 26 Is it easy to understand how to use the sidekick? Do players really use it once they understand how-to? Ideas BUILD IT! Release it! MEASURE IT! MEASURE IT! – does it work?
  • 27. © King.com Ltd 2015 – Commercially confidential Experimentation in CCSS Page 27 Ideas BUILD IT! Release it! MEASURE IT! Analyze it! Analyze it! - Feedback from players
  • 28. © King.com Ltd 2015 – Commercially confidential Players do like and use it only if they understand how-to What did we learn? Experimentation in CCSS Page 28 Ideas BUILD IT! Release it! MEASURE IT! Analyze it! LEARN It’s hard to understand how to use The sidekick is not visually noticeable
  • 29. © King.com Ltd 2015 – Commercially confidential Tweek it with the learning Experimentation in CCSS Page 29 In-game step-by-step tutorial More visual, more attention Ideas BUILD IT! Release it! MEASURE IT! Analyze it! LEARN Thought bubble Charge reminder
  • 30. © King.com Ltd 2015 – Commercially confidential How is it doing now? Experimentation in CCSS Page 30 Ideas BUILD IT Release it! MEASURE IT! Analyze it! LEARN Constant growth in Sprinkleshell usage More than 80% of players use Sprinkleshell on a given day and level Players use Sprinkleshell more than just a few times Average attempts for completing hard levels decreased
  • 31. © King.com Ltd 2015 – Commercially confidential Page 31
  • 32. © King.com Ltd 2015 – Commercially confidential Idea Design & Build it! Verify it! Typical process Page 32 Think it! TWEEK IT! Release it! MEASURE IT! Analyze it! LEARN Are we happy?
  • 33. © King.com Ltd 2015 – Commercially confidential Idea Design & Build it! Verify it! Typical process Page 33 Think it! TWEEK IT! Release it! MEASURE IT! Analyze it! LEARN Are we happy?
  • 34. Used with permission. Created by Håkan Forss @hakanforss http://hakanforss.wordpress.com
  • 35.
  • 36. A B
  • 38. © King.com Ltd 2015 – Commercially confidential Happy players
  • 39. © King.com Ltd 2015 – Commercially confidential Our main KPIs Retention Engagement Monetization Conversion Virality
  • 40. © King.com Ltd 2015 – Commercially confidential
  • 41. © King.com Ltd 2015 – Commercially confidential Level monitoring • Cohort analysis important • Listen to your data to inform design
  • 43. © King Digital Entertainment plc 2014 Culture = ∑ ( Behaviors )
  • 44. © King.com Ltd 2015 – Commercially confidential We listen, we learn, we share. Free to be ourselves, we treat people like a friend. We don’t compromise on quality. We put our heart and soul into everything we do. We stand up for creativity. We’re agile and adaptable problem solvers. King Values
  • 45. © King.com Ltd 2015 – Commercially confidential Recruitment Programming skills Experience Open & Humble Care & Craft Programming skills Experience Open & Humble Care & Craft
  • 46. © King.com Ltd 2015 – Commercially confidential Introduction Training
  • 47. © King.com Ltd 2015 – Commercially confidential Bootcamp
  • 48. © King.com Ltd 2015 – Commercially confidential
  • 49. © King.com Ltd 2015 – Commercially confidential Page 50
  • 50. © King.com Ltd 2015 – Commercially confidential Game Jams
  • 51. © King.com Ltd 2015 – Commercially confidential
  • 52. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Solving problems through experimentation and collaboration Develop small, incremental releases and iterate Focus on frequent delivery to maximize learning Transparency and visualization Agile @ King?
  • 53. © King.com Ltd 2015 – Commercially confidential 55 Agile is not a Process, It Defines Culture
  • 54. © King.com Ltd 2015 – Commercially confidential 56 Team decides… …what to ship …how to ship …when to ship …and after
  • 55. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Alignment vs Autonomy Page 57 AutonomyAlignment DO AS I SAY! Do whatever you want.
  • 56. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Alignment vs Autonomy Page 58 High autonomyLow autonomy LowalignmentHighalignment Authorative organization Micromanaging organization Organization? I hope someone is working on that resort... BUILD MY PARADISE ISLAND!! We need to build a nice paradise island where our visitors can relax and enjoy themselves. Innovative organization Dig a hole! Let’s find the best way to achieve this together.
  • 57. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 59 Photos © Balazs Gardi / Red Bull Sailing Newsroom
  • 58. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 60
  • 59. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 61
  • 60. © King.com Ltd 2015 – Commercially confidential© King.com Ltd 2015 – Commercially confidential Page 62
  • 61. Cake Artist: Lee Sin http://cakejournal.cakejournalllc.netdna-cdn.com/wp-content/uploads/2013/08/Candy-Crush-Cake.jpg
  • 62. © King.com Ltd 2015 – Commercially confidential Creative workplace
  • 63.
  • 64.
  • 65.
  • 66. © King.com Ltd 2015 – Commercially confidential Placeholder for Sveav. 44 video
  • 67. Thank you © King.com Ltd 2015 – Commercially confidential Q & AHåkan Forss Mail: hakan.forss@king.com Twitter: @hakanforss Blog: http://hakanforss.wordpress.com