Spotify uses metric alignment and A/B testing to optimize user experience across their many autonomous teams and platforms. Education and automation are key to ensuring widespread adoption of the aligned metrics. Presenting results from A/B tests can demonstrate how certain features and functions impact vital metrics like daily and monthly active users, and teams are organized as a people as a service model to best implement optimizations.
8. Tribes
Provide fast and
reliable access to all
the world's music
Enable high product
development speed
while maintaining a
highly available service
P P P P
Squad Squad Squad Squad
Chapter
Chapter
P P P P
Squad Squad Squad Squad
Chapter
Chapter
Our team is growing rapidly
250
30
100
10
24. 24
Make magic happen with desired metrics
Vital Sign Group A Group B
Functionality 1 +1.5% -0.5%
Functionality 2 +2.5% -3%
Functionality 3 +0.5% 0%
Functionality 4 +1% -7%
26. Summary
• Metric alignment is the most effective way of making sure the
overall experience does not suffer
• Education and Automation are key for adoption
• People as a service is a most effective way of reaching out to
teams.
27. May 20, 2014
Copyright stuff
Napster pic by bixentro, cc 2.0
http://www.flickr.com/photos/bixentro/
Busy record store pic by gomattolson
http://www.flickr.com/photos/gomattolson
Empty record store pic by passetti
http://www.flickr.com/photos/passetti/
First Frankenstein screenshot form :
“Frankenstein” movie by Kenneth Branagh, 1994
Second Frankenstein screenshot form :
“I, Frankenstein” movie by Stuart Beattie, 2014