django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
•
8 j'aime•2,501 vues
'django-lean' is an open source a/b split-test experimentation framework for Django. 'django-lean' was created by Akoha, a Montreal-based startup building the world's first social reality game. This presentation was delivered on September 30th, 2009 at Montreal Python 9, by Erik Wright, Director of Engineering for Akoha. For further details visit: http://bitbucket.org/akoha/django-lean/ http://akoha.com http://twitter.com/erikwright
Recommandé
Contenu connexe
Similaire à django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
Similaire à django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9 (20)
Dernier
Dernier (20)
django-lean, Akoha's open-source a/b experimentation framework @ Montreal Python 9
- 1. django-lean An open-source framework for performing and analyzing a/b split-test experiments in Django
- 2. 60 sec. intro to split testing
- 3. What is split testing? A technique for comparing two alternative implementations Done properly, allows you to eliminate other variables For the gory details, seehttp://elem.com/~btilly/effective-ab-testing/
- 4. Why do people split test? Improve conversion, ARPU, or other key metrics systematically Eliminate guesswork and opinions Determine, scientifically, which implementation is best Test your hypotheses
- 9. Python
- 10. Django template
- 11. JavaScript In your HTML template: In your JavaScript:
- 12. Reports
- 13. future
- 14. Wishlist Experimentation improvements Multivariate testing Arbitrary numbers of test cases Tools for automated (integration, unit, ...) testing Support more test scenarios Conversion funnels Decoupling from Django More “Lean Startup” tools Cohort analysis In-site surveys (net promoter score, etc.)
- 15. Find out more: http://bitbucket.org/akoha/django-lean/ http://akoha.com erik@erikwright.com / @erikwright
Notes de l'éditeur
- Erik Wright, Dir. Eng @ AkohaHere to present django-leanAkoha’s recently open-sourced split-testing framework for Django
- A tool for measuring differences between alternative implementations* font sizes, texts, prices, images, and so on.Recently, use for measuring effectiveness of new features and enhancements is gainingSimultaneously run both implementations,randomly assign users to one or the other, compare performance
- Rarely confident of the impact our changes will have on users / customersEven when confident, sometimes we are dead wrongSplit testing reduces the risk of wrong decisions / find, correct, and learn from mistakes quickly.
- Trivially implement split-test experiments in Javascript, Django Templates, PythonMeasures user performance according to metrics you defineGenerates and publishes nightly reports of experiment resultsIncluding calculating statistical significance so that you know when you can stop testingThanks to django-admin, starting, stopping, and promoting tests is easy
- Now that I’ve told you what django-lean can do, allow me to show you