1.
django-lean<br />An open-source framework for performing and analyzing a/b split-test experiments in Django<br />

2.
60 sec. intro to split testing<br />

3.
What is split testing?<br />A technique for comparing two alternative implementations<br />Done properly, allows you to eliminate other variables<br />For the gory details, seehttp://elem.com/~btilly/effective-ab-testing/<br />

4.
Why do people split test?<br />Improve conversion, ARPU, or other key metrics systematically<br />Eliminate guesswork and opinions<br />Determine, scientifically, which implementation is best<br />Test your hypotheses<br />

5.
Introducing django-lean<br />

6.
django-lean<br />Experiment<br />JavaScript<br />Django templates<br />Python<br />Measure<br />User-defined goals<br />User-defined metric<br />Analyze<br />Manage<br /><ul><li>Nightly reports

7.
Statistical significance

8.
Start, stop, and promote experiments via django-admin</li></li></ul><li>Examples<br />

9.
Python<br />

10.
Django template<br />

11.
JavaScript<br />In your HTML template:<br />In your JavaScript:<br />

12.
Reports<br />

13.
future<br />

14.
Wishlist<br />Experimentation improvements<br />Multivariate testing<br />Arbitrary numbers of test cases<br />Tools for automated (integration, unit, ...) testing<br />Support more test scenarios<br />Conversion funnels<br />Decoupling from Django<br />More “Lean Startup” tools<br />Cohort analysis<br />In-site surveys (net promoter score, etc.)<br />

15.
Find out more:<br />http://bitbucket.org/akoha/django-lean/<br />http://akoha.com<br />erik@erikwright.com / @erikwright<br />