A Crash Course in A/B Testing: Or, How to Tell If You’re Accomplishing Anything

This is a deck I’ve been using over the past few months to teach the product, program, business development, and marketing folks at RunKeeper about some of the perils and pitfalls of A/B testing. I intended it to be a good first step for people interested in testing but without much background in statistics. Enjoy!

(By the way, if you’re comfortable with IPython and would like to play around with the sample size calculations described on Slide 12, here is the IPython notebook that I put together to run the numbers.)


Nicholas Arcolano

Senior Data Scientist at TrueMotion. Formerly Runkeeper, MIT Lincoln Laboratory, Harvard SEAS Ph.D. Loves running, though it doesn't always love him back.

Leave a Reply

Your email address will not be published.