Samuel and Robert share tips about how best to use A/B tests for UX.



Download Episode

Notes

Play-by-Play

Samuel cares about Robert, but Robert is all business

Other people care about us too!

Crushing SERP Dopplegangers vs Living in their shadow

Do we endeavor to make podcast history? (Spoiler: We don’t)

Announcing the topic!

The pronunciation of bouillabaisse

Pranks for digital natives

The difference between A/B testing, split testing, and multivariate testing

More bouillabaisse breakdown

A radical shift to the episode format?

What defines a significant split test?

Samuel cautions against boiling the A/B ocean

How you can align A/B testing with your users’ success

Things that are like jazz (e.g. this podcast)

The ins & outs of hypotheses

On the segmenting & cohort-ing of test subjects

Robert Graham: The People’s Champion

Samuel gets controversial with a “controversial do”

A brief history of the hill climbing metaphor & local maxima

Out comes The Hot Seat™!!

Hilbert: A star is born

Robert advises not to throw the baby out with the bathwater

Samuel questions whether the bathwater even needs to be thrown out in the first place

On measuring and inspiration and the relation thereof

Radical format change: The Tomb of the Unknown Tip!

User Onboarding: the perfect place for A/B suckers

Samuel gets his science tips from children’s television

http://mcfunley.com/design-for-continuous-experimentation

https://medium.com/designing-for-results/in-defense-of-the-humble-local-maximum-2e53e61301df

https://medium.com/designing-for-results/dont-blame-the-tool-aadbe3465dc4

http://engineering.indeed.com/blog/2013/05/indeedeng-data-driven-product-design-slides-video/

PBS, Dinosaurs, and a Hypothesis