8 A/B testing mistakes every engineer should know
Written version of this video - https://posthog.com/blog/ab-testing-m...
Subscribe for more - https://www.youtube.com/@PostHog?sub_...
Get signup for PostHog for free - https://app.posthog.com/signup
More content like this - https://posthog.com/blog
Follow us on Twitter - / posthog
In this video, we go over 8 A/B testing mistakes every engineer should know and avoid.
0:00 Intro
0:12 Including unaffected users
0:52 Simpson's paradox
1:30 No predetermined duration
1:59 Not testing
2:50 Counter metrics
3:26 Seasonality
4:00 Unclear hypothesis
5:11 Relying too much on A/B tests
5:51 Outro