A/B Testing on iOS, Dealing with the AppStore, and Moving Fast
Note: I first wrote this post for KISSMetrics. Though, I wanted to keep a copy of it here.
Lately, I’ve been meeting with founders and CTOs regarding the challenges of a/b testing on iOS, and I’ve found that I’m repeating myself a lot.
Releasing frequent updates and running tests on iOS aren’t as easy as on the web: you have to push to the App Store and wait for your users to update before they even receive the experiment.
The issues regarding testing on iOS mainly involve the following:
- The App Store’s slow review process.
- Users not updating frequently enough to always be on the latest version (which is also a problem if you’re multi-platform).
- Testing features across multiple platforms and being in sync.
I believe these are just small setbacks and shouldn’t stop you from moving fast and testing your hypotheses.
At Frank & Oak, we try to follow a...
Continue reading →