Subscribe
Sign in
  1. Discussions
  2. A/B Testing - which tool has helped you?

A/B Testing - which tool has helped you?

Marianna
4 replies
What helps in A/B testing: 👊It needs to be run at the same time for both tests 👊Ensure the sample size is enough to tell if there was a statistically significant difference between these two variations 👊Ensure the website does get steady traffic in order for it to be statistically significant Have you seen a tool that has helped you with A/B testing?

Replies

Fabian Maume
Warmup Inbox
Warmup Inbox
VWO is quite good to run A/B test. The free plan is enough for most A/B test. I also recommend to complement A/B test with qualitative analysis using a tool like clarity or Smartlook Qualitative Analytics
Share
Yuki
Hey marianna these are great tips! Agreed that it's very important to keep things besides the variable of interest constant. What kind of volume are you typically looking for in a paid ads scenario (in terms of impressions) for statistical signficance?
Share
Marianna
Llanai
Llanai
@yukioyama Hello Yuki. It's essential to calculate the required sample size based on your experiment's specific requirements to ensure reliable results. Some experiments might require thousands or even millions of impressions to achieve statistical significance.
Share