After five days of a store listing experiment, one of your variants outperforms the current version. Why should you continue to run your experiment for at least seven days even though you think that you have enough data now?

  • You should run as many variants as possible before you make a decision.
  • You must run the experiment for at least seven days to see a recommendation in the results column.
  • You need to see an accurate reflection of weekday and weekend behavior.
  • You must run the experiment for at least 7 days to see a recommendation in the metrics-used column.

The correct answer is:

  • You need to see an accurate reflection of weekday and weekend behavior.