How Etsy Handles Peeking in A/B Testing - Code as Craft

Etsy relies heavily on experimentation to improve our decision-making process. We leverage our internal A/B testing tool when...

Etsy relies heavily on experimentation to improve our decision-making process. We leverage our internal A/B testing tool when...

The biggest question in ecommerce A/B testing is not “how.”

A/B tests are controlled experiments of two attributes, to measure which one was most popular with users. You can apply A/B testing to just about anything that you can measure. Multivariate testing allows you to measure multiple variables simultaneously.

Which layout of an advertisement leads to more clicks? Would a different color or position of the purchase button lead to a higher conversion rate? Does a special offer really attract more customers – and which of two phrasings would be better? For a long time, people have…
Data Science, Machine Learning, AI & Analytics