Learning about Campaign Optimization

Billy's Blog @

• Home
• Lesson Guide
• Optimization Glossary
• Disclaimer
• About

Terminology

An Essential Primer on Full and Fractional Factorial Test Design

What are full and fractional factorial test designs? How do they relate to optimization and what about interactions?
Once you get down and dirty with testing, these questions matter. Whether selecting an optimization platform or trying to thoroughly understand the tests you are building, grasping these concepts will put you in greater control and allow you [...]

Interactions

I’ve written an extended definition for interactions in preparation for a long post about full and fractional factorial. Understanding interactions is a critical part to understanding full and fractional factorial also. I look forward to clearing up some misconceptions about fractional factorial test design. Hopefully I’ll have the post done next week.
CC photo [...]

Optimization Glossary

Someone at the office has put together a great glossary, so I modified it slightly and have posted the glossary as its own page (it has a tab dedicated to it above now.) It is in a usable but not optimal form right now, so I’ll be updating it every now and then. [...]

What is Taguchi? How does it relate to testing?

Multivariate testing is a buzz word these days, but the buzzword of multivariate testing seems to be Taguchi. However, that term is being abused. Do you know what Taguchi really means? I wasn’t even positive, so to get some background, I did some research and talked with Vladimir (Widemile’s Chief Scientist).
The name and [...]

Google Optimizer is slow (or Not all Multivariate Testing is the same)

Without knowing it, people might assume that there’s only one method to multivariate testing. That it has been long figured out by math and statistic wizards. I have learned otherwise from Widemile’s personal math wizard, Chief Scientist, Vladimir Brayman.
(Just as a side note, he does not have a typical office. Rather than [...]

Multivariate testing: a quick primer

Want to quickly get up to speed on multivariate testing? This post is designed to help you grasp the basics of multivariate testing so that you can get started talking and even doing your own tests. While its hard to design great tests, it’s easy to get good results with only a little [...]

5 quick tips to effective A/B and split testing

While multivariate might be the hottest testing subject, you can’t beat a good split test in certain situations.
If you already know the difference between A/B and split tests, skip this part, otherwise it’s a quick read.
A/B testing is when you test one page then replace it with a new page, so the two versions are [...]

Two types of tests (and I’m not talking MV or Split)

There are a lot of things to know to be a pro at testing, so I’ll cover some of the basics every week. Hopefully I’ll have a nice inventory of posts that can be used as a resource for you or anyone else to quickly learn the testing language and methods.
A good starting point [...]