Learning about Campaign Optimization

Billy's Blog @

• Home
• Lesson Guide
• Optimization Glossary
• Disclaimer
• About

Testing Concerns

3 difficult optimization results and what you can learn from them (3 of 3)

Note: This is the third post of a 3 part series, each focusing on one type of test result that is tough to deal with. Read the other 2 articles on highly mixed data and the original page beating the new variations.

Ready for the toughest of all test results? I brought in Widemile’s Chief [...]

3 difficult optimization results and what you can learn from them (2 of 3)

Note: This is the second post of a 3 part series, each focusing on one type of test result that is tough to deal with. Read the first article on highly mixed data.
As an optimization analyst, this is probably the hardest result to bring to a client. Oddly enough, it actually is favorable [...]

3 difficult optimization results and what you can learn from them (1 of 3)

Note: This is the first post of a 3 part series, each focusing on one type of test result that is tough to deal with.

There are 3 types of optimization results that people never look forward to getting.
Unfortunately, anyone who runs enough tests will run into these situations. In the following 3 posts I will [...]

How to get ideal test conditions (and results)

A big mistake in testing is to overlook variables inside and outside of the test that impact results. In an ideal test, the only variables would be the ones you are testing on your page. That usually isn’t possible though, but as long as you account for them in your analysis, you will [...]

3 steps to quickly make a good multivariate test

Having great testing technology puts a lot of power in your hands. You can test anything and everything you want. However, like any other tool, to use it effectively you have to use it right. There’s a lot of best practices and thought that goes into test design, but following these three [...]

What’s an average conversion rate? 40%!

Would you believe that? And if it were true, would it really mean anything to you? It shouldn’t.

I get asked this question fairly often and at first glance it seems like a logical question to ask, but really the focus should be elsewhere.
From my experience, conversion rates range from less than a percent [...]

Google Optimizer is slow (or Not all Multivariate Testing is the same)

Without knowing it, people might assume that there’s only one method to multivariate testing. That it has been long figured out by math and statistic wizards. I have learned otherwise from Widemile’s personal math wizard, Chief Scientist, Vladimir Brayman.
(Just as a side note, he does not have a typical office. Rather than [...]

SEO + Testing = Friends

One common concern with optimization is that testing content will bring down SEO. In actuality, testing will not affect SEO.
Here’s what happens, a regular visitor goes to the web page and sees an experiment, which is a version of the tested page. Google’s spiders go and only see the default content, meaning what [...]