Kinds Of Split Testing Software

You’ve probably heard that split testing elements of your website can improve your conversion rates. And that’s true. But there are many kinds of split testing out there. And there are many ways to set up split tests on your website.

I can’t discuss every feature of every testing tool out there, but I can give you a major overview of the different kinds of split testing software.

First, there’s a difference between multivariate and single variable testing.

Simple split testing is easy. You’re just “trying stuff” one thing at a time. You want to try a different headline? Split test it. When that test finishes, you want to “try” something else? Split test that. You can test one alternative version or many. As long as it’s a single element of your page you’re testing, that’s simple split testing. All you need is a tool that rotates the different versions of the headline (or whatever) on your page, and keeps track of which one produces the most sales.

There are a few simple split testing tools available. Some are free and some cost money. Google offers a free tool, though you do have to have an Adwords, and an Analytics account to use it.

But simple split testing can be discouraging. When you test a new idea against your control version, sometimes the control version wins. In fact, it often wins. You can get a string of disappointing tests all in a row. What would it be like if you could test 10 things at once? Well, you’d be bound to find at least one or two ideas that led to improvement. And what if you could test all those ideas simultaneously with the same amount of traffic it takes to test one idea with simple split testing? Well, it sounds like magic, but that’s exactly what multivariate testing can do for you.

Among multiple variable software solutions, there are hosted plans and self-install plans. If you want to install software on your server (which can be faster and cheaper) you will have more control over your data. And you can usually find someone to install it for you (often the vendor provides this service for a nominal fee). If you want to go with a hosted plan expect to pay more.

Hosted solutions include Google’s Website Optimizer, and Vertster. Installed solutions include the Split Test Accelerator and Kaizen Track.

Taguchi testing is only one kind of multivariate testing. There are also “full factorial” tools, and random independent rotators. When you run a Taguchi test, you run only a small fraction of the possible combinations of your factor levels. You might, for instance, run only 18 pages to test 4374 combinations. This is made possible by orthongonal arrays. This allows you to find the best combination with out running through all of them. You do have to be careful about your factors interacting negatively with each other, but if you take care as you design your test, you can avoid the bulk of the problem with these. The Split Test Accelerator, Vertster, and Kaizentrack are Taguchi testing tools.

If you want to get around interaction effects you can with a full factorial tool. It will take more traffic to avoid the interactions — a lot more — but with a FFT, like Google’s Website Optimizer, you can just see how every combination plays out, and live with the interactions.

The Taguchi and full factorial tools both use arrays to maintain a relationship between the options being served for one factor, and the options being served for another. Some split testers don’t do this, though. They simply treat each factor as independent from the other factors. This leads to more flexible test designs, but also to longer and less accurate tests.

Now that’s just the overview. There are many other features to compare and questions to ask. Does a tester allow you to exclude bots and spiders? Does it allow real time access to data? What kind of reports does it show? What kind of information does it track for each visitor, and is the visitor-level data available for viewing. Etc.

Dominic DeLong has used taguchi testing software for years to improve landing pages.

No related posts.

Related posts brought to you by Yet Another Related Posts Plugin.

Tagged with: advertising • conversion rate • Copywriting • internet marketing • marketing • money • multivariate testing software • multivariate testing tools • split testing • split testing software • taguchi software • taguchi testing • taguchi testing software • web design

Filed under: money

Like this post? Subscribe to my RSS feed and get loads more!