![\"Two](\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/varianttesting-abtesting.jpg\")
<\/p>\nVariant testing is one of the best ways to find out what works for your visitors. Whether testing the location of a button, a redesigned menu, or an entirely different website, variant testing gives you a chance to have hard data behind your design decisions.<\/p>\n
Variant testing comes in two forms \u2013 A\/B testing and multivariate testing. Both of them have their use in design, whether creating a new website, testing out an email, or running a print campaign. With A\/B testing, you are comparing two variations of a single element, and with multivariate testing, you are comparing variations of multiple elements.<\/p>\n
<\/p>\n
A\/B testing (or split testing) is when you test two variations of a single item, such as changing a button from blue to red, moving images, or altering the text. You present both versions at the same time, split between your audience, and then judge the response you get based on the goals you set.<\/p>\n
Joan runs a bookstore. Her monthly newsletters are very popular, but don\u2019t result in the sales conversions she was hoping for. She can see if changing the style of the call-to-action buttons in her newsletter will result in more conversions.<\/p>\n
Dante\u2019s web hosting company is really taking off, but he\u2019s finding that many of his customers complain about how they\u2019ve ordered the wrong product. He can see if changing the product descriptions cuts down on the number of complaints.<\/p>\n
Emily has a programming blog that seems to be generating a lot of traffic, but it looks like people aren\u2019t engaging with her online courses due to the other advertising she has on her site. She can see if moving the advertising into a new location helps her customers find her courses.<\/p>\n
With each, they create two versions of the page, changing only one thing on it. They put both versions live at the same time, and wait to see what the data will tell them.<\/p>\n
A\/B testing is a great way to test single things that may have big results. If you want to see if one thing is currently causing you issues, A\/B testing gives you a way to be certain.<\/p>\n
![\"Six](\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/varianttesting-multivariate.jpg\")
<\/p>\n
Multivariate testing is when you test two variations of multiple items, spreading out the variations exponentially. While A\/B testing produces two versions of a page (each with one different thing on them), multivariate testing can produce an immense number of pages, all depending on how many items on a page you want to test.<\/p>\n
Lin\u2019s photography website is bringing in customers, but people have remarked that it can be difficult to navigate. By trying out a new menu, a new size for her images, and a colour scheme change, she\u2019s hoping to make it easier for her customers.<\/p>\n
Andrew\u2019s new organisational app is taking off, but he\u2019s wondering what might be the best way to get customers to upgrade to the paid version. Trying out different locations for his advertisements will give him a better idea about conversions.<\/p>\n
Penny\u2019s company potentially has a new logo. While it works well with the existing colour scheme, she wants to try it (and the current logo) out with a few other colour schemes as well to see if things could be better.<\/p>\n
With each, they create two versions of each element they want to test, and then create the pages needed to test out every version of the element against each other.<\/p>\n
So, for example, Lin\u2019s website has three elements she wants to test (Menu, Size, Colour). She creates two versions of each element (Menu A, Menu B, Size A, Size B, Colour A, Colour B) and then creates pages that test all the versions working together:<\/p>\n
Menu A + Size A + Colour A
\nMenu B + Size A + Colour A
\nMenu A + Size B + Colour A
\nMenu A + Size A + Colour B
\nMenu B + Size B + Colour A
\nMenu B + Size B + Colour B
\nMenu B + Size A + Colour B
\nMenu A + Size B + Colour B<\/p>\n
With only three elements being tested, there are only 23<\/sup> variations. As the number of elements increase, the variations increase exponentially, and you could end up with more variations than you have visitors.<\/p>\n A\/B testing is ideal for when you\u2019re making dramatic changes and want results quickly. It will be easier to tell which version is more effective faster, as the data will only be split into two sections. It\u2019s also good if you are testing somthing that doesn\u2019t get a lot of traffic, as you\u2019ll get plenty of data without needing plenty of visitors.<\/p>\n Multivariate is good for subtle changes and when you want to understand how the elements on your page work together. You do need a lot of traffic in order to get meaningful results, however, as you are dividing up your audience into small bunches. But if you do have the traffic, the multivariate testing can give you good data that you can then take forward into larger projects, such as complete website redesigns.<\/p>\n Once you\u2019ve decided which test you\u2019re going to implement, there are many software companies out there willing to work with out to deliver those variations to your visitors.<\/p>\n Google Analytics has Content Experiments<\/a> built in, giving you a slightly different version of variant testing, where you can test up to 10 full versions of a single page. This is convenient for A\/B testing and most multivariate testing, but does limit you if you were planning on testing the same element across several pages. It\u2019s free to use as part of your Google Analytics account<\/a>, but any visitors who have installed the Analytics opt-out browser add-on for privacy purposes will not be a part of your data set.<\/p>\n Monetate<\/a> is subscription-based software that gives you a convenient way to test not only websites, but also mobile apps and emails. This makes it a good option if you plan to do a lot of testing across different platforms, but might be overkill if you only need to test one thing.<\/p>\n VWO (Visual Website Optimizer)<\/a> is purely for A\/B testing, but is affordable and gives you a wide range of options for your site and your data. Popular and easy to use, it isn\u2019t for expert variant testers, but can be a great starting point for beginners.<\/p>\n Optimizely<\/a> works for websites and mobile apps, and is one of the most popular out there. They also have a wide range of e-books, blog posts, and white papers that provide advice and information on variant testing.<\/p>\n By finishing the test early, you could be reading too much into the small amount of results that you have. Just because 5 people spent more time on Version A than Version B does not meant that Version A is better \u2013 especially if only 20 people came to your site. While most variant testing packages come with statistics packages that explain the data to you, you can also use VWO\u2019s Split Test Significance Calculator<\/a> as a good indicator of where your data is.<\/p>\n Don\u2019t shock your regular customers with new versions every time they visit. Most tools will have cookies to make certain that every visitor sees the same thing, but check before you start. And if you have a way to have your current customers stick with the old version and only show the new version to your new customers, go with that \u2013 the last thing you need during the testing period is having to answer support queries as well.<\/p>\n While you might be absolutely convinced that your website needs a particular colour scheme or that the text in the button should be one way, the data tells you the truth. It doesn\u2019t matter what you think is better \u2013 it\u2019s what converts that matters. And if you didn\u2019t want more conversions, why are you doing the testing in the first place?<\/p>\n <\/p>\n Swift Icons<\/a> by Darius Dan<\/a> for Smashing Magazine<\/a>.<\/small><\/p>\n","protected":false},"excerpt":{"rendered":" Variant testing is one of the best ways to find out what works for your visitors. Whether testing the location of a button, a redesigned menu, or an entirely different website, variant testing gives you a chance to have hard data behind your design decisions. We get into what variant testing is, how you can use it, and how we’re using it now.<\/p>\n","protected":false},"author":2,"featured_media":11755,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[25,29],"tags":[],"class_list":{"0":"post-11750","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-web-hosting","8":"category-your-website"},"yoast_head":"\n![\"Two](\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/varianttesting-whentouse.jpg\")
<\/p>\nWhen to use which method<\/h3>\n
![\"Two](\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/varianttesting-software.jpg\")
<\/p>\nChoosing the right variant testing software<\/h3>\n
![\"A](\"https:\/\/www.heartinternet.uk\/blog\/wp-content\/uploads\/varianttesting-remember.jpg\")
<\/p>\nThings to remember when testing<\/h3>\n
Don\u2019t stop the test too early<\/h4>\n
Show repeat visitors the same version<\/h4>\n
Don\u2019t let your instincts overrule the data<\/h4>\n