AB Testing and Multivariate testing
Articles and resources about how to use AB testing and multivariate testing to compare and contrast the pages which have better conversion rates for visitors to your website.
-
Stop Making Excuses, Start Split Testing
- By Nick Eubanks, Business 2 Community, Published February 27, 2013. "If you are reading this, chances are you are not new to the idea of split testing, but just in case, here’s a quick and dirty definition:
A/B testing or split testing compares the effectiveness of two versions of a web page, marketing email, or the like, in order to discover which has better response rate or better sales conversion rate.
Source: Wikipedia
In my opinion, split testing should be the most frequently used tool in your CRO toolbox. Split testing alone is one of the greatest sources of 'Ah Ha!' moments and insights into exactly how your customers think about and perceive your brand.
For some of my specific thoughts on conversion rate optimization, please check out my recent CRO interview with Ben Beck. Also, stay tuned for a special offer at the end of this post..."
-
A Simple Guide to Google Content Experiments
- by Nick Eubanks, Search Engine Watch, November 12, 2012. "... 3 Reasons You Need to Split Test
- Little changes can lead to big improvements.
- Your competitors are testing. If you aren't gaining ground, you're losing it.
- It is a tenet of the Lean Startup for good cause, this is the quickest way to optimize conversions for your target audience.
Here's What We're Going to Do
The easiest way to get started with a simple split test is to make a copy of the page you would like to test.
Once the copy has been made – in most cases this involves create a new page in your content management system (CMS) and copying and pasting all of the source code from the original page – simply make the change that you would like to test and save the new page to a new URL.
When testing between two or more URLs, it's smart to use the URLs as an additional indicator of the variation number, so the first variation would be URL-2, and the next URL-3...
Google Content Experiments is a free and robust testing platform integrated directly into Google Analytics, formerly know as Google Website Optimizer..."
-
Google Content Experiments-The Good, the Bad and The Alternatives
- By Mariel Bacci. Future Now, August 22, 2012. "Google Website Optimizer is gone. It has been replaced with Google Content Experiments. Countless articles and blog posts have been written on how this change will affect testing for everyone. This blog post will briefly outline why Google Content Experiments will make your life better, but might make your life harder, and will show you some alternative testing tools that this change should draw your attention to..."
-
Website testing and Google search
- Posted by Susan Moskwa, Webmaster Trends Analyst. Google Webmaster Central Blog, Thursday, August 9, 2012. "We've gotten several questions recently about whether website testing—such as A/B or multivariate testing—affects a site's performance in search results. We're glad you’re asking, because we're glad you're testing! A/B and multivariate testing are great ways of making sure that what you're offering really appeals to your users..."
-
Google's SEO Guide On A/B & Multivariate Testing
- by Barry Schwartz. Search Engine land, August 9, 2012. "Google posted some guidelines on how you can conduct A/B or multivariate testing and stay clear of any issues with being listed in its search engine, such as avoiding penalties..."
-
8 Rules of A/B Testing – The Art in Marketing Science
- by Uri Bar-Joseph, Search Engine Watch, August 6, 2012. "Data will tell you the right answer. If you can't find data somewhere, you should run a test, collect the data, and let it tell you what's right.
Testing is one of the core marketing arts a marketer should master and practice.
You should treat A/B testing as a competition between two players – a champion and a contender. You define the rules, set up the arena, announce the players and let the data be the judge..."
-
Upgrades To Google Analytics Content Experiments
- by Daniel Waisberg. Marketing Land, July 31, 2012. "A few weeks ago Google Analytics launched Content Experiments, a new testing functionality that can be used to create A/B/N tests to optimize campaigns and overal website experience.
Last week Google announced 3 upgrades that will make testing with the tool significantly easier and more powerful. Below I discuss each of the upgrades and how they can enhance testing with Google Analytics..."
-
Google Improves Content Experiments in Analytics
- by Thom Craver, Search Engine Watch, July 26, 2012. "Last month Google introduced Analytics users to Content Experiments, a revamped version of the old Website Optimizer tool. Content experiments is a tool that allows site owners to do simple A/B testing against a common goal.
This week, Google announced they've already added several improvements to content experiments..."
-
Making Google Analytics Content Experiments Even Better
- Posted by Inna Weiner, Software Engineer. Google Analytics Blog, Monday, July 23, 2012. "A few weeks ago, we announced Google Analytics Content Experiments. Since our announcement, we have been busy making Content Experiments available to Google Analytics users and improving it based on your feedback. We'd like to tell you about a few changes that we have recently introduced:
Content Experiments available to everyone. Every Google Analytics user can now access Content Experiments. You can find this feature under "Experiments" in the "Content" section of your Standard Reports..."
-
What to do When Your Split Test Fails
- by Bonnie Stefanick, Search Engine Watch, June 10, 2012. "Most of the time when it comes to landing page testing, whether it be multivariate or split testing, you read about gleaning successes, where 'we increased our conversion by 454 percent!' But what do you do your test fails?
Let's focus on what causes your A/B/n experiments to fail, because this is the most common type of landing page testing done by small- to mid- size webmasters. We will also explore how to gain value from even failed tests..."
-
Google Analytics Gets New Testing Functionality: Content Experiments
- by Daniel Waisberg. Marketing Land, June 1, 2012. "Today the Google Analytics team made an important announcement for marketers and analysts: Google Website Optimizer will be fully integrated into Google Analytics. Google will be discontinuing Website Optimizer as a stand alone product (by August) and the testing functionality will be available to Google Analytics users only. The testing tool will be found in the Content section under the header 'Experiments'..."
-
Google Website Optimizer is Dead. Long live Google Analytics Content Experiments
- by Sayf Sharif. LunaMetrics, Posted on June 4, 2012. "Until a few days ago we've had to keep this one under wraps, but with the official announcement on the Google Analytics Blog Friday we can finally talk about the all new Google Analytics Content Experiments. This is the all new, tied directly into your analytics, testing software to replace Google Website Optimizer. Google Website Optimizer will slowly be decomissioned over this year, and replaced fully by these new Content Experiments. So if your'e starting any A/B testing anytime soon, time to do it in here rather than in GWO.
Let's do a quick run through on how to use and set up these new tests. It’s really simple, and A/B testing is something pretty much everyone is capable of doing, and should give a try..."
-
Helping to Create Better Websites: Introducing Content Experiments
- Posted by Nir Tzemah, Google Analytics team. Google Analytics Blog, Friday, June 1, 2012. "Over the last 5 years, it’s been great to see how many marketers and publishers have improved the web by using insights from Google Website Optimizer to create better site experiences. Today, we’d like to announce the release of Google Analytics Content Experiments, which brings website testing to Google Analytics.
We’re excited to integrate content testing into Google Analytics and believe it will help meet your goals of measuring, testing and optimizing all in one place. Content Experiments helps you optimize for goals you have already defined in your Google Analytics account, and can help you decide which page designs, layouts and content are most effective.
-
Do It Yourself A/B Testing
- by Conrad Saam. Search Engine Land, April 4, 2012. Shows you how to use a free online tool called AB Tester, which allows you to measure up to three alternatives compared to a benchmark.
-
45 Awesome Posts on A/B, Multivariate, and Usability Testing
- By Kristi Hines, Unbounce, December 7, 2011. "... These 45 posts from 2011 will teach you all you need to know about A/B testing, multivariate testing, and usability testing for copy, design, landing pages, PPC, and much more..."
This category last updated: 28 February 2013