A Case Study On Split Testing And Tips On How To Do It Right

Advertise Here Free

Online Marketing Empire
In launch mode, only $10/month! Total of nine sites and more to come!
  SAVE $500 - $5000 on MEDS
COSTS $7 to make $5,000 by Saving Family & Others Med Costs

We’ve all heard of the importance of split-testing, but often times we are just too lazy (or rather simply do not have the right tool) to do sufficient split tests. Today I’m happy to invite our guest blogger, Ruben Corbo, a split-testing consultant, to share with us some useful tips on split testing.

To start, I requested Ruben to share with us a case study to illustrate the importance of split testing. I then continued to ask him a series of questions that I had in mind. Below is the organized version of our correspondences. Enjoy.

A case study of how split testing has made a difference

Split testing conducted by SIM-Only.co.uk is one the most convincing proofs that this marketing tool really helps. The test was conducted by first tweaking the icons used in presenting the products: images of phones vs. SIM cards.

On another round of testing, the icons are arranged vertically on the right hand side of the page for one variant, and horizontally across the page for the other.

Results showed that the vertical layout of phone images worked better than the other versions. It increased the website’s click out rate (clicking the icons towards the landing page) by 20 percent and improved other areas such as confidence levels, etc.

What are the things that need to be split tested?

In A/B testing, adjustments on text contents and images seem to create the most impact to the audiences. Shortening the texts and including only the gist of what the products/brand is all about seem to increase audience engagement and stir purchase motivation.

Similarly, placing a well-taken photo of the product on the landing page has also been shown to increase the click-through of visitors who check out the product, as compared to a page without product photo.

What are the things that don’t need to be split tested?

Design of menu bars and other navigation tools are not to be prioritized in split testing. As long as they are situated in the right places, their styles usually don’t matter. Most webmasters misconstrue that colors are least of priorities, but they are just as important. Remember that visual has a lot to do in luring visitors into action. A website with a pastel almost-unnoticeable blue background cannot ensnare attention as much as a vivid cerulean can.

What is the easy step by step procedure to do split testing?

1. Identify the problem: determine what could be causing your low traffic or poor conversions.

2. Formulate a hypothesis: make an educated guess on how the complexities can be solved.

3. Choose the right elements to test.

4. Set a metric that can be used for evaluation of the variants’ performances.

5. Run the A/B test.

6. Analyze the data gathered.

7. Implement the design that performed better than the other.

Split testing is tedious and time consuming. What are some of the tricks to simplify the process?

There’s no shortcut to A/B testing. If you want to get the soundest results, patience is required in the process. For newbies, however, there are loads of software and tools that can be downloaded online. Google’s Web Optimizer, for example, automates the process of splitting traffic and gathering data (including number of clicks on a page, hits on the landing page, etc.)

Other programs can help you choose the elements to be put on test, generate probable variant designs, set metrics, etc. These options can automate majority of the steps in split testing, thus taking a lot of time out of your hands.

Here are some of the links where the software can be downloaded:






What are some of the things that people do wrongly in split testing?

1) Using the wrong metrics in evaluating certain areas. For example, web masters tend to look at the number of purchases in assessing the effectiveness of content instead of the performance of the call to action button. Note that audience engagement and depth of browsing should be the metric for content impact.

2) Not earmarking ample time to gather reliable data. Most webmasters conduct the split testing in a span that’s too short. Six weeks is actually the ideal period.

3) Conducting the test when the website is yet to earn a good volume of traffic. A/B testing cannot be conducted by websites that are only getting hundred to a thousand of visitors per month. Otherwise, the data gathered from the experiment would be misrepresentation of consumer preferences. Note that there is a need to get a good amount of sampling in conducting the test.

This is a guest post by Ruben Corbo and he is a AB Test Expert.

  • Digg
  • Facebook
  • Propeller
  • StumbleUpon
  • Technorati
  • TwitThis
  • Reddit
  • del.icio.us

Check out these offers from our members:

  • Free Bitcoins-Join Free
    Let us stack your Bitcoin wallet high with piles of FREE BITCOINS.
  • The Future Of PPC Is HERE
    Why Thousands Are Pulling Out Of The Popular Traffic-Getting Strategy
  • $1,310,377 PROOF + FREE ¬
    ________________ _______ _______________ Watch Video, Join For Free...
  • You're Invited
    It's already growing at the speed of Facebook, Twitter and Pinterest!
  • Have What It Takes?
    The 7 Keys to being an Entrepreneur are revealed in this Free Report!
  • Advertise Here Free

    RSS feed | Trackback URI


    Comment by Niranjan Ranade
    2012-11-30 08:33:52

    Yes, marketers often focus so much on traffic that they forget to track and improve conversion which should also be a continuous process. Testing and tweaking websites is important to optimizing income. Thanks Kenneth for the awesome tips and guidance on Split testing :)

    2012-11-30 15:00:31

    Whats up very cool website!! Man .. Beautiful .. Superb .
    . I’ll bookmark your site and take the feeds also? I’m glad to seek out so
    many useful info right here within the publish, we want work out extra strategies in this regard, thank you for sharing.
    . . . . .

    Comment by http://lebface.com
    2012-12-02 04:15:37

    Having read this I thought it was rather enlightening. I appreciate you finding the time and energy to put
    this information together. I once again find myself spending
    a significant amount of time both reading and posting comments.

    But so what, it was still worth it!

    2012-12-06 00:18:45

    I know this site presents quality dependent articles or reviews and additional material,
    is there any other web page which gives such data in quality?

    Comment by Suvaance
    2012-12-08 05:38:32

    Visual Website Optimizer is a good tool for A/B testing, but due to lack of knowledge as well as experience I’ve not used yet but this article is quite helpful to understand the facts.

    I’ll soon use it for some sites but not sure how it’ll be effective as I don’t have experience in it. But A?B testing is essential to improve the conversion. Thanks for sharing the case studies.

    Comment by Lyndhurst Locksmith
    2013-04-08 18:01:39

    well yeah you are right this is really a fine way for case study on split and thanks to share those tips.

    Comment by see here
    2013-04-11 15:26:26

    I think this site is one of the best I have seen so far on the internet. You discuss some of the latest procedure on split testing in an effective manner. The article is discussed in an excellent manner and I am glad that it has helped me so much. Thank you for the good work.

    Comment by Fred
    2013-04-24 12:58:48

    This is a really good tip especially to those new to the blogosphere.
    Brief but very precise info… Many thanks for sharing this one.
    A must read article!

    2013-05-03 12:11:08

    Your style is so unique in comparison to other folks I’ve read stuff from. Thank you for posting when you have the opportunity, Guess I’ll just book mark this web

    2013-05-03 12:27:35

    Very descriptive blog, I enjoyed that a lot.
    Will there be a part 2?

    2013-05-03 12:30:57

    Hi, i feel that i saw you visited my website thus i got here to go back the favor?

    .I am trying to find things to improve my web site!
    I suppose its adequate to make use of some of your ideas!

    2013-05-03 13:32:27

    Thanks for sharing your thoughts on split testing.

    Comment by ppc tricks
    2013-05-07 15:33:40

    What’s up colleagues, how is everything, and what you wish for to say on the topic of this post, in my view its actually remarkable in support of me.

    Comment by Read This
    2013-05-09 10:29:33

    Thanks on your marvelous posting! I quite enjoyed reading it, you can be
    a great author. I will be sure to bookmark your blog
    and will eventually come back later in life.
    I want to encourage you to ultimately continue your great posts, have a nice holiday weekend!

    2013-05-15 09:53:25

    This article is in fact a nice one it helps new net visitors, who are wishing in favor of blogging.

    Comment by com.au
    2013-05-16 15:25:16

    Hello, I would like to subscribe for this webpage to take hottest updates, so where can
    i do it please help.

    2013-05-16 20:30:05

    Fantastic post however I was wondering if you could
    write a litte more on this topic? I’d be very thankful if you could elaborate a little bit more. Cheers!

    2013-05-17 13:44:28

    Hey there! This is my 1st comment here so I just wanted to give a quick shout out and tell you I really enjoy reading through your posts.
    Can you recommend any other blogs/websites/forums that go over the same topics?

    Comment by new balance
    2013-05-20 12:26:40

    Hello it’s me, I am also visiting this website daily, this site is actually good and the people are actually sharing pleasant thoughts.

    2013-05-22 09:44:33

    I’m truly enjoying the design and layout of your blog. It’s a very easy
    on the eyes which makes it much more pleasant for me to come here and visit more often.
    Did you hire out a designer to create your theme?

    Fantastic work!

    Comment by Thyromine Cost
    2013-05-26 03:06:57

    Very shortly this web site will be famous among all blogging
    people, due to it’s nice articles

    2013-05-26 10:06:56

    Hi everyone, it’s my first go to see at this web page, and article is in fact fruitful in favor of me, keep up posting these content.

    2013-05-28 17:32:08

    Good day! This is my first visit to your blog! We are a group of volunteers and starting a new initiative in a community in the
    same niche. Your blog provided us beneficial information to work
    on. You have done a extraordinary job!

    Comment by cellulite treatment
    2013-06-03 13:10:15

    You actually make it seem so easy along with your presentation but I find this matter to be really something that I feel I would by no means understand.
    It seems too complex and very broad for
    me. I’m looking ahead in your next submit, I’ll attempt
    to get the hang of it!

    2013-06-04 20:47:50

    Excellent article. Keep writing such kind of information on your blog.
    Im really impressed by your blog.
    Hey there, You’ve done an excellent job. I’ll certainly digg it
    and for my part recommend to my friends. I am confident they’ll be benefited from this site.

    Comment by woodworking plans
    2013-06-13 00:03:42

    Thanks for the marvelous posting! I genuinely enjoyed reading it,
    you can be a great author.I will remember to bookmark your
    blog and will eventually come back down the road.
    I want to encourage that you continue your great posts, have a nice day!

    2013-06-18 21:56:14

    Hello this is somewhat of off topic but I was wondering if blogs use WYSIWYG editors or
    if you have to manually code with HTML. I’m starting a blog soon but have no coding skills so I wanted to get advice from someone with experience. Any help would be enormously appreciated!

    2013-06-27 17:03:39


    Comment by football
    2013-06-28 21:08:50

    you are in point of fact a just right webmaster. The web site loading velocity is amazing.
    It kind of feels that you are doing any unique trick.
    Furthermore, The contents are masterwork.
    you’ve performed a wonderful activity on this subject!

    2013-07-11 02:23:02

    With the page location now saved in my Favorites list I
    am able to revisit that page by simply selecting it from the unauthorized
    users which may attack the storage while they are online. This is an extension of 30 days but it can be
    easier for them to become damage, scratched, or otherwise

    Comment by webpage
    2013-07-23 13:49:45

    Hi there it’s me, I am also visiting this site regularly, this web site is genuinely fastidious and the viewers are genuinely sharing good thoughts.

    Comment by Highster Mobile
    2013-07-31 11:58:04

    This is my first time pay a visit at here and i am truly impressed to read all at
    single place.

    2013-08-03 05:36:15

    Your means of explaining all in this article is really nice,
    all be able to effortlessly understand it, Thanks a lot.

    2013-08-03 06:58:38

    I constantly spent my half an hour to read this web site’s posts all the time along with a cup of coffee.

    2013-08-17 13:49:33

    Hi Kenneth, it has been quite a while since I read your post. I have however enjoyed this post as always. See you at the top!

    2013-09-08 12:42:15

    whoah this weblog is great i love reading your articles. Keep up the good work!
    You already know, many people are hunting round for
    this info, you could help them greatly.

    Comment by youtube.com
    2013-11-15 17:25:21

    Hello to all, as I am really keen of reading thijs website’s post to be updated on a regular basis.
    It contains nice information.

    Comment by cheap business gas
    2014-01-14 08:59:32

    What’s up, I log on to your new stuff like every week.

    Your humoristic style is witty, keep up the
    good work!

    Comment by Jarred
    2014-01-24 17:23:06

    Awesome blog! Is your theme custom made or did you download it from somewhere?
    A theme like yours with a few simple adjustements would really
    make my blog shine. Please let me know where you got your
    design. Bless you

    2014-03-03 10:48:31

    Hi there to every body, it’s my first visit of this website; this blog contains amazing and really good data
    in support of readers.|

    Look into my homepage :: darmowy program do rozliczania pit 2013

    2014-03-27 05:31:18

    Siոce the аdmin of thiks web ѕite is working, no hesitation very rapidly
    it will be well-known, due to its featuure contents.

    2014-04-04 05:07:08

    I waѕ able too find good advice from your blog postѕ.

    Name (required)
    E-mail (required - never shown publicly)

    Your Comment (smaller size | larger size)
    You may use <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong> in your comment.