The Download Button Drives Downloads

As previously introduced, and subsequently rolled out in an initial test, we recently wrapped up our evaluation of a multivariate website optimization tool with a more complex test on the main Firefox product page – www.mozilla.com/firefox.  We considered several variations of three components on the page – the headline, sub-headline, and text within the download button.  To accomplish this, the tool had us create 16 different variations, or recipes, of our page.  We then exposed these recipes to a small percentage of IE visitors to our site.

What did we find?

Some good news and some not so significant news.

The first thing we noticed was that no recipe performed significantly better than our existing Firefox product page (the control page during our test) in a statistically significant way.  That said, there was one strong and valid finding.  The four recipes shown below all performed significantly worse than our existing page in a statistically significant way.  What’s the common thread among these four recipes?

These are the four recipes using “Try Now!” as the text within the download button.  The other two variations of text used within the button were “Download” and “Free Download”.

How does this change our business/creative decision making?

As some of us already guessed, it appears that it’s the download button itself that matters most here.  Thinking about the size, shape, color, and placement (among other characteristics), our findings indicate that future testing could reveal surprising – and positive findings – based on changes to the download button.  In other words, it wouldn’t be a stretch to imagine that future tests, that adjust such characterisitcs of the download button, could easily translate to a 2% lift (or much greater), and in turn, a substantially improved experience for millions of new Firefox users each year.

———–

For those interested, the full results from our test are below.  The “winner” is highlighted in green and the four recipes discussed above are highlighted in red.

6 responses

  1. Ran wrote on :

    I think you’re overanalyzing this. The first thing to note is that the button does NOT look like a button. Without the ‘Download’ wording, it would hardly cross your mind to press it.

  2. Justin Dolske wrote on :

    Interesting. Especially because I’ve always assumed that one impediment to people getting Firefox is the fear that it will permanently switch their browser (and, hence, language like “try it out” would be good to imply some kind of no-commitment trial).

  3. Dave wrote on :

    I’ve heard that a ‘call to action’ such as ‘click here’ significantly increases clicks. I know ‘click here’ is supposed to die with web2.0, but perhaps you could try that next time. You may also want to try more text, and include a text link to download, such as suggested here:
    http://blog.sitebrand.com/2007/07/04/experimenting-with-link-placementcall-to-action/

  4. John Silvestri wrote on :

    IMHO, ‘Try Now’ is deceiving from that point of view, unless you’re talking about a Portable App. After all, the file you download with that button is an installer, and therefore, kind of a mixed message. Uninstalling software is a nuisance to many people, and something that routinely doesn’t get done.

    Also, ‘Try Now’ appears to be really bad English in that context. Besides that, I tend to think people /expect/ the wording of “Download.”

  5. Mark S wrote on :

    My guess is that “Try Now!” does neither communicate download nor (and this is big) freeness.
    When I’m on a website and I see that I can “try out” the software, what am I thinking? Yup, it’s a trial. I’m going to get a period of time to fall in love with a product and then not buy it? No thanks, I’m no masochist.

    @Ben Whether it looks like a button or not hardly matters. He could have very well said ‘Green Box’ in the place of button. But yet, making the link say Download does seem to be the key towards user action.

    Ken, could you post a link to Recipe D to help satisfy my curiosity. 🙂

  6. Ricmacas wrote on :

    I saw that test today when i visited the homepage. There was a headline that said: “Try it now”. It makes me think in Trials, and i just reloaded the page and got a nice version of the firefox page. Glad I did that.