{"id":250,"date":"2008-12-04T17:02:03","date_gmt":"2008-12-05T00:02:03","guid":{"rendered":"http:\/\/blog.mozilla.org\/metrics\/?p=250"},"modified":"2019-09-18T12:07:09","modified_gmt":"2019-09-18T19:07:09","slug":"the-download-button-drives-downloads","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/metrics\/2008\/12\/04\/the-download-button-drives-downloads\/","title":{"rendered":"The Download Button Drives Downloads"},"content":{"rendered":"<p>As previously <a href=\"http:\/\/blog.mozilla.org\/metrics\/2008\/09\/30\/multivariate-testing-coming-to-wwwmozillacom\/\" target=\"_blank\" rel=\"noopener noreferrer\">introduced<\/a>, and subsequently rolled out in <a href=\"http:\/\/blog.mozilla.org\/metrics\/2008\/11\/21\/changing-the-firefox-download-button\/\" target=\"_blank\" rel=\"noopener noreferrer\">an initial test<\/a>, we recently wrapped up our evaluation of a multivariate website optimization tool with a more complex test on the main Firefox product page \u2013 www.mozilla.com\/firefox.\u00a0 We considered several variations of three components on the page \u2013 the headline, sub-headline, and text within the download button.\u00a0 To accomplish this, the tool had us create <strong>16 different variations<\/strong>, or recipes, of our page.\u00a0 We then exposed these recipes to a small percentage of IE visitors to our site.<\/p>\n<p>What did we find?<\/p>\n<p>Some good news and some not so significant news.<\/p>\n<p>The first thing we noticed was that no recipe performed significantly better than our existing Firefox product page (the control page during our test) in a statistically significant way.\u00a0 That said, there was one strong and valid finding.\u00a0 The four recipes shown below all performed significantly worse than our existing page in a statistically significant way.\u00a0 <strong>What&#8217;s the common thread among these four recipes?<\/strong><\/p>\n<p style=\"text-align: center;\"><a href=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/better_v21.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-256 aligncenter\" title=\"better_v21\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/better_v21.png\" alt=\"\" width=\"500\" height=\"287\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><a href=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/does_more.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-252 aligncenter\" title=\"does_more\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/does_more.png\" alt=\"\" width=\"500\" height=\"285\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><a href=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/hasitall_v2.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-253 aligncenter\" title=\"hasitall_v2\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/hasitall_v2.png\" alt=\"\" width=\"500\" height=\"287\" \/><\/a><\/p>\n<p style=\"text-align: center;\"><a href=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/safest.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-full wp-image-254 aligncenter\" title=\"safest\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/safest.png\" alt=\"\" width=\"500\" height=\"290\" \/><\/a><\/p>\n<p>These are the four recipes using <strong>\u201cTry Now!\u201d<\/strong> as the text within the download button.\u00a0 The other two variations of text used within the button were \u201cDownload\u201d and \u201cFree Download\u201d.<\/p>\n<p>How does this change our business\/creative decision making?<\/p>\n<p>As some of us already guessed, it appears that it&#8217;s the download button itself that matters most here.\u00a0 Thinking about the size, shape, color, and placement (among other characteristics), our findings indicate that future testing could reveal surprising \u2013 and positive findings \u2013 based on changes to the download button.\u00a0 In other words, it wouldn&#8217;t be a stretch to imagine that future tests, that adjust such characterisitcs of the download button, could easily translate to a 2% lift (or much greater), and in turn, a substantially improved experience for millions of new Firefox users each year.<\/p>\n<p>&#8212;&#8212;&#8212;&#8211;<\/p>\n<p>For those interested, the full results from our test are below.\u00a0 The &#8220;winner&#8221; is highlighted in green and the four recipes discussed above are highlighted in red.<\/p>\n<p><a href=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/raw_data_mvt_fx_main.png\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-260\" title=\"raw_data_mvt_fx_main\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/12\/raw_data_mvt_fx_main.png\" alt=\"\" width=\"500\" height=\"287\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>As previously introduced, and subsequently rolled out in an initial test, we recently wrapped up our evaluation of a multivariate website optimization tool with a more complex test on the main Firefox product page \u2013 www.mozilla.com\/firefox.\u00a0 We considered several variations &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/metrics\/2008\/12\/04\/the-download-button-drives-downloads\/\">Continue reading<\/a><\/p>\n","protected":false},"author":60,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[101],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/250"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/users\/60"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/comments?post=250"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/250\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/media?parent=250"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/categories?post=250"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/tags?post=250"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}