{"id":235,"date":"2008-11-21T16:49:50","date_gmt":"2008-11-21T23:49:50","guid":{"rendered":"http:\/\/blog.mozilla.org\/metrics\/?p=235"},"modified":"2019-09-18T12:07:09","modified_gmt":"2019-09-18T19:07:09","slug":"changing-the-firefox-download-button","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/metrics\/2008\/11\/21\/changing-the-firefox-download-button\/","title":{"rendered":"Changing the Firefox Download Button"},"content":{"rendered":"<p>A couple months back we <a href=\"http:\/\/blog.mozilla.org\/metrics\/2008\/09\/30\/multivariate-testing-coming-to-wwwmozillacom\/\" target=\"_blank\" rel=\"noopener noreferrer\">started a discussion<\/a> around our plans for performing some multivariate optimization tests within the mozilla.com site.\u00a0 We started with one simple A\/B test on a single web page and we now have some findings to share.\u00a0 At the Firefox customize page &#8212; <a href=\"http:\/\/en-us.www.mozilla.com\/en-US\/firefox\/customize\/\" target=\"_blank\" rel=\"noopener noreferrer\">www.mozilla.com\/firefox\/customize\/<\/a> &#8212; we made a singular text change: the green download button could either include our default text <strong>&#8220;Download Now \u2013 Free&#8221;<\/strong> or our test text <strong>&#8220;Try Firefox 3&#8221;<\/strong>.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-236\" title=\"customize_page\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/11\/customize_page.png\" alt=\"\" width=\"500\" height=\"359\" \/><\/p>\n<p>The results from the test are below.\u00a0 Please keep in mind that the primary purpose of this initial test was to evaluate a possible long-term solution\/tool for implementing much more robust tests in the future.\u00a0 That said, our findings provide a small amount of insight.\u00a0 During the course of two weeks, this page saw about 300K visitors and nearly 30K clicks to download Firefox.\u00a0 The conversion rate for &#8220;Download Now \u2013 Free&#8221; was 10.07% versus 9.73% for &#8220;Try Firefox 3&#8221;, which translates to a 3.44% decrease in optimization when using &#8220;Try Firefox 3&#8221;, with 99.85% confidence in these results (confidence = likelihood that this version of the page performs significantly different than our default page).<\/p>\n<p><a href=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/11\/results_cust_test.png\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-241\" title=\"results_cust_test\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2008\/11\/results_cust_test.png\" alt=\"\" width=\"500\" height=\"62\" \/><\/a><\/p>\n<p>If we&#8217;ve piqued your interest, please note that we&#8217;ll soon have some exciting findings related to a currently ongoing multivariate test at the main Firefox product page (www.mozilla.com\/firefox).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A couple months back we started a discussion around our plans for performing some multivariate optimization tests within the mozilla.com site.\u00a0 We started with one simple A\/B test on a single web page and we now have some findings to &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/metrics\/2008\/11\/21\/changing-the-firefox-download-button\/\">Continue reading<\/a><\/p>\n","protected":false},"author":60,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[101],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/235"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/users\/60"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/comments?post=235"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/235\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/media?parent=235"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/categories?post=235"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/tags?post=235"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}