{"id":612,"date":"2009-06-19T09:33:30","date_gmt":"2009-06-19T16:33:30","guid":{"rendered":"http:\/\/blog.mozilla.org\/metrics\/?p=612"},"modified":"2019-09-18T12:05:41","modified_gmt":"2019-09-18T19:05:41","slug":"firefox-is-green","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/metrics\/2009\/06\/19\/firefox-is-green\/","title":{"rendered":"Firefox is Green"},"content":{"rendered":"<p>We recently ran a week long A\/B optimization test at www.mozilla.com where we rotated in a few different colors of the Firefox download button.\u00a0 (You may recall that we&#8217;ve previously conducted one prior multivariate test on the Firefox product\/download page\u2026 <a href=\"http:\/\/blog.mozilla.org\/metrics\/2008\/12\/04\/the-download-button-drives-downloads\/\" target=\"_blank\" rel=\"noopener noreferrer\">check it out<\/a> for some historical context.)\u00a0 For this current test, here was our existing page and download button:<\/p>\n<p><a href=\"http:\/\/www.mozilla.com\/en-US\/firefox\/ie.html\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-613\" title=\"fx_control\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_control.png\" alt=\"fx_control\" width=\"520\" height=\"418\" srcset=\"https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_control.png 520w, https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_control-300x241.png 300w\" sizes=\"(max-width: 520px) 100vw, 520px\" \/><\/a><\/p>\n<p>Within this page (the green download button was our &#8220;control&#8221; color), we randomly rotated three other colors of the download button \u2013 blue, purple, and orange\/yellow:<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-614\" title=\"fx_blue\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_blue.png\" alt=\"fx_blue\" width=\"516\" height=\"302\" srcset=\"https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_blue.png 516w, https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_blue-300x175.png 300w\" sizes=\"(max-width: 516px) 100vw, 516px\" \/><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-615\" title=\"fx_purple\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_purple.png\" alt=\"fx_purple\" width=\"516\" height=\"301\" srcset=\"https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_purple.png 516w, https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_purple-300x175.png 300w\" sizes=\"(max-width: 516px) 100vw, 516px\" \/><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-616\" title=\"fx_yellow\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_yellow.png\" alt=\"fx_yellow\" width=\"518\" height=\"304\" srcset=\"https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_yellow.png 518w, https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/fx_yellow-300x176.png 300w\" sizes=\"(max-width: 518px) 100vw, 518px\" \/><\/p>\n<p>The results are below.\u00a0 The difference between a 76.5% conversion rate and a 77.3% conversion rate is a 1% lift, i.e., the percentage change between those two percentages.\u00a0 So, what does this translate to in terms of Firefox usage?\u00a0 Assuming we see about 500K daily downloads at www.mozilla.com, a 1% lift translates to nearly <strong>2 million marginal, or incremental, downloads annually<\/strong> (i.e., 2 million potential new Firefox users we would have otherwise lost).<\/p>\n<p><a href=\"http:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/color_results.png\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone size-full wp-image-621\" title=\"color_results\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/color_results.png\" alt=\"color_results\" width=\"467\" height=\"113\" srcset=\"https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/color_results.png 467w, https:\/\/blog.mozilla.org\/metrics\/files\/2009\/06\/color_results-300x72.png 300w\" sizes=\"(max-width: 467px) 100vw, 467px\" \/><\/a><\/p>\n<p>We&#8217;re already running the winning button color, so we&#8217;re now looking forward to future optimization testing (e.g., a download button quadrupled in size, an octagon shaped download button, a button centered within the page, etc.) to see if we can actually gain a 1% lift (or ideally a 5%+ lift), and in the process, improve our site experience for millions of new Firefox users.<\/p>\n<p>Lastly, I want to thank John Slater, Laura Mesa, Monique Johnson, Stephen Donner, Neil Lee, Jeremy Orem, and Alex Buchanan for making this initiative happen.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We recently ran a week long A\/B optimization test at www.mozilla.com where we rotated in a few different colors of the Firefox download button.\u00a0 (You may recall that we&#8217;ve previously conducted one prior multivariate test on the Firefox product\/download page\u2026 &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/metrics\/2009\/06\/19\/firefox-is-green\/\">Continue reading<\/a><\/p>\n","protected":false},"author":60,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[101],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/612"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/users\/60"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/comments?post=612"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/612\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/media?parent=612"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/categories?post=612"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/tags?post=612"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}