{"id":2740,"date":"2010-03-22T13:10:40","date_gmt":"2010-03-22T20:10:40","guid":{"rendered":"http:\/\/blog.mozilla.org\/metrics\/?p=2740"},"modified":"2019-09-18T12:05:37","modified_gmt":"2019-09-18T19:05:37","slug":"addition-by-subtraction","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/metrics\/2010\/03\/22\/addition-by-subtraction\/","title":{"rendered":"Addition by Subtraction"},"content":{"rendered":"

With our first multivariate test, we set out to answer a simple question: which design elements drive downloads on the IE landing page? We didn’t know which elements were most effective, but expected each would help persuade visitors to ditch IE. <\/p>\n

Our results are surprising! But before I share them, let me briefly describe our experiment design. <\/p>\n

\"\"<\/a><\/p>\n

We focused on the 4 boxes highlighted in red. To test how each element contributes to Firefox downloads, we created 16 variations of this page, each containing a different set of elements. Note: rather than removing the entire footer, we simplified the footer, keeping the Privacy Policy, Legal Notices, and Report Trademark Abuse links.<\/em><\/p>\n

Below, you can see 3 of the 16 page variations. Which do you think performed best?
\n\"\"<\/a><\/p>\n

The title tipped it off, but only one element positively impacted the download conversion rate–the download stats box. The main features box, the deep footer, and the switching tips all drove conversions down. <\/p>\n

The simplest variation (far right image) performed the best, increasing the download conversion rate by 2.3%, at the 99% confidence interval. This improvement translates to 1.7 million additional Firefox downloads per year! <\/p>\n

Next up, we will run similar tests on our non-IE download page<\/a> and on our localized pages<\/a>. If we hit the same 2.3% conversion improvement across these pages, we’ll drive 5.4 million additional downloads per year! And, if just 25% of those downloads convert into daily users, we’ll have added as many users as we have in all of Argentina.<\/p>\n

We’ll also explore why the simpler variation performed better. One hypotheses is that more users converted because the page loaded faster. Another is that Take a Tour<\/em> and Reasons to Switch<\/em> elements are more visible and more persuasive. Have other ideas? Please leave them in the comments!<\/p>\n","protected":false},"excerpt":{"rendered":"

With our first multivariate test, we set out to answer a simple question: which design elements drive downloads on the IE landing page? We didn’t know which elements were most effective, but expected each would help persuade visitors to ditch … Continue reading<\/a><\/p>\n","protected":false},"author":1557,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[827],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/2740"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/users\/1557"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/comments?post=2740"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/2740\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/media?parent=2740"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/categories?post=2740"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/tags?post=2740"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}