{"id":18,"date":"2007-12-27T16:40:12","date_gmt":"2007-12-27T23:40:12","guid":{"rendered":"http:\/\/blog.mozilla.org\/metrics\/2007\/12\/27\/what-did-our-advertising-experiment-really-tell-us\/"},"modified":"2019-09-18T12:07:16","modified_gmt":"2019-09-18T19:07:16","slug":"what-did-our-advertising-experiment-really-tell-us","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/metrics\/2007\/12\/27\/what-did-our-advertising-experiment-really-tell-us\/","title":{"rendered":"What did our advertising experiment really tell us?"},"content":{"rendered":"<p>I did an admittedly poor job of <a href=\"http:\/\/blog.mozilla.org\/metrics\/2007\/12\/20\/mozilla-online-advertising-part-2-experiment-findings-and-marginal-cost\/\" target=\"_blank\" rel=\"noopener noreferrer\">framing my last post<\/a> in its broader context.  We set out to discover the true effect of paid search advertising on a change (or increase) in number of Firefox downloads, and in the process, both the experiment and analysis were focused narrowly on one channel (US search) through which Firefox downloaders arrive (to the exclusion of all other channels).<\/p>\n<p>In the broadest universe of Firefox downloads, what did our experiment tell us?<\/p>\n<ul>\n<li>Over any two-day period, Mozilla sees about 1 million downloads of Firefox<\/li>\n<li>Approximately half of these downloads are for our en-US version and about half are for our <a href=\"http:\/\/www.mozilla.com\/en-US\/firefox\/all.html\" target=\"_blank\" rel=\"noopener noreferrer\">localized language versions<\/a><\/li>\n<li>We focus our search marketing efforts primarily on the en-US market<\/li>\n<li>Within this specific market, <a href=\"http:\/\/blog.mozilla.org\/metrics\/2007\/11\/26\/mozilla-online-advertising-%e2%80%93-an-experiment\/\" target=\"_blank\" rel=\"noopener noreferrer\">about 38% of downloaders<\/a> come through the search channel (organic + paid)<\/li>\n<li>Within this narrowly defined download channel \u2013 en-US search \u2013 about 75% is attributable to organic search and 25% to paid search.<\/li>\n<li>Over the two-day periods in our experiment, we saw an average of 21K additional downloads as a result of our paid search advertising<\/li>\n<li>Thus, by participating in paid search advertising, we are currently able to increase the total number of global Firefox downloads by approximately 2% (increasing 1 million by 21K).<\/li>\n<\/ul>\n<p>A few last notes about this 2% estimate:<\/p>\n<ol>\n<li>It\u2019s based on experiment numbers representing 80% of our en-US search traffic, so the true effect is closer to 2.5% (if we extrapolate the 21K increase) before considering the next point.<\/li>\n<li>When we have our paid search advertising \u201cturned off,\u201d the \u201closs\u201d of downloads might be far less than the 21K indicated above.   These prospective Firefox downloaders may simply be diverted to the \u201cOther\u201d traffic category (e.g., our affiliates program); unfortunately, we don\u2019t have a good way to detect and measure such an occurrence.  So, the true effect, rather than 2.5%, might be closer to 1%.<\/li>\n<\/ol>\n<p>Summing it all up\u2026 <a href=\"http:\/\/freakonomics.blogs.nytimes.com\/2007\/12\/21\/mozilla-gets-freaky\/\" target=\"_blank\" rel=\"noopener noreferrer\">we need to do more experiments<\/a>, and from a cost-benefit standpoint, we need to decide if our marketing spend on paid search advertising is worth the additional 1% of Firefox downloads (alternately, we can work towards more effective strategies and tactics within this channel).<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I did an admittedly poor job of framing my last post in its broader context. We set out to discover the true effect of paid search advertising on a change (or increase) in number of Firefox downloads, and in the &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/metrics\/2007\/12\/27\/what-did-our-advertising-experiment-really-tell-us\/\">Continue reading<\/a><\/p>\n","protected":false},"author":60,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[101],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/18"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/users\/60"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/comments?post=18"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/18\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/media?parent=18"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/categories?post=18"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/tags?post=18"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}