{"id":570,"date":"2009-05-28T10:05:25","date_gmt":"2009-05-28T17:05:25","guid":{"rendered":"http:\/\/blog.mozilla.org\/metrics\/?p=570"},"modified":"2019-09-18T12:05:41","modified_gmt":"2019-09-18T19:05:41","slug":"improving-a-users-experience-with-firefox-support","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/metrics\/2009\/05\/28\/improving-a-users-experience-with-firefox-support\/","title":{"rendered":"Improving a User’s Experience with Firefox Support"},"content":{"rendered":"

The SUMO team has been dedicated to improving the support.mozilla.com<\/a> site in many different ways.\u00a0 One such effort has been around website optimization and testing.\u00a0 We’ve previously touched on a broader roadmap<\/a> for Mozilla, and as part of that vision, the SUMO team is implementing some A\/B tests at support.mozilla.com.\u00a0 As a starting point, we launched this super simple A\/B test last month<\/a>.\u00a0 The thought behind it was this \u2013 we already have two slightly different designs for the SUMO homepage, so why not test them side-by-side to see if there’s any discernible difference in how users interact with each version (i.e., does one provide a better experience for users?).<\/p>\n

First, let’s look at the two page versions…<\/p>\n

Version #1 (in-product start page):<\/strong><\/p>\n

\"help1_page\"<\/a><\/p>\n

Version #2 (support.mozilla.com start page):<\/strong><\/p>\n

<\/strong><\/p>\n

\"help2_page\"<\/a><\/p>\n

You’ll notice that the designs are relatively similar\u2026 the only difference being the content below the knowledge base search box.\u00a0 As expected, the results weren’t particularly telling.\u00a0 (Remember \u2013 this was a lightweight and easy test to implement, so it behooved us to at least try.)<\/p>\n

Version #2 showed a slightly greater bounce rate (+0.2%).\u00a0 This is a borderline case of “statistically significant”, so we shouldn’t read too much into it.\u00a0 Conversely, of the people taking some action on these pages (e.g., clicking on a link\/article, searching, etc.), Version #2 had a greater percentage of people utilizing the knowledge base search box (which is generally the desired outcome).\u00a0 Thus, at an aggregate, there doesn’t appear to be a “winning” version of the SUMO start page.<\/p>\n

\"actions_taken_by_users_at_sumo_v3\"<\/a><\/p>\n

Next up, the SUMO team is planning to soon roll-out a much more substantial A\/B test at support.mozilla.com.\u00a0 With a somewhat radically different page design<\/a>, our expectations for this next test<\/a> are different.\u00a0 In other words, the more variation that is tested generally leads to bigger differences in the results.\u00a0 Stay tuned!<\/p>\n","protected":false},"excerpt":{"rendered":"

The SUMO team has been dedicated to improving the support.mozilla.com site in many different ways.\u00a0 One such effort has been around website optimization and testing.\u00a0 We’ve previously touched on a broader roadmap for Mozilla, and as part of that vision, … Continue reading<\/a><\/p>\n","protected":false},"author":60,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[101],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/570"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/users\/60"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/comments?post=570"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/posts\/570\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/media?parent=570"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/categories?post=570"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/metrics\/wp-json\/wp\/v2\/tags?post=570"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}