{"id":3939,"date":"2019-03-22T08:59:52","date_gmt":"2019-03-22T15:59:52","guid":{"rendered":"http:\/\/blog.mozilla.org\/sumo\/?p=3939"},"modified":"2019-03-22T08:59:52","modified_gmt":"2019-03-22T15:59:52","slug":"sumo-a-b-experiments","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/sumo\/2019\/03\/22\/sumo-a-b-experiments\/","title":{"rendered":"SUMO A\/B Experiments"},"content":{"rendered":"<p>This year the SUMO team is focused on learning what to improve on our site. As part of that, we spent January setting support.mozilla.org up for A\/B testing and last week we ran our first test!<\/p>\n<p>The goal of the test was to run a series of experiments on individual Knowledge Base articles to:<\/p>\n<ul>\n<li>Improve navigation from KB article to KB article (in-article suggestions)<\/li>\n<li>Improve design of KB articles to ensure users better understand content and can engage with content faster<\/li>\n<\/ul>\n<p>The two tests we are running are trying a bunch of different things, such as screengrabs, video clips, highlights, better feedback options on articles, and better navigation.<\/p>\n<p><strong>Version A: Breadcrumbs<\/strong><\/p>\n<ul>\n<li>Screengrabs<\/li>\n<li>Ratings at different parts of the page<\/li>\n<li>Highlights<\/li>\n<li>On both experiments we have a section of related articles at the bottom.<\/li>\n<\/ul>\n<p><a href=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled.png\"><img decoding=\"async\" loading=\"lazy\" class=\"wp-image-3945 size-medium alignleft\" src=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled-252x174.png\" alt=\"\" width=\"252\" height=\"174\" srcset=\"https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled-252x174.png 252w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled-768x530.png 768w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled-600x414.png 600w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled.png 1538w\" sizes=\"(max-width: 252px) 100vw, 252px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><em>A breadcrumb menu should make it clearer to users where they are.<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled3.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-3947 alignleft\" src=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled3-252x242.png\" alt=\"\" width=\"252\" height=\"242\" srcset=\"https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled3-252x242.png 252w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled3-768x737.png 768w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled3-600x576.png 600w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Untitled3.png 956w\" sizes=\"(max-width: 252px) 100vw, 252px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><em>Feedback points through up\/down icons with a follow up question to understand to allow for more feedback.<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-12.58.28-PM.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-3944 alignleft\" src=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-12.58.28-PM-252x78.png\" alt=\"\" width=\"252\" height=\"78\" srcset=\"https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-12.58.28-PM-252x78.png 252w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-12.58.28-PM-768x239.png 768w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-12.58.28-PM-600x187.png 600w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-12.58.28-PM.png 964w\" sizes=\"(max-width: 252px) 100vw, 252px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><em>Highlights in the text to help the user see the important areas.<\/em><\/p>\n<p>&nbsp;<\/p>\n<p><strong>Version B: Hamburger menu &#8211; Categories<br \/>\n<\/strong><\/p>\n<ul>\n<li>One rating at the end of the page<\/li>\n<li>No highlights in text<\/li>\n<li>On both experiments we have a section of related articles at the bottom.<\/li>\n<\/ul>\n<p><a href=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.41-PM2.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-3948 alignleft\" src=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.41-PM2-252x117.png\" alt=\"\" width=\"252\" height=\"117\" srcset=\"https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.41-PM2-252x117.png 252w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.41-PM2-768x357.png 768w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.41-PM2-600x279.png 600w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.41-PM2.png 900w\" sizes=\"(max-width: 252px) 100vw, 252px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p><em>Hamburger menu to allow for users to focus on the content not the menu.<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.52-PM3.png\"><img decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-3949 alignleft\" src=\"http:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.52-PM3-252x211.png\" alt=\"\" width=\"252\" height=\"211\" srcset=\"https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.52-PM3-252x211.png 252w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.52-PM3-768x645.png 768w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.52-PM3-600x504.png 600w, https:\/\/blog.mozilla.org\/sumo\/files\/2019\/03\/Screen-Shot-2019-03-05-at-1.12.52-PM3.png 1070w\" sizes=\"(max-width: 252px) 100vw, 252px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><em>Drop down to see wider menu.<\/em><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>The test will run for the next 2-3 weeks and we will report back on here and our weekly SUMO meeting on the results and next steps.<\/p>\n<p>The test is currently serving for 50% of visitors and you can \u2018maybe\u2019 see the tests by going <a href=\"https:\/\/support.mozilla.org\/en-US\/kb\/insecure-password-warning-firefox\">here<\/a> or <a href=\"https:\/\/support.mozilla.org\/en-US\/kb\/enable-and-disable-cookies-website-preferences\">here<\/a>.<\/p>\n<p>SUMO staff team<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This year the SUMO team is focused on learning what to improve on our site. As part of that, we spent January setting support.mozilla.org up for A\/B testing and last &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/sumo\/2019\/03\/22\/sumo-a-b-experiments\/\">Read more<\/a><\/p>\n","protected":false},"author":422,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[571],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/posts\/3939"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/users\/422"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/comments?post=3939"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/posts\/3939\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/media?parent=3939"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/categories?post=3939"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/sumo\/wp-json\/wp\/v2\/tags?post=3939"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}