{"id":5159,"date":"2010-07-01T16:09:04","date_gmt":"2010-07-01T23:09:04","guid":{"rendered":"http:\/\/9.284"},"modified":"2010-07-01T16:09:04","modified_gmt":"2010-07-01T23:09:04","slug":"interactive-heat-map","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/labs\/2010\/07\/interactive-heat-map\/","title":{"rendered":"The interactive heat map for Firefox Main Window usage!"},"content":{"rendered":"<p>Mozilla Metrics team has created a really awesome interactive heat map to visualize the data from the recent <a href=\"\/\/testpilot.mozillalabs.com\">Test Pilot <\/a> study of <a href=\"https:\/\/testpilot.mozillalabs.com\/testcases\/toolbar\">Firefox\u2019s main window<\/a>. The team also publish <a href=\"http:\/\/blog.mozilla.org\/metrics\/2010\/07\/01\/firefox-main-window-study-a-heatmap-visualization\/\">a great blog post<\/a> sharing findings from this study. Check it out below!<\/p>\n<p>&#8220;Last month, Mike Beltzner shared an early product plan for the next<br \/>\nversion of Firefox with the Mozilla community and presented our <a href=\"http:\/\/blog.mozilla.org\/blog\/2010\/05\/10\/firefox-4-vision-fast-powerful-and-empowering\/\">vision<br \/>\nfor Firefox 4<\/a>. A big upgrade coming with Firefox 4 is the new theme<br \/>\nproject: creating a new, sleek, and simpler default theme for the<br \/>\nbrowser. The UX team has been working tirelessly on this \u2013 streamlining<br \/>\nand modernizing the user interface, particularly on Windows, given the<br \/>\naesthetic changes introduced by Vista and Windows 7. <a href=\"http:\/\/blog.mozilla.org\/metrics\/files\/2010\/06\/Firefox4.png\"><img decoding=\"async\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2010\/06\/Firefox4.png\" alt=\"\" width=\"325\" class=\"aligncenter size-full wp-image-3761\" \/><\/a><br \/>\nNote: Plans May Change.<\/p>\n<p>Metrics and Test Pilot have been doing what we can to help guide the UX<br \/>\nteam as they create an optimized design. A few months ago, Test Pilot<br \/>\nreleased the <a href=\"http:\/\/blog.mozilla.org\/metrics\/2010\/03\/15\/menu-item-usage-study-part-i\/\">Menu Item Usage Study<\/a>, from which we gained valuable insight into how<br \/>\nusers interact with the menu bar. And a few weeks ago, we released the<br \/>\n<a href=\"https:\/\/testpilot.mozillalabs.com\/testcases\/toolbar\">Main Window Usage Study<\/a> to capture the remaining major UI elements of the browser,<br \/>\nand provide more data-driven recommendations.<br \/>\n<!--more--><br \/>\nToday, we&#8217;d like to present some initial findings from this study. Like<br \/>\nprevious Test Pilot studies, the main window study ran for 5 days and<br \/>\ncovered Firefox versions 3.5 and up. The sample consists of 9,667 users<br \/>\nwho have opted into the Test Pilot program AND opted to submit their data.<\/p>\n<p>We usually display study results in charts and graphs on this blog, but<br \/>\nfor this study, we were inspired by the work of principal designer, Alex<br \/>\nFaaborg, and came up with a slightly different kind of visualization.<br \/>\nBack in March, Alex <a href=\"http:\/\/blog.mozilla.org\/faaborg\/2010\/03\/23\/visualizing-usage-of-the-firefox-menu-bar\/\">created a heatmap<\/a> to visualize the menu study data<br \/>\n(his post is also a great example of how the UX team is using Test Pilot data to<br \/>\ninform design decisions). Overlaying the actual UI and putting the data in context<br \/>\nwas really useful, so with his help, we expanded on the idea and constructed<br \/>\n<a href=\"https:\/\/heatmap.mozillalabs.com\/mozmetrics\">this interactive, web-based heatmap<\/a> for the main window study:<\/p>\n<p><a href=\"https:\/\/heatmap.mozillalabs.com\/mozmetrics\"><img decoding=\"async\" src=\"http:\/\/blog.mozilla.org\/metrics\/files\/2010\/06\/blog.png\" alt=\"\" width=\"500\" class=\"aligncenter size-full wp-image-3816\" \/><\/a><br \/>\n(image links to heatmap)<\/p>\n<p>Currently, the heatmap can display the usage data in two ways. Selecting<br \/>\n&#8216;Used by x% of users&#8217; displays the percentage of users who clicked each<br \/>\nUI element at least one time, and &#8216;Clicks per user&#8217; is simply the<br \/>\nfrequency click count for each item, divided by the number of users in<br \/>\nthe sample (we normalize for sample size to make comparisons across the<br \/>\ndifferent subsets more meaningful). The first approach is useful because<br \/>\nit mitigates the effect of outliers, since each person who clicks an<br \/>\nitem counts only once, whether they clicked the item 1 time or 25,000<br \/>\ntimes. The obvious drawback is that this metric fails to capture<br \/>\nintensity of use, which &#8216;Clicks per user&#8217; does capture.<\/p>\n<p>You can also choose to examine specific subsets within the sample; there<br \/>\nare selectors to display breakdowns by OS and by self-reported<br \/>\ncomputer\/web skill level. Unfortunately, you cannot combine these<br \/>\nsubsets yet; that is, while you can look at data for just Windows users<br \/>\nor for just Advanced users, you cannot look at data for the subset of<br \/>\nAdvanced, Windows users. Our sample is too small for such sub-setting<br \/>\nright now, but we&#8217;ll add this ability as soon as our sample size increases.<\/p>\n<p>Be sure not to miss the table to the right of the heatmap &#8211; it lists all<br \/>\nthe UI elements in descending order and also outlines the color<br \/>\nspectrum. In addition, if you are viewing data for a subset, the table<br \/>\nwill show the differences between the currently selected subset and the<br \/>\nother related subsets to make comparison easy (the differences for the<br \/>\n&#8216;Used by x% of users&#8217; filter are simply one subset minus the other, the<br \/>\ndifferences for the &#8216;Clicks per user&#8217; filter are in percentage change).<\/p>\n<p>We&#8217;ll discuss results more thoroughly in future blog posts, here are a<br \/>\nfew findings that immediately jumped out to us. As always, these<br \/>\nfindings apply to our sample of Test Pilot users only, and we realize<br \/>\nthis sample is not likely representative of the population of Firefox<br \/>\nusers as a whole. Furthermore, its important to remember that usage data<br \/>\nlike this is only one part of a rigorous design process, and that it<br \/>\nalone will not dictate any design decisions.<\/p>\n<ul>\n<li>The Back button is used far more often than any other navigation<br \/>\nelement (by which we mean the Back, Forward, Reload, Stop, and Home<br \/>\nbuttons). 93.1% of study participants used the Back button at least<br \/>\nonce, and on average, each user clicked Back 66.2 times over the 5 days<br \/>\n&#8211; that&#8217;s 3x more clicks than the Reload button, 10x more than the Home<br \/>\nbutton, and over 30x more than the Forward and Stop buttons! <\/li>\n<li>Of all items that are not in the Firefox main window by default, the<br \/>\nNew Tab Button (Navigation Toolbar) is the most commonly used, both by %<br \/>\nof users and frequency count. Looking at click counts, the New Tab<br \/>\nButton (Navigation Toolbar) is a more popular way to generate new tabs<br \/>\nthan the New Tab Button (Tab Bar) that is located in the tab strip by<br \/>\ndefault. The New Tab Button (Navigation Toolbar) is also more often used<br \/>\nthan the default UI elements Bookmark Star and RSS Icon by click count.<\/li>\n<li>Another conspicuous result is the disparate use of the scroll arrows<br \/>\nin comparison to the scroll slider. This holds true for both the<br \/>\nvertical scroll bar and the horizontal scroll bar; while 89% of people<br \/>\nused the vertical scroll slider, only 21.2% and 16.6% of people used the<br \/>\nup and down arrows. And although 42.8% of users used the horizontal<br \/>\nscroll slider, only 2.1% and 0.9% clicked the left and right arrows to<br \/>\nscroll.<\/li>\n<\/ul>\n<p>Besides putting the data in a spatial context, another benefit of this<br \/>\nvisualization is that it is easy to reuse, update, and improve. We plan<br \/>\nto add more data, more breakdowns, and the ability to synthesize<br \/>\nmultiple subsets in the near future. We also want to improve the<br \/>\nrobustness of our findings by filtering out certain extensions (e.g.<br \/>\nsome users have the Google Toolbar and might be searching through that<br \/>\nchannel instead of the integrated search box), and by increasing our<br \/>\nsample size.<\/p>\n<p>In addition, the heatmap will be updated over the course of the Firefox<br \/>\n4 beta program. Hopefully, this visualization will help us understand<br \/>\nhow the various UI changes affect user behavior, and ensure that these<br \/>\ndesign decisions are in fact improving the product for our (beloved)<br \/>\nend-users. Look for these updates soon!<\/p>\n<p>Thanks again to Alex Faaborg, and to all Test Pilot users for opting-in<br \/>\nto provide us with the data. If you&#8217;d like to help us understand how<br \/>\npeople use Firefox and build a better browser, head over to the <a href=\"https:\/\/testpilot.mozillalabs.com\">Test Pilot website<\/a><br \/>\nto learn more and download the add-on. And as always, please feel<br \/>\nfree to download the <a href=\"https:\/\/testpilot.mozillalabs.com\/testcases\/toolbars\/aggregated-data.html\"> raw data<\/a> and supplement our analysis with your own!&#8221;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Mozilla Metrics team has created a really awesome interactive heat map to visualize the data from the recent Test Pilot study of Firefox\u2019s main window. The team also publish a great blog post sharing findings from this study. Check it &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/labs\/2010\/07\/interactive-heat-map\/\">Continue reading<\/a><\/p>\n","protected":false},"author":309,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/posts\/5159"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/users\/309"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/comments?post=5159"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/posts\/5159\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/media?parent=5159"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/categories?post=5159"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/labs\/wp-json\/wp\/v2\/tags?post=5159"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}