{"id":62659,"date":"2016-12-07T00:00:00","date_gmt":"2016-12-07T00:00:00","guid":{"rendered":"http:\/\/blog.mozilla.org\/foxtail\/2016\/12\/07\/how-to-lie-with-analytics\/"},"modified":"2016-12-07T00:00:00","modified_gmt":"2016-12-07T00:00:00","slug":"how-to-lie-with-analytics","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/","title":{"rendered":"How to Lie with Analytics"},"content":{"rendered":"<p><em>The following guest post, &#8220;How to Lie with Analytics&#8221; was written by Ted Byfield for Mozilla&#8217;s Internet Citizen blog. <\/em><\/p>\n<p><em>Learn more about the history of data analytics and visualization at <b>The Glass Room<\/b> through December 18, 2016. <\/em><a href=\"https:\/\/theglassroomnyc.org\/schedule\/\"><em>Ted will be hosting a session and guided tour on December 11 at 3 p.m.<\/em> <\/a><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter wp-image-75 size-large\" src=\"http:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2016\/12\/connect-dots_cropped-1024x427.jpg\" alt=\"analytics constellation\" width=\"1024\" height=\"427\" \/><\/p>\n<h2><b>How to lie with analytics<\/b><\/h2>\n<p>There&#8217;s a particular kind of image that&#8217;s associated with &#8220;big data&#8221; &#8212; you&#8217;ve probably seen it. Let&#8217;s call it the <i>luminous city<\/i>. The background &#8212; maybe a city, a nation, or the entire earth &#8212; is stark, often dark. Against that backdrop we see thousands of radiant trajectories fanning out and spanning across empty expanses, intertwined tendrils dispersing and converging. Aaron Koblin&#8217;s &#8220;<a href=\"http:\/\/www.aaronkoblin.com\/work\/flightpatterns\/\">Flight Patterns<\/a>&#8221; (2011) is one famous example; Paul Butler\u2019s \u201c<a href=\"https:\/\/www.facebook.com\/note.php?note_id=469716398919\">Visualizing Friendships<\/a>\u201d (2010) for Facebook is another. There are many more.<\/p>\n<p>Images like this are supposed to show how our lives coincide &#8212; in cars and on planes, on the internet or social networks, whatever. What they don\u2019t show is everyone and everything that isn&#8217;t so \u201cconnected.\u201d The poorer neighborhoods, industrial and mixed-use areas, the people, places, and things forgotten in one way or another by &#8220;innovation.&#8221; They disappear into the background as if they never even existed. In this way, visualizations can often help us to <i>forget<\/i> many of those gritty, obstinate, and inconvenient worlds.<\/p>\n<p>When people talk about visualization, they often emphasize how it can &#8220;surface&#8221; important patterns and correlations. But surfacing one thing means submerging everything else &#8212; in other words, forgetting it. Hiding isn&#8217;t a bug of visualization, it&#8217;s a feature. It\u2019s not just fanciful visualizations that do it: their poor cousins, spreadsheets, do it too &#8212; with much more impact.<\/p>\n<p>My point isn&#8217;t to condemn visualization, of course &#8212; that would be ridiculous. Every serious decision made anywhere in the world now &#8212; in government, business, manufacturing, construction, science, education, civil society, and the military &#8212; is fundamentally shaped by visualization. <i>That<\/i> is why we need to think more seriously about how visualization works &#8212; and also how it doesn&#8217;t work. But the questions we ask shouldn\u2019t just be functional\u00a0&#8212; about whether what we hope to discover or communicate is clear, effective, persuasive, or elegant. We also need to ask about the unintended effects: what disappeared into the background?<\/p>\n<h2><b>Lies, damn lies, and analytics<\/b><\/h2>\n<p>So what does this have to do with analytics? And how <i>do<\/i> you lie with them, anyway?<\/p>\n<p>Along with the adage that \u201cthere are three kinds of lies: lies, damned lies, and statistics,\u201d the phrase <i>How to Lie with Statistics<\/i> is one of the main references for what many people associate with statistics: <i>lies<\/i>. The phrase was the title of a <a href=\"https:\/\/www.worldcat.org\/title\/how-to-lie-with-statistics\/oclc\/225473&#038;referer=brief_results\">1954 book by Darrell Huff<\/a> &#8212; the first popular book to tackle statistics. To this day, people often note its breezy style and describe it as current; but emphasizing its style obscures key ways in which the book is very dated.<\/p>\n<p>The goalposts have moved in the last sixty-odd years. When Huff wrote it, data wasn\u2019t an everyday fact at work, home, and everywhere between. It was still mostly hidden away in bean-counting back offices and an occasional feature of print journalism. Now, though, data is front and center &#8212; for example, in &#8220;data-driven&#8221; journalism, where the data <i>is<\/i> the story. For the outlets that publish those stories, analytics play a decisive role in what kinds of stories are developed, presented, and promoted. The same is true, in different ways, everywhere else data appears: it describes the questions we ask. As in the \u201cluminous cities\u201d example I began with, we should ask ourselves what kinds of stories <i>are not<\/i> developed and what kinds of data <i>aren\u2019t<\/i> collected.<\/p>\n<p>Huff\u2019s book wasn\u2019t really a how-to manual for lying with data, it was a primer in how not to be lied to. And that problem remains just as real decades later: how not to be lied to. The challenge now is to recognize where we can think critically and practically about the many ways that statistics and analytics shape and distort our own &#8212; and others\u2019 &#8212; lives.<\/p>\n<h2><b>So&#8230;how <\/b><b><i>do<\/i><\/b><b> you lie with analytics?<\/b><\/h2>\n<p>The first step is to remember that <i>analytics<\/i>, however sophisticated, is an <i>evolutionary<\/i> step in, not a <i>revolutionary<\/i> break from, statistics. True, analytics also involves some important distinctions about how data is processed and analyzed. But the field of statistics has changed dramatically over the last two to three centuries, and on a basic level analytics is just another step. And if we can lie with statistics, we can lie with analytics.<\/p>\n<p>Most people will never command what Mark Surman, executive director of the Mozilla Foundation, called &#8220;<a href=\"https:\/\/blog.mozilla.org\/internetcitizen\/2016\/11\/15\/rise-digital-empires\/\">data empires<\/a>.&#8221; And &#8212; hopefully &#8212; they won\u2019t break or hack into data centers. Nor can most people immerse themselves in the esoteric world of <a href=\"http:\/\/governingalgorithms.org\/\">governing algorithms<\/a>. These aren&#8217;t viable options. So what <i>is<\/i> viable? What can you do?<\/p>\n<p>I\u2019d argue that that one answer is right in front of you, in the steady parade of visual presentations of data and statistics you see every day. It&#8217;s no longer just a question of the informed consumer casting a skeptical eye on how a handful of facts and figures are used in front-page stories, though. Instead, it begins with a simple set of questions: What else is in the background? What\u2019s in all those empty, &#8220;negative&#8221; spaces between, behind, and around the statistics we see? And, if or when you&#8217;re called upon to act on those images of data, you can factor in the gritty, obstinate, and inconvenient worlds they often hide.<\/p>\n<hr \/>\n<p><i>Ted Byfield is a retired artist, frequent editor, escaped urbanist, governance hobbyist, perpetual collaborator, and recovering academic. He\u2019s moderated nettime for a really long time and, more recently,co-founded the Open Syllabus Project. He\u2019s currently writing a history of what people imagine information looks like, which isn\u2019t at all what you\u2019d imagine. <\/i><\/p>\n<p><i>Join Ted at <\/i><a href=\"https:\/\/theglassroomnyc.org\/schedule\/\"><i>The Glass Room<\/i><\/a><i> on Sunday, Dec. 11 at 3 p.m. to learn more about \u201cHow to lie with analytics.\u201d<\/i><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The following guest post, &#8220;How to Lie with Analytics&#8221; was written by Ted Byfield for Mozilla&#8217;s Internet Citizen blog. Learn more about the history of data analytics and visualization at The Glass Room through December 18, 2016. Ted will be hosting a session and guided tour on December 11 at 3 p.m. How to lie [&hellip;]<\/p>\n","protected":false},"author":727,"featured_media":20075,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[30],"tags":[],"coauthors":[],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to Lie with Analytics, Ted Byfield - Mozilla Internet Citizen<\/title>\n<meta name=\"description\" content=\"Guest author Ted Byfield on how to lie with analytics. There&#039;s a particular kind of image associated with &quot;big data.&quot; Let&#039;s call it the luminous city.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/\",\"url\":\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/\",\"name\":\"How to Lie with Analytics, Ted Byfield - Mozilla Internet Citizen\",\"isPartOf\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2016\/12\/connect-dots_cropped.jpg\",\"datePublished\":\"2016-12-07T00:00:00+00:00\",\"dateModified\":\"2016-12-07T00:00:00+00:00\",\"author\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/5c987afc4f606be73692d2acfdd1316c\"},\"description\":\"Guest author Ted Byfield on how to lie with analytics. There's a particular kind of image associated with \\\"big data.\\\" Let's call it the luminous city.\",\"breadcrumb\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#primaryimage\",\"url\":\"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2016\/12\/connect-dots_cropped.jpg\",\"contentUrl\":\"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2016\/12\/connect-dots_cropped.jpg\",\"width\":1200,\"height\":500},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blog.mozilla.org\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to Lie with Analytics\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/#website\",\"url\":\"https:\/\/blog.mozilla.org\/en\/\",\"name\":\"The Mozilla Blog\",\"description\":\"News and Updates about Mozilla\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.mozilla.org\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/5c987afc4f606be73692d2acfdd1316c\",\"name\":\"M.J. Kelly\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/image\/70718b02fa9f11d88288b937f1da2ac1\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d61ff6a9eb6dd324df20cb773e6c416e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d61ff6a9eb6dd324df20cb773e6c416e?s=96&d=mm&r=g\",\"caption\":\"M.J. Kelly\"},\"description\":\"Mozilla Communications\",\"url\":\"https:\/\/blog.mozilla.org\/en\/author\/mjkellymozilla-com\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to Lie with Analytics, Ted Byfield - Mozilla Internet Citizen","description":"Guest author Ted Byfield on how to lie with analytics. There's a particular kind of image associated with \"big data.\" Let's call it the luminous city.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/","url":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/","name":"How to Lie with Analytics, Ted Byfield - Mozilla Internet Citizen","isPartOf":{"@id":"https:\/\/blog.mozilla.org\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#primaryimage"},"image":{"@id":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#primaryimage"},"thumbnailUrl":"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2016\/12\/connect-dots_cropped.jpg","datePublished":"2016-12-07T00:00:00+00:00","dateModified":"2016-12-07T00:00:00+00:00","author":{"@id":"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/5c987afc4f606be73692d2acfdd1316c"},"description":"Guest author Ted Byfield on how to lie with analytics. There's a particular kind of image associated with \"big data.\" Let's call it the luminous city.","breadcrumb":{"@id":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#primaryimage","url":"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2016\/12\/connect-dots_cropped.jpg","contentUrl":"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2016\/12\/connect-dots_cropped.jpg","width":1200,"height":500},{"@type":"BreadcrumbList","@id":"https:\/\/blog.mozilla.org\/en\/firefox\/how-to-lie-with-analytics\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.mozilla.org\/en\/"},{"@type":"ListItem","position":2,"name":"How to Lie with Analytics"}]},{"@type":"WebSite","@id":"https:\/\/blog.mozilla.org\/en\/#website","url":"https:\/\/blog.mozilla.org\/en\/","name":"The Mozilla Blog","description":"News and Updates about Mozilla","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.mozilla.org\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/5c987afc4f606be73692d2acfdd1316c","name":"M.J. Kelly","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/image\/70718b02fa9f11d88288b937f1da2ac1","url":"https:\/\/secure.gravatar.com\/avatar\/d61ff6a9eb6dd324df20cb773e6c416e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d61ff6a9eb6dd324df20cb773e6c416e?s=96&d=mm&r=g","caption":"M.J. Kelly"},"description":"Mozilla Communications","url":"https:\/\/blog.mozilla.org\/en\/author\/mjkellymozilla-com\/"}]}},"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/posts\/62659"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/users\/727"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/comments?post=62659"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/posts\/62659\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/media\/20075"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/media?parent=62659"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/categories?post=62659"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/tags?post=62659"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/coauthors?post=62659"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}