{"id":350,"date":"2015-01-16T22:19:01","date_gmt":"2015-01-16T22:19:01","guid":{"rendered":"http:\/\/blog.mozilla.org\/webqa\/?p=350"},"modified":"2015-01-16T22:19:01","modified_gmt":"2015-01-16T22:19:01","slug":"web-qa-2014-year-in-review","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/fxtesteng\/2015\/01\/16\/web-qa-2014-year-in-review\/","title":{"rendered":"Web QA: 2014 &#8211; Year in Review"},"content":{"rendered":"<p>(I love this team so much &#8212; and we&#8217;re not all represented, here, even!)<\/p>\n<p><a href=\"http:\/\/blog.mozilla.org\/fxtesteng\/files\/2014\/12\/webqa-team2-690x401.jpg\"><img decoding=\"async\" loading=\"lazy\" class=\"alignnone  wp-image-337\" src=\"http:\/\/blog.mozilla.org\/fxtesteng\/files\/2014\/12\/webqa-team2-690x401-252x146.jpg\" alt=\"webqa-team2-690x401\" width=\"369\" height=\"214\" \/><\/a><\/p>\n<p>Shamelessly stealing a page from Laura Thomson&#8217;s &#8220;<a href=\"http:\/\/www.laurathomson.com\/2014\/12\/2014-engineering-operations-year-in-review\/\">2014: Engineering Operations Year in Review<\/a>&#8221; blogpost, <a href=\"http:\/\/quality.mozilla.org\/teams\/web-qa\/\">Web QA<\/a> would also like to take this slightly belated opportunity to highlight many &#8212; but certainly not all &#8212; team accomplishments:<\/p>\n<p><strong>Infrastructure:<\/strong><\/p>\n<ul>\n<li>started the process of creating a new, publicly open Jenkins instance for all our automation<\/li>\n<li>added Windows virtual machines in SCL3<\/li>\n<li>moved both <a href=\"https:\/\/ci.mozilla.org\/view\/Bouncer\/\">Bouncer<\/a> and <a href=\"https:\/\/ci.mozilla.org\/view\/Snippets\/\">Snippets<\/a> test automation into the public, Webdev Jenkins (<a href=\"http:\/\/ci.mozilla.org\">ci.mozilla.org<\/a>)<\/li>\n<li>built out and maintained a <a href=\"http:\/\/www.meetup.com\/seleniumsanfrancisco\/events\/211095862\/\">40+ device Firefox OS test-automation lab<\/a><\/li>\n<\/ul>\n<p><strong>Marketplace:<\/strong><\/p>\n<ul>\n<li>got <a href=\"https:\/\/github.com\/mozilla\/marketplace-tests-gaia\/\">Marketplace Payments tests<\/a> (UI flow, using <a href=\"https:\/\/developer.mozilla.org\/en-US\/docs\/Mozilla\/QA\/Marionette\">Marionette<\/a>) running on a Firefox OS Flame device using <a href=\"https:\/\/github.com\/mozilla\/zippy\/\">Zippy<\/a><\/li>\n<li>switched Android tests over to <a href=\"http:\/\/appium.io\/\">Appium<\/a>, using Sauce Labs<\/li>\n<li>shipped Marketplace on low-spec Tarako devices\/branch<\/li>\n<li>shipped serverless in-app payments<\/li>\n<li>supported (both manually and with automation) the split of AMO and Marketplace<\/li>\n<li>shipped update notifications and feature detection for Hello and WMW<\/li>\n<li>shipped Operator Dashboard<\/li>\n<li>shipped Curation tools<\/li>\n<li>shipped Feed!<\/li>\n<li>shipped Bango dev-portal integration into DevHub<\/li>\n<li>shipped single-page webpay<\/li>\n<li>migrated from Persona to FxA (and supported both, through manual testing and automation, throughout the transition)<\/li>\n<li>shipped support for pre-installed apps<\/li>\n<li>shipped support for hidden apps<\/li>\n<li>shipped recommended apps<\/li>\n<li>shipped support for Newsletters<\/li>\n<li>shipped communication dashboard for\u00a0 interaction between reviewers and developers<\/li>\n<li>enabled payments in regions like Mexico and worked extensively on getting payments working on Bangladesh<\/li>\n<\/ul>\n<p><strong>MDN:<\/strong><\/p>\n<ul>\n<li><a href=\"http:\/\/theintern.io\/\">theintern.io<\/a> &#8211; <a href=\"https:\/\/blog.mozilla.org\/webqa\/2015\/01\/15\/make-the-intern-do-it\/\">Collaboration on an experiment\/prototype between teams<\/a>: Web QA and MDN<\/li>\n<li>audited JS WebDriver frameworks and decided to use theintern.io<\/li>\n<li>created a representative subset of our Python-based tests using JS<\/li>\n<li>configured the build &#8212; travis-ci &#8212; to run the end-to-end tests using Sauce Labs<\/li>\n<\/ul>\n<p><strong>Mozilla.org:<\/strong><\/p>\n<ul>\n<li>tested and shipped 10-year anniversary pages\/tours<\/li>\n<li>tested and shipped Yahoo! tour<\/li>\n<li>tested shipped Developer Edition pages\/tours<\/li>\n<li>tested and shipped a Basket rearchitecture<\/li>\n<li>tested and shipped revamped Get Involved flow<\/li>\n<li>added homepage coverage through automation:\n<ul>\n<li><a href=\"https:\/\/github.com\/mozilla\/mcom-tests\/pull\/343\">https:\/\/github.com\/mozilla\/mcom-tests\/pull\/343<\/a><\/li>\n<\/ul>\n<\/li>\n<li>streamlined a bunch of tests by removing is_visible() checks, where they were redundant or unreliable:\n<ul>\n<li><a href=\"https:\/\/github.com\/mozilla\/mcom-tests\/commit\/369a17902d50e9c18193db83be1091a99ab51b52\">https:\/\/github.com\/mozilla\/mcom-tests\/commit\/369a17902d50e9c18193db83be1091a99ab51b52<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Mozillians:<\/strong><\/p>\n<ul>\n<li>shipped vouch refactor<\/li>\n<li>shipped geolocation<\/li>\n<li>moved the project&#8217;s development environment to Docker<\/li>\n<li>successfully transitioned the project to a community QA Lead<\/li>\n<\/ul>\n<p><strong>MozTrap:<\/strong><\/p>\n<ul>\n<li>Acting PM &#8211; created a prioritized list of triaged feature needs<\/li>\n<li>Began to solve scaling problems in MozTrap to reduce pain for QA &#8211; unresponsive UX, long running queries, data integrity (more to come in 2015!)<\/li>\n<\/ul>\n<p><strong>Socorro:<\/strong><\/p>\n<ul>\n<li>Migrated crash-stats storage off HBase and into S3<\/li>\n<li>Crash-stats reporting for B2G<\/li>\n<\/ul>\n<p><strong>OWASP ZAP:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/github.com\/davehunt\/pytest-zap\">pytest-zap<\/a> work to support deeper integration with <a href=\"https:\/\/www.owasp.org\/index.php\/OWASP_Zed_Attack_Proxy_Project\">OWASP ZAP<\/a> + <a href=\"https:\/\/github.com\/mozilla\/pytest-mozwebqa\">pytest-mozwebqa<\/a><\/li>\n<\/ul>\n<p><strong>Web QA Dashboard:<\/strong><\/p>\n<ul>\n<li>Published the <a href=\"http:\/\/mozilla.github.io\/mozwebqa-dashboard\">Web QA dashboard<\/a>, which initially included information on xfails and skips for all of our projects\n<ul>\n<li><a href=\"http:\/\/mozilla.github.io\/mozwebqa-dashboard\/#\/xfails\">http:\/\/mozilla.github.io\/mozwebqa-dashboard\/#\/xfails<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Added the Web QA Issues dashboard, which displays all open issues and pull requests for our GitHub projects\n<ul>\n<li><a href=\"http:\/\/mozilla.github.io\/mozwebqa-dashboard\/#\/issues\">http:\/\/mozilla.github.io\/mozwebqa-dashboard\/#\/issues<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Added the Marketplace tests dashboard, which provides a quick reference for the tests we run for Marketplace and shows which are passing, failing, and skipped\n<ul>\n<li><a href=\"http:\/\/mozilla.github.io\/mozwebqa-dashboard\/#\/marketplace\">http:\/\/mozilla.github.io\/mozwebqa-dashboard\/#\/marketplace<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>One and Done:<\/strong><\/p>\n<ul>\n<li>Improved admin system for creating and editing tasks<\/li>\n<li>Added admin views for Task Activity and Metrics<\/li>\n<li>Ability to create &#8220;one time only&#8221; tasks<\/li>\n<li>Ability to create tasks from Bugzilla bugs<\/li>\n<li>Publicly viewable profiles, with a customizable URL<\/li>\n<li>User notifications for expired and\/or closed tasks<\/li>\n<li>updated privacy protocols<\/li>\n<li>ability to interact with users who submit feedback<\/li>\n<li>One and Done test days<\/li>\n<li>Community highlights<\/li>\n<\/ul>\n<p><strong>QMO:<\/strong><\/p>\n<ul>\n<li>shipped a redesigned (and long-awaited) quality.mozilla.org blog platform:\n<ul>\n<li><a href=\"http:\/\/quality.mozilla.org\/2015\/01\/announcing-a-redesign-of-quality.mozilla.org\/\">http:\/\/quality.mozilla.org\/2015\/01\/announcing-a-redesign-of-quality.mozilla.org\/<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Open Badges:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/badges.mozilla.org\/en-US\/profiles\/profile\/webqa.badges\">https:\/\/badges.mozilla.org\/en-US\/profiles\/profile\/webqa.badges<\/a>\n<ul>\n<li>we added many new badges:\n<ul>\n<li><a href=\"http:\/\/quality.mozilla.org\/2014\/04\/announcement-web-qa-team-badges-2\/\">http:\/\/quality.mozilla.org\/2014\/04\/announcement-web-qa-team-badges-2\/<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><strong>Presentations &amp; Meetups:<\/strong><\/p>\n<ul>\n<li>Python Development Standards:\n<ul>\n<li><a href=\"http:\/\/secretmustache.com\/presentations\/2014\/11\/python_development_standards\">http:\/\/secretmustache.com\/presentations\/2014\/11\/python_development_standards<\/a><\/li>\n<\/ul>\n<\/li>\n<li>\u00a0Building a 40+ real-phone test-automation lab:\n<ul>\n<li><a href=\"http:\/\/www.meetup.com\/seleniumsanfrancisco\/events\/211095862\/\">http:\/\/www.meetup.com\/seleniumsanfrancisco\/events\/211095862\/<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Engagement offsite &#8211; two presentations: 1) Continuous Delivery and how to integrate community, 2) What does QA do &#8212; an overview of what comprises a test plan<\/li>\n<li>Continuously detecting web security vulnerabilities:\n<ul>\n<li><a href=\"\/\/people.mozilla.org\/~dhunt\/talks\/seunconf2014\/\"> http:\/\/people.mozilla.org\/~dhunt\/talks\/seunconf2014\/<\/a><\/li>\n<\/ul>\n<\/li>\n<li>started an &#8220;I am MozWebQA&#8221; blog series:\n<ul>\n<li><a href=\"https:\/\/blog.mozilla.org\/webqa\/2014\/11\/21\/i-am-mozilla-web-qa-meet-stephen-donner\/\">https:\/\/blog.mozilla.org\/webqa\/2014\/11\/21\/i-am-mozilla-web-qa-meet-stephen-donner\/<\/a><\/li>\n<\/ul>\n<\/li>\n<li>Intro to Web testing test days [multiple] + SF meetup<\/li>\n<li><a href=\"http:\/\/quality.mozilla.org\/2014\/06\/summer-projects-for-mozilla-web-qa\/\">Summer project internships<\/a><\/li>\n<li>Test automation clean up test days [multiple]<\/li>\n<li>Two OPW internships<\/li>\n<li>Xfail test days<\/li>\n<\/ul>\n<p>A huge thanks yet again to the entire team for really coming together and making\u00a0 our efforts in 2014 really pay off &#8212; here&#8217;s to 2015!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>(I love this team so much &#8212; and we&#8217;re not all represented, here, even!) Shamelessly stealing a page from Laura Thomson&#8217;s &#8220;2014: Engineering Operations Year in Review&#8221; blogpost, Web QA &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/fxtesteng\/2015\/01\/16\/web-qa-2014-year-in-review\/\">Read more<\/a><\/p>\n","protected":false},"author":512,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/posts\/350"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/users\/512"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/comments?post=350"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/posts\/350\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/media?parent=350"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/categories?post=350"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/fxtesteng\/wp-json\/wp\/v2\/tags?post=350"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}