{"id":517,"date":"2024-10-31T16:22:33","date_gmt":"2024-10-31T23:22:33","guid":{"rendered":"https:\/\/blog.mozilla.org\/performance\/?p=517"},"modified":"2024-12-16T05:18:57","modified_gmt":"2024-12-16T13:18:57","slug":"performance-testing-newsletter-q3-edition","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/performance\/2024\/10\/31\/performance-testing-newsletter-q3-edition\/","title":{"rendered":"Performance Testing Newsletter (Q3 Edition)"},"content":{"rendered":"<p>Welcome to the latest edition of the Performance Testing Newsletter! The PerfTools team empowers engineers with tools to continuously improve the performance of Mozilla products.<\/p>\n<p>Last quarter was MozWeek, and we had a great time meeting a number of you in our PerfTest Regression Workshop &#8211;<b> thank you all for joining us, and making it a huge success<\/b>! If you didn\u2019t get a chance to make it, you can <a href=\"https:\/\/docs.google.com\/presentation\/d\/1A6ztjq8dZ9VHsNkhOjzEUjYG-M73WazzaDuQoDKJjEA\/edit?usp=sharing\">find the slides here<\/a>, and most of the information from the workshop (including some additional bits) <a href=\"https:\/\/firefox-source-docs.mozilla.org\/testing\/perfdocs\/perftest-in-a-nutshell.html\">can be found in this documentation page<\/a>. We will be running this workshop again next MozWeek, along with a more advanced version.<\/p>\n<p>See below for highlights from the changes made in the last quarter.<\/p>\n<h2>Highlights<\/h2>\n<ul>\n<li aria-level=\"1\">[mayankleoboy1] <b>This quarter, Mayank became our first official Community Performance Sheriff!<\/b><\/li>\n<li aria-level=\"1\">[mayankleoboy1] <a href=\"https:\/\/bugzilla.mozilla.org\/buglist.cgi?emailtype1=substring&amp;component=Performance&amp;list_id=17299241&amp;chfield=%5BBug%20creation%5D&amp;email1=mayankleoboy1%40gmail.com&amp;bug_status=UNCONFIRMED&amp;bug_status=NEW&amp;bug_status=ASSIGNED&amp;bug_status=REOPENED&amp;bug_status=RESOLVED&amp;bug_status=VERIFIED&amp;bug_status=CLOSED&amp;query_format=advanced&amp;product=Testing&amp;emailreporter1=1\">Filed some issues related to missing alerts.<\/a><\/li>\n<li aria-level=\"1\">[myeongjun] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1826822\">AWSY now uses tp6 by default to match CI tests where only tp6 is tested.<\/a><\/li>\n<li aria-level=\"1\">[julienw] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1914574\">PerfCompare now being shown by default in Mach Try Perf!<\/a><\/li>\n<li aria-level=\"1\">[beatrice] <a href=\"https:\/\/github.com\/mozilla\/treeherder\/pull\/8170\">Compare View now provides a helpful link to redirect to PerfCompare.<\/a><\/li>\n<li aria-level=\"1\">[aglavic] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1898221\">Added new mobile app link startup tests in CI.<\/a><\/li>\n<li aria-level=\"1\">[aglavic] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1908117\">Replaced Android Samsung S21 device with Samsung S24 devices.<\/a><\/li>\n<li aria-level=\"1\">[kshampur] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1906949\">New mobile foreground resource usage tests are now available in CI.<\/a><\/li>\n<li aria-level=\"1\">[kshampur] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1915462\">Android Samsung A51 devices have been replaced with Samsung A55 devices in CI (includes a larger device pool).<\/a><\/li>\n<li aria-level=\"1\">[kshampur] <a href=\"https:\/\/arewefastyet.com\/linux64\/benchmarks\/overview\">AWFY<\/a> has been updated with <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1904980\">Windows 11<\/a>, <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1906737\">MacOSX M2<\/a>, <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1906738\">Safari Tech Preview<\/a>, and much more!<\/li>\n<li aria-level=\"1\">[sparky] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1906949\">New mobile background resource usage tests are now available in CI.<\/a><\/li>\n<li aria-level=\"1\">[sparky] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1908345\">New option \u2013tests is now available in mach try perf to specify tasks to run using test name.<\/a><\/li>\n<li aria-level=\"1\">[sparky] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1906101\">Documentation for basics of performance testing now available<\/a> (<a href=\"https:\/\/firefox-source-docs.mozilla.org\/testing\/perfdocs\/perftest-in-a-nutshell.html\">see here<\/a>).<\/li>\n<li aria-level=\"1\">[sparky] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1907926\">New tool available to run all alerting tests locally. Run with `mach perftest &lt;ALERT-NUMBER&gt;`.<\/a><\/li>\n<\/ul>\n<h2>Blog Posts \u270d\ufe0f<\/h2>\n<ul>\n<li aria-level=\"1\">[csevere] <a href=\"https:\/\/blog.mozilla.org\/performance\/2024\/10\/16\/announcing-perfcompare-the-new-comparison-tool\/\">Announcing PerfCompare: the new comparison tool!<\/a><\/li>\n<\/ul>\n<h2>Contributors<\/h2>\n<ul>\n<li aria-level=\"1\">Myeongjun Go [:myeongjun]<\/li>\n<li aria-level=\"1\">Mayank Bansal [:mayankleoboy1]<\/li>\n<\/ul>\n<p>If you have any questions, or are looking to add performance testing for your code component, you can find us in <a href=\"https:\/\/matrix.to\/#\/#perftest:mozilla.org\">#perftest on Element<\/a>, or <a href=\"https:\/\/mozilla.slack.com\/archives\/C03U19JCSFQ\">#perf-help on Slack<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Welcome to the latest edition of the Performance Testing Newsletter! The PerfTools team empowers engineers with tools to continuously improve the performance of Mozilla products. Last quarter was MozWeek, and &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/performance\/2024\/10\/31\/performance-testing-newsletter-q3-edition\/\">Read more<\/a><\/p>\n","protected":false},"author":1804,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[457019],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/posts\/517"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/users\/1804"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/comments?post=517"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/posts\/517\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/media?parent=517"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/categories?post=517"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/tags?post=517"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}