{"id":505,"date":"2024-08-08T05:16:48","date_gmt":"2024-08-08T12:16:48","guid":{"rendered":"https:\/\/blog.mozilla.org\/performance\/?p=505"},"modified":"2024-08-08T05:16:48","modified_gmt":"2024-08-08T12:16:48","slug":"performance-testing-newsletter-q2-edition","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/performance\/2024\/08\/08\/performance-testing-newsletter-q2-edition\/","title":{"rendered":"Performance Testing Newsletter, Q2 Edition"},"content":{"rendered":"<div dir=\"ltr\">Welcome to the latest edition of the Performance Testing Newsletter! The PerfTools team empowers engineers with tools to continuously improve the performance of Mozilla products. See below for highlights from the changes made in the last quarter.<\/div>\n<div dir=\"ltr\">\n<h2 dir=\"ltr\">Highlights <img decoding=\"async\" loading=\"lazy\" class=\"CToWUd\" src=\"https:\/\/lh7-rt.googleusercontent.com\/docsz\/AD_4nXdBPVFSz-taB6EZ9ZRPQ_GNFFihvgo8xUWj0tN-8A0ss___8IHyTXnxpfwfarSCuyRSVhv43BKgPheJu4s9wUvF2vxSSkbBbugLwsj8MBcu745H237kSrVx33SN6Prr4zBDCqjr6AdBsRBlHzSObX16_KU?key=rmgQ4427nwStRDzIbQ-ILg\" width=\"29\" height=\"31\" data-bit=\"iit\" \/><\/h2>\n<ul>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[myeongjun] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1837998\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1837998&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw20PZ-r97-mYHhKKlr5RePS\">Changed the performance sheriffing workflow for filling bugs to use the Bugzilla API.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[myeongjun] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1837998\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1837998&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw20PZ-r97-mYHhKKlr5RePS\">Fixed the mozperftest regression template.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[mayankleoboy1] <a href=\"https:\/\/bugzilla.mozilla.org\/buglist.cgi?bug_status=UNCONFIRMED&amp;bug_status=NEW&amp;bug_status=ASSIGNED&amp;bug_status=REOPENED&amp;bug_status=RESOLVED&amp;bug_status=VERIFIED&amp;bug_status=CLOSED&amp;list_id=17151174&amp;emailtype1=exact&amp;product=Testing&amp;query_format=advanced&amp;email1=mayankleoboy1%40gmail.com&amp;component=PerfCompare&amp;emailreporter1=1\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/buglist.cgi?bug_status%3DUNCONFIRMED%26bug_status%3DNEW%26bug_status%3DASSIGNED%26bug_status%3DREOPENED%26bug_status%3DRESOLVED%26bug_status%3DVERIFIED%26bug_status%3DCLOSED%26list_id%3D17151174%26emailtype1%3Dexact%26product%3DTesting%26query_format%3Dadvanced%26email1%3Dmayankleoboy1%2540gmail.com%26component%3DPerfCompare%26emailreporter1%3D1&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw3xgFgo0uNDwK1n338tLIYe\">Performed some testing for PerfCompare, and filed bugs for issues.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[mayankleoboy1] <a href=\"https:\/\/bugzilla.mozilla.org\/buglist.cgi?email1=mayankleoboy1%40gmail.com&amp;list_id=17151183&amp;query_format=advanced&amp;chfield=%5BBug%20creation%5D&amp;bug_status=UNCONFIRMED&amp;bug_status=NEW&amp;bug_status=ASSIGNED&amp;bug_status=REOPENED&amp;bug_status=RESOLVED&amp;bug_status=VERIFIED&amp;bug_status=CLOSED&amp;emailreporter1=1&amp;product=Testing&amp;emailtype1=exact&amp;component=Performance\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/buglist.cgi?email1%3Dmayankleoboy1%2540gmail.com%26list_id%3D17151183%26query_format%3Dadvanced%26chfield%3D%255BBug%2520creation%255D%26bug_status%3DUNCONFIRMED%26bug_status%3DNEW%26bug_status%3DASSIGNED%26bug_status%3DREOPENED%26bug_status%3DRESOLVED%26bug_status%3DVERIFIED%26bug_status%3DCLOSED%26emailreporter1%3D1%26product%3DTesting%26emailtype1%3Dexact%26component%3DPerformance&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw2ah8E0cad9m6NiEp1_oYn_\">Found, and filed bugs for issues related to data not being displayed or tests not producing alerts for significant changes.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[jmaher] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1896384\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1896384&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw1-ifqfEF7M0GWHdZlvW7x7\">Migrated all windows 10 performance tests to windows 11.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[florian] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1905067\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1905067&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw0iXE6kPJ3baIlM6p-VmM2J\">Browsertime tests in CI now produce test markers in the resource usage profiles.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[afinder] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1824194\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1824194&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw0qm3b9HiVTPDJAo0Oht73H\">The Raptor harness code now has code coverage available locally.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[andrej] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1884930\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1884930&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw1mj20vNr5Wj_gwol3jzVU2\">Android Startup performance tests are now running on autoland.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[kshampur] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1840660\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1840660&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw1D-WhchpxqYobuIMSZ-MIz\">Performance Tests can now be run on Safari Technology Preview.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[kshampur] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1887998\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1887998&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw0A838OEaXKLKecVx-IBx2T\">MozPerftest, and Raptor now use the same Browsertime version, making updating the version simpler.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[kshampur] <a href=\"https:\/\/arewefastyet.com\/win10\/benchmarks\/overview?numDays=60\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/arewefastyet.com\/win10\/benchmarks\/overview?numDays%3D60&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw3HStrAOtN5AeebgnZ5XCD9\">AWFY dashboard <\/a>updated with <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1904980\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1904980&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw3hyvhyJfu8mO5AZdPpQB-6\">Windows 11<\/a>, <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1906737\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1906737&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw1ty7cJKD5w-CEfAtzJIA9Q\">MacOSX M2<\/a>, and <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1906738\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1906738&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw0Mzf2HvjTP5-6fbwd5wGvz\">Safari Technology Preview Browser<\/a>.<\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[sparky] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1898256\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1898256&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw0JSTa33JGvYbwx_-R08S5R\">New test layer available in MozPerftest to run performance tests from shell scripts.<\/a><\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[sparky] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1890318\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1890318&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw1HiSNLABvxH8GVcWq2Iarq\">Documentation is now enforced for metrics that alert in Raptor (based on `alert_on`).<\/a> (<a href=\"https:\/\/firefox-source-docs.mozilla.org\/testing\/perfdocs\/raptor-metrics.html#metric-definitions\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/firefox-source-docs.mozilla.org\/testing\/perfdocs\/raptor-metrics.html%23metric-definitions&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw00ILRWQoyvBYa6jbyIQUHh\">Example<\/a>)<\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">[sparky] <a href=\"https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id=1908345\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/bugzilla.mozilla.org\/show_bug.cgi?id%3D1908345&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw3qH1A6LXQuHVDeLtjWuTE1\">New option \u2013tests is now available in mach try perf to specify tasks to run using test name.<\/a><\/p>\n<\/li>\n<\/ul>\n<h2 dir=\"ltr\">Contributors <img decoding=\"async\" loading=\"lazy\" class=\"CToWUd\" src=\"https:\/\/lh7-rt.googleusercontent.com\/docsz\/AD_4nXefRWG7TYHNXBCGieU849IktBuZgY568CzN-cAJgs-RFebomPzCgLVU0vxTjmaBfa-NJjFQOCF6khX4ZMNEVwzxeR9mLcVl8vVRXEsiu7sz4a9buYDdop-czLQGC6fT6oCINo_IVVzN-cJqcJeJr-5a4274?key=rmgQ4427nwStRDzIbQ-ILg\" width=\"31\" height=\"31\" data-bit=\"iit\" \/><\/h2>\n<ul>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">Myeongjun Go [:myeongjun]<\/p>\n<\/li>\n<li dir=\"ltr\">\n<p dir=\"ltr\" role=\"presentation\">Mayank Bansal [:mayankleoboy1]<\/p>\n<\/li>\n<\/ul>\n<p dir=\"ltr\">If you have any questions, or are looking to add performance testing for your code component, you can find us in <a href=\"https:\/\/matrix.to\/#\/%23perftest:mozilla.org\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/matrix.to\/%23\/%2523perftest:mozilla.org&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw0LLcNbbPkncsvY_EJJ1wf1\">#perftest on Element<\/a>, or <a href=\"https:\/\/mozilla.slack.com\/archives\/C03U19JCSFQ\" target=\"_blank\" rel=\"noopener\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/mozilla.slack.com\/archives\/C03U19JCSFQ&amp;source=gmail&amp;ust=1723205683735000&amp;usg=AOvVaw0N7-A_gbc42uLpZxnYEnte\">#perf-help on Slack<\/a>.<\/p>\n<p dir=\"ltr\">P.S. If you\u2019re interested in including updates from your teams in a quarterly newsletter like this, and you are not currently covered by another newsletter, please reach out to me (:sparky). I\u2019m interested in making a more general newsletter for these.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Welcome to the latest edition of the Performance Testing Newsletter! The PerfTools team empowers engineers with tools to continuously improve the performance of Mozilla products. See below for highlights from &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/performance\/2024\/08\/08\/performance-testing-newsletter-q2-edition\/\">Read more<\/a><\/p>\n","protected":false},"author":1804,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[457019],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/posts\/505"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/users\/1804"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/comments?post=505"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/posts\/505\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/media?parent=505"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/categories?post=505"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/performance\/wp-json\/wp\/v2\/tags?post=505"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}