{"id":91,"date":"2012-09-03T18:31:28","date_gmt":"2012-09-03T18:31:28","guid":{"rendered":"http:\/\/blog.mozilla.org\/nfroyd\/?p=91"},"modified":"2012-09-03T18:31:28","modified_gmt":"2012-09-03T18:31:28","slug":"running-talos-locally","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/nfroyd\/2012\/09\/03\/running-talos-locally\/","title":{"rendered":"running talos locally"},"content":{"rendered":"

We had a meeting about not regressing Talos last week<\/a>.\u00a0 One of the concerns brought up at the meeting was that reproducing Talos regressions was hard: dissimilar machines, not knowing where Talos is, inability to run Talos locally, etc. etc.<\/p>\n

Joel Maher<\/a> noted that Talos has its very own wiki page<\/a>, complete with checkout instructions and information about running the tests.\u00a0 In the interest of looking like a functioning member of the performance team (“benchmarks?\u00a0 what are those?”), I decided to verify those instructions.\u00a0 The monospace<\/tt> commands below were run on a Linux\/x86-64 box.<\/p>\n

    \n
  1. Checkout the repository: hg clone http:\/\/hg.mozilla.com\/build\/talos && cd talos<\/tt><\/li>\n
  2. Run the INSTALL.py script: .\/INSTALL.py<\/tt><\/li>\n
  3. Run activation script for virtualenv: . bin\/activate<\/tt>\u00a0 This step will modify your shell prompt to include a (talos)<\/tt> string at the beginning; it also modifies PATH<\/tt> to include the location of talos scripts.<\/li>\n
  4. Create a test configuration: PerfConfigurator --develop --executablePath \/path\/to\/firefox --activeTests ts --results_url file:\/\/\/${HOME}\/ts.txt --output ts_desktop.yaml<\/tt> Note that providing a path to a firefox you just compiled (~\/src\/build-mc\/dist\/bin\/firefox<\/tt> in my case) works just fine.<\/li>\n
  5. Run tests with your configuration: talos -n ts_desktop.yaml<\/tt> Unfortunately, you have to shutdown any Firefox instances you have running or the test harness will complain. I filed bug 787980<\/a> for fixing this.<\/li>\n
  6. Sit back and relax while you watch the test harness print progress messages on your terminal.\u00a0 You may see messages about logs being posted to http:\/\/datazilla.mozilla.org\/talos; the --develop<\/tt> flag ought to prevent that from happening, \u00a0 It’s not clear to me whether the bug is in the wrong messages or that --develop<\/tt> doesn’t actually inhibit uploading.<\/li>\n<\/ol>\n

    And that’s it!\u00a0 You’ve now run the Talos startup tests.\u00a0 I haven’t tried running the pageload tests (yet!) because doing them properly requires downloading quite a number of webpages and arranging things just so.<\/p>\n","protected":false},"excerpt":{"rendered":"

    We had a meeting about not regressing Talos last week.\u00a0 One of the concerns brought up at the meeting was that reproducing Talos regressions was hard: dissimilar machines, not knowing where Talos is, inability to run Talos locally, etc. etc. Joel Maher noted that Talos has its very own wiki page, complete with checkout instructions […]<\/p>\n","protected":false},"author":320,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/posts\/91"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/users\/320"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/comments?post=91"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/posts\/91\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/media?parent=91"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/categories?post=91"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/nfroyd\/wp-json\/wp\/v2\/tags?post=91"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}