{"id":72,"date":"2008-09-17T16:45:35","date_gmt":"2008-09-18T00:45:35","guid":{"rendered":"http:\/\/blog.mozilla.org\/webdev\/?p=72"},"modified":"2017-03-08T14:50:12","modified_gmt":"2017-03-08T22:50:12","slug":"the-crashing-edge","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/","title":{"rendered":"The Crashing Edge"},"content":{"rendered":"<p>This will be the first of a weekly blog about the crash reporting system &#8212; much like the other *edge blogs out there.<\/p>\n<p>In short, we&#8217;ve rewritten most of the system to accomodate throughput that is more than 10 times the projected traffic.\u00a0 It is not because Firefox 3 is crashing more &#8212; we are seeing increased traffic because:<\/p>\n<ul>\n<li>Client-side throttling has not been effective<\/li>\n<li>Overall number of users has increased<\/li>\n<li>Mac Intel builds now submit crashes properly<\/li>\n<\/ul>\n<h3>What have we been up to?<\/h3>\n<p>First, two bug lists:<\/p>\n<ul>\n<li><a href=\"https:\/\/bugzilla.mozilla.org\/buglist.cgi?query_format=advanced&amp;short_desc_type=allwordssubstr&amp;short_desc=&amp;classification=Server+Software&amp;product=Webtools&amp;component=Socorro&amp;long_desc_type=substring&amp;long_desc=&amp;bug_file_loc_type=allwordssubstr&amp;bug_file_loc=&amp;status_whiteboard_type=allwordssubstr&amp;status_whiteboard=&amp;keywords_type=allwords&amp;keywords=&amp;bug_status=RESOLVED&amp;emailassigned_to1=1&amp;emailtype1=exact&amp;email1=&amp;emailassigned_to2=1&amp;emailreporter2=1&amp;emailqa_contact2=1&amp;emailtype2=exact&amp;email2=&amp;bugidtype=include&amp;bug_id=&amp;votes=&amp;chfieldfrom=2008-07-07&amp;chfieldto=Now&amp;chfieldvalue=&amp;cmdtype=doit&amp;order=Reuse+same+sort+as+last+time&amp;field0-0-0=noop&amp;type0-0-0=noop&amp;value0-0-0=\">Bugs closed between the last blog post and now<\/a><\/li>\n<li><a href=\"https:\/\/bugzilla.mozilla.org\/buglist.cgi?query_format=advanced&amp;short_desc_type=allwordssubstr&amp;short_desc=&amp;product=Webtools&amp;component=Socorro&amp;target_milestone=0.6&amp;long_desc_type=allwordssubstr&amp;long_desc=&amp;bug_file_loc_type=allwordssubstr&amp;bug_file_loc=&amp;status_whiteboard_type=allwordssubstr&amp;status_whiteboard=&amp;keywords_type=allwords&amp;keywords=&amp;resolution=DUPLICATE&amp;resolution=---&amp;emailassigned_to1=1&amp;emailtype1=substring&amp;email1=&amp;emailassigned_to2=1&amp;emailreporter2=1&amp;emailqa_contact2=1&amp;emailtype2=substring&amp;email2=&amp;bugidtype=include&amp;bug_id=&amp;votes=&amp;chfieldfrom=&amp;chfieldto=Now&amp;chfieldvalue=&amp;cmdtype=doit&amp;order=Reuse+same+sort+as+last+time&amp;known_name=Socorro-0.6&amp;query_based_on=Socorro-0.6&amp;field0-0-0=noop&amp;type0-0-0=noop&amp;value0-0-0=\">Socorro 0.6<\/a> &#8212; our next milestone, targeted for early October<\/li>\n<\/ul>\n<p>Here are some issues that have been addressed in the last 4-6 weeks (not all of which had bugs):<\/p>\n<ul>\n<li>server-side throttling now possible and configurable<\/li>\n<li>improved separation between monitor and processor jobs<\/li>\n<li>updated collector now saves unprocessed crashes grouped by hour<\/li>\n<li>mysterious death of main monitor thread resolved<\/li>\n<li>collector, monitor, processor now use a common config<\/li>\n<li>SVN structure simplified, no longer required to use \/dist or \/scripts\/dist-* scripts to copy things inside SVN<\/li>\n<li>Python\/Pylons reporter replaced with PHP\/Kohana reporter<\/li>\n<li>web application now clustered with memcache support<\/li>\n<li>removal of SQLAlchemy from all tiers of the system<\/li>\n<\/ul>\n<h3>Known Issues<\/h3>\n<p>Known issues are mostly listed in the 0.6 buglist.  If you know of a problem that isn&#8217;t already filed please file it to help us keep track of things.\u00a0 Pressing issues with the reporter are:<\/p>\n<ul>\n<li>database bottleneck<\/li>\n<li>inefficient queries<\/li>\n<li>corrupted summary tables for topcrashers<\/li>\n<\/ul>\n<h3>What&#8217;s Next?<\/h3>\n<p>Our goals as we move into Q4 2008 are:<\/p>\n<ul>\n<li>work with PostgreSQL to update and optimize our hardware and software configurations<\/li>\n<li>move expensive aggregate queries to cron jobs, summary tables<\/li>\n<li>move focus from performance and maintenance to feature development (e.g. new reports, graphs)<\/li>\n<li>fully document the system to make sure it is easy to contribute or learn about how this works<\/li>\n<\/ul>\n<p>In the next week, we will be focusing on <a href=\"http:\/\/code.google.com\/p\/socorro\/w\/list\">documentation<\/a> and making the reporter usable.\u00a0 As we resolve our scaling issues, if anybody is interested in revamping some of the UI, you are welcome to jump in.\u00a0 Find us in #breakpad on IRC.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This will be the first of a weekly blog about the crash reporting system &#8212; much like the other *edge blogs out there. In short, we&#8217;ve rewritten most of the system to accomodate throughput that is more than 10 times &hellip; <a class=\"go\" href=\"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/\">Continue reading<\/a><\/p>\n","protected":false},"author":24,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[96],"tags":[],"coauthors":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The Crashing Edge - Mozilla Web Development<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Mike Morgan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/\",\"url\":\"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/\",\"name\":\"The Crashing Edge - Mozilla Web Development\",\"isPartOf\":{\"@id\":\"https:\/\/blog.mozilla.org\/webdev\/#website\"},\"datePublished\":\"2008-09-18T00:45:35+00:00\",\"dateModified\":\"2017-03-08T22:50:12+00:00\",\"author\":{\"@id\":\"https:\/\/blog.mozilla.org\/webdev\/#\/schema\/person\/373fd84922ef95d8d5171d1a72770d4f\"},\"breadcrumb\":{\"@id\":\"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blog.mozilla.org\/webdev\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Crashing Edge\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.mozilla.org\/webdev\/#website\",\"url\":\"https:\/\/blog.mozilla.org\/webdev\/\",\"name\":\"Mozilla Web Development\",\"description\":\"For make benefit of glorious tubes\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.mozilla.org\/webdev\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.mozilla.org\/webdev\/#\/schema\/person\/373fd84922ef95d8d5171d1a72770d4f\",\"name\":\"Mike Morgan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.mozilla.org\/webdev\/#\/schema\/person\/image\/1d6151e93e27d281a7fc06534ee8eae0\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ff5890a3252cd74f006ee33360e71c76?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ff5890a3252cd74f006ee33360e71c76?s=96&d=mm&r=g\",\"caption\":\"Mike Morgan\"},\"description\":\"Mike Morgan is the former Director of Web Development for the Mozilla Corporation.\",\"url\":\"https:\/\/blog.mozilla.org\/webdev\/author\/morgamicmozillacom\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Crashing Edge - Mozilla Web Development","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/","twitter_misc":{"Written by":"Mike Morgan","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/","url":"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/","name":"The Crashing Edge - Mozilla Web Development","isPartOf":{"@id":"https:\/\/blog.mozilla.org\/webdev\/#website"},"datePublished":"2008-09-18T00:45:35+00:00","dateModified":"2017-03-08T22:50:12+00:00","author":{"@id":"https:\/\/blog.mozilla.org\/webdev\/#\/schema\/person\/373fd84922ef95d8d5171d1a72770d4f"},"breadcrumb":{"@id":"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blog.mozilla.org\/webdev\/2008\/09\/17\/the-crashing-edge\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.mozilla.org\/webdev\/"},{"@type":"ListItem","position":2,"name":"The Crashing Edge"}]},{"@type":"WebSite","@id":"https:\/\/blog.mozilla.org\/webdev\/#website","url":"https:\/\/blog.mozilla.org\/webdev\/","name":"Mozilla Web Development","description":"For make benefit of glorious tubes","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.mozilla.org\/webdev\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blog.mozilla.org\/webdev\/#\/schema\/person\/373fd84922ef95d8d5171d1a72770d4f","name":"Mike Morgan","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.mozilla.org\/webdev\/#\/schema\/person\/image\/1d6151e93e27d281a7fc06534ee8eae0","url":"https:\/\/secure.gravatar.com\/avatar\/ff5890a3252cd74f006ee33360e71c76?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ff5890a3252cd74f006ee33360e71c76?s=96&d=mm&r=g","caption":"Mike Morgan"},"description":"Mike Morgan is the former Director of Web Development for the Mozilla Corporation.","url":"https:\/\/blog.mozilla.org\/webdev\/author\/morgamicmozillacom\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/posts\/72"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/users\/24"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/comments?post=72"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/posts\/72\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/media?parent=72"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/categories?post=72"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/tags?post=72"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/blog.mozilla.org\/webdev\/wp-json\/wp\/v2\/coauthors?post=72"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}