Socorro unplanned outage
Socorro is experiencing an unplanned outage due to network difficulty in the Phoenix data center. The user interface continues to function for aggregate queries. Calling up individual crashes, along with crash processing is stalled. Crashes coming into the collectors are unaffected other than being delayed in processing. No priority jobs are being processed.
I will report back as soon as I hear more news as to the potential duration of this outage.
Update: HBase has been restarted and all functionality has been restored.