Mozilla IT

Mozilla IT & Operations

Archive for Infrastructure Notices

Mozilla Scheduled Maintenance (Socorro) – 01/22/2011, 9am PST (01/14/2011, 1700 UTC)

We will have a scheduled maintenance window starting SATURDAY MORNING from 9:00am to 5:00pm PST. The following changes will take place: 9:00am PST (1700 UTC) Socorro migration. We’ll be migrating production Socorro to Phoenix. We will continue to collect crashes but processing will be suspended for the duration of the migration. More details can be… Read more

Categories: Scheduled Maintenance

Mozilla Network Outage Report – 01/14/2011, 7:30pm PST – 11:30pm PST

At around 7:30pm PST Friday night Mozilla’s primary data center in San Jose went offline, affecting multiple services. CoreSite, Mozilla’s San Jose data center provider, indicated that they had lost city water and had suffered site-wide CRAC unit failures. These units provide cooling for the data center and without them, the ambient air temperature quickly… Read more

Tags: , ,

Categories: Outages

Mozilla Scheduled Maintenance – 01/13/2011, 4pm PST (01/14/2011, 0000 UTC)

We will have a scheduled maintenance window tomorrow night from 4:00pm to 10:00pm PST. The following changes will take place: 4:00pm PST (0000 UTC) addons.mozilla.org code updates (bug 624525). While we don’t anticipate any user-facing downtime, due to the nature of the code push, we’re being cautious and announcing this push. Duration 30 minutes. 9:00pm… Read more

Categories: Scheduled Maintenance

Mozilla Scheduled Maintenance (Tree Closure) – 1/12/2011, 6am PST (1400 UTC 12-Jan-11)

Mozilla Scheduled Maintenance (Tree Closure) – 1/12/2011, 6am PST (1400 UTC 12-Jan-11) We will have a scheduled maintenance window tomorrow morning from 6am to 7am PST (1400-1500 UTC) All Firefox, Fennec & TryServer trees will be closed during this window. * 6:00am PST (1400 UTC) ftp.mozilla.org NFS remounts (bug 614786) We’ll be rearranging some NFS… Read more

Categories: Scheduled Maintenance

Mozilla Scheduled Maintenance – 01/11/2010, 4pm PST (01/12/2010, 0000 UTC)

We will have a scheduled maintenance window tomorrow night from 4:00pm to 10:00pm PST. The following changes will take place: 4:00pm PST (0000 UTC) support.mozilla.com update and hardware upgrades. We’ll be picking up code updates (bug 622898) and adding memory to the existing web servers. This is a re-attempt from last week’s scheduled push. Duration… Read more

Categories: Scheduled Maintenance

Mozilla Scheduled Maintenance – 12/28/10, 4pm PST (12/29/10, 0000 UTC)

We will have a scheduled maintenance window tonight from 4:00pm to 10:00pm PST. The following changes will take place: * 4:00pm PST (0000 UTC) addons.mozilla.org – database update, bug 621486. This is a minor update and any outage here should be brief. * 4:00pm PST (0000 UTC) input.mozilla.org – code update, bug 621565. This is… Read more

Tags: ,

Categories: Scheduled Maintenance

Mozilla Scheduled Maintenance (Tree Closure) – 12/17/2010, 8am PST (1600 UTC)

We will have a scheduled maintenance window Friday, December 17 from 8:00am to 5:00pm PST. All Firefox, Fennec & TryServer trees will be closed during this window. This downtime is needed to reallocate power and network infrastructure for all build, unittest and talos slaves+masters in the Internap data center. The curious can follow along in… Read more

Categories: RelEng, Scheduled Maintenance

Mozilla Scheduled Maintenance – 11/30/2010, 4pm PST (12/01/2010, 0000 UTC)

We will have a scheduled maintenance window tomorrow night from 4:00pm to 10:00pm PST. The following changes will take place: 4:00pm PST (0000 UTC) www.mozilla.org load balancer move. We’ll be moving this site behind the Zeus load balancer cluster. Duration 10 minutes. 4:00pm PST (0000 UTC) support.mozilla.com update and database changes. We’ll be picking up… Read more

Categories: Scheduled Maintenance

Mozilla Scheduled Maintenance – 11/18/2010, 4pm PST (11/19/2010, 0000 UTC)

We will have a scheduled maintenance window tomorrow night from 4:00pm to 10:00pm PST. The following changes will take place: 4:00pm PST (0000 UTC) input.mozilla.com update. We’ll be updating input.mozilla.com to pick up code updates (bug 611180). No downtime expected. 6:00pm PST (0200 UTC) addons.mozilla.org database server upgrade. We’ll be upgrading the hardware on the… Read more

Categories: Scheduled Maintenance