Unexpected Power Outage in Komas Data Center - September 27th approximately 10:00 a.m.

Posted: September 27, 2012

Duration: Unknown Duration

Systems Affected/Downtime Timelines:
* Ember Cluster ~10:00-unknown
* Updraft Cluster ~10:00- ~ 4:20 p.m.
* Sanddunearch Cluster ~10:00 a.m. - ~4:20 p.m.

Around 10 a.m. on September 27th, a breaker tripped in the CHPC Komas data center, taking down half of the power to the room, affecting our main HPC clusters including ember, updraft and sanddunearch. There was maintenance being performed on the UPS at the time, which was not expected to cause any problems.

Sanddunearch and Updraft are back up (about 4:15 p.m.) but Ember is still having some issues. CHPC staff are troubleshooting as of 5:25 p.m.