Euler power outage (24 July 2018)

From ScientificComputing
Revision as of 14:23, 24 July 2018 by Byrdeo (talk | contribs)

Jump to: navigation, search

Due to a massive power outage in Lugano (and apparently a big part of Ticino), most compute nodes of Euler went down at 10:42 this morning, causing the loss of all running jobs.

Since our colleagues at CSCS do not know when the power will be restored, we have initiated an emergency shutdown of all systems connected to UPS, including storage systems, login nodes and admin nodes.

We will update this page as the situation evolves.


11:30 — More information about the outage (in Italian):

12:30 — The power in Lugano is back on-line. CSCS is now restarting the data centre's cooling infrastructure

13:15 — Information about outage from the electricity provider (in Italian):

13:30 — The cooling infrastructure at CSCS is operational again. We can now progressively restart the network and storage systems of Euler. This will take a few hours.

15:00 — All storage systems are up and healthy. We can now start powering up compute nodes.

16:15 — Most compute nodes are up. We are now testing the health and performance of the nodes and networks.