Affected services:

  • Crane

Crane: /work filesystem unplanned downtime

Opened on Saturday 3rd August 2019, last updated

Resolved

Crane's /work was restored for production use by 2:30pm today.

Please check the status of your jobs if they were running at the time of the failure: 5:30am to 2:30pm. These jobs may have experienced I/O errors if they were using files that were backed by the failed storage server.

Posted by John Thiltges

Investigating

The /work filesystem for Crane is partially unavailable. One of the storage servers is misbehaving and will be repaired as soon as possible. As this is the weekend there is no ETA on when this will be completed just yet.

Posted by Garhan Attebury