RCC are aware of an issue with the high performance storage sub-system that provides access to /home /scratch and /sw and $TMPDIR.
Clients may experience:
RCC staff are working with the backline vendor to resolve the issue as soon as possible and return all nodes to regular operations.
Once normal operations resume, clients should be encouraged to check the status of their jobs and re-submit if required.
Update Job queues on Bunya have been re-enabled and a work-around is now running in place to mitigate the bug that has triggered the failures over the weekend.
A further update will be provided once a full patch has been provided by the vendor. (11:57 AEST — Sep 4)
Resolution A vendor supplied patch has been applied to the storage service. Bunya is now stable and jobs are running. (14:38 AEST — Sep 4)
Last updated: 4 September, 2023 at 12:25 AM AEST