https://status.its.uq.edu.au/affected/mysql-general-purpose-and-web-database-servers/Incident historygithub.com/cstateen2024-10-25T00:15:00+00:002024-10-25T00:15:00+00:00https://status.its.uq.edu.au/issues/19546/Fri, 25 Oct 2024 00:15:00 +0000https://status.its.uq.edu.au/issues/19546/2024-10-26 09:25:00The DBA team are investigating reports of issues resulting from an unscheduled failover of MySQL services from the Prentice to CCR data centres which occured at 12:15AM this morning. Transactions for VPNext and hostinfo have been replayed Other DB are being checked for consistency Update Data restoration activities are underway. No data loss is expected once that is complete (12:11 AEST — Oct 25) Update Data has been restored and recovered.<p>The DBA team are investigating reports of issues resulting from an unscheduled failover of MySQL services from the Prentice to CCR data centres which occured at 12:15AM this morning.</p> <p>Transactions for VPNext and hostinfo have been replayed</p> <p>Other DB are being checked for consistency</p> <hr> <p><strong>Update</strong> Data restoration activities are underway.</p> <p>No data loss is expected once that is complete <span class="faded">(12:11 AEST — Oct 25)</span> </p> <p><strong>Update</strong> Data has been restored and recovered.</p> <p>ITS are awaiting confirmation / validation from stakeholders before closing this incident</p> <span class="faded">(06:09 AEST — Oct 26)</span> <p><strong>Resolution</strong> Data and databases have been restored and recovered.</p> <p>The mysqlprod service is now restored.</p> <span class="faded">(09:25 AEST — Oct 26)</span>