Incident Duration: April 8, 2025, 07:00 UTC - 08:00 UTC (1 hour)
On April 8, 2025, we experienced a service outage that lasted for one hour, from 07:00 UTC to 08:00 UTC. The incident was triggered by a deployment of a database indexing process update that caused unexpected issues.
The database cluster was unresponsive during the incident window. While the outage lasted longer than anticipated due to the extended restart process, we can confirm that all data remained intact and secure throughout the incident.
A malfunction occurred during the deployment of a database indexing process update. When we attempted to stop the deployment to address this malfunction, it unexpectedly caused the entire cluster to become unresponsive, necessitating a full restart.
We performed a safe, methodical node-by-node restart of the entire database cluster. While this process took longer than initially expected, this careful approach ensured data integrity was maintained throughout the recovery.
Our team is currently:
We apologize for any inconvenience this outage may have caused. We remain committed to improving our systems to prevent similar incidents in the future.