Google Workspace Status Dashboard
Incident affecting AppSheet, Gmail, Google Calendar, Google Chat, Google Cloud Search, Google Docs, Google Drive, Google Meet, Google Tasks, and Google Voice
Incident began at 2025-06-12 17:58 and ended at 2025-06-12 23:00 (times are in Coordinated Universal Time (UTC)).
Date | Time | Description | |
---|---|---|---|
| Jun 13, 2025 | 11:59 PM UTC | The detailed Incident Report is now available on the Google Cloud Service Health Dashboard at https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW |
| Jun 13, 2025 | 7:00 AM UTC | Mini Incident ReportWe are deeply sorry for the impact to all of our users and their customers that this service disruption/outage caused. Businesses large and small trust Google Cloud with your workloads and we will do better. In the coming days, we will publish a full incident report of the root cause, detailed timeline and robust remediation steps we will be taking. Given the size and impact of this incident, we would like to provide some information below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Cloud Support using https://cloud.google.com/support or to Google Workspace Support using help article https://support.google.com/a/answer/1047213. (All Times US/Pacific) Incident Start: 12 June, 2025 10:49 All regions except us-central1 mitigated: 12 June, 2025 12:48 Incident End: 12 June, 2025 13:49 Duration: 3 hours Regions/Zones: Global Description: Multiple Google Cloud and Google Workspace products experienced increased 503 errors in external API requests, impacting customers. From our initial analysis, the issue occurred due to an invalid automated quota update to our API management system which was distributed globally, causing external API requests to be rejected. To recover we bypassed the offending quota check, which allowed recovery in most regions within 2 hours. However, the quota policy database in us-central1 became overloaded, resulting in much longer recovery in that region. Several products had moderate residual impact (e.g. backlogs) for up to an hour after the primary issue was mitigated and a small number recovering after that. Google will complete a full Incident Report in the following days that will provide a detailed root cause. Customer Impact: Customers had intermittent API and user-interface access issues to the impacted services. Existing streaming and IaaS resources were not impacted. Additional details: This incident should not have happened, and we will take the following measures to prevent future recurrence: Prevent our API management platform from failing due to invalid or corrupt data. Prevent metadata from propagating globally without appropriate protection, testing and monitoring in place. Improve system error handling and comprehensive testing for handling of invalid data. Affected Services and Features: Google Cloud Products:
Google Workspace Products:
|
| Jun 12, 2025 | 7:53 PM UTC | The issue with Google Chat, Google Meet, Gmail, Google Calendar, Google Drive, Google Cloud Search, Google Tasks, Google Voice has been resolved for all affected users as of Thursday, 2025-06-12 12:48 PDT. The issue with AppSheet has been resolved for all affected users as of Thursday, 2025-06-12 16:00 PDT. We will publish an analysis of this incident once we have completed our internal investigation. We thank you for your patience while we worked on resolving the issue. |
| Jun 12, 2025 | 7:30 PM UTC | All product impacts except Google Meet have recovered. Google engineers continue to work on full mitigation. |
| Jun 12, 2025 | 7:01 PM UTC | We're investigating reports of an issue with Gmail, Google Calendar, Google Chat, Google Cloud Search, Google Docs, Google Drive, Google Meet, Google Tasks, and Google Voice. We will provide more information shortly. Multiple Workspace products beginning on Thursday, at 2025-06-12 10:58 PDT may be experiencing service issues. Our engineers are currently investigating the issue. We apologize to all who are affected by the disruption. |
- Times are listed in Coordinated Universal Time (UTC)