Google Workspace Status Dashboard
Incident affecting Google Calendar
Incident began at 2022-09-04 04:00 and ended at 2022-09-07 14:36 (times are in Coordinated Universal Time (UTC)).
Date | Time | Description | |
---|---|---|---|
| Sep 14, 2022 | 7:53 AM UTC | INCIDENT REPORTSummary: On Saturday, 03 September 2022 21:00 US/Pacific, Google Calendar experienced an issue with a mismatch in Daylight Savings time in Chile for a duration of 3 days, 22 hours, 36 minutes. The issue was mitigated on Wednesday, 07 September 2022 07:36 US/Pacific. We have conducted an internal investigation and are taking steps to improve our service. Root Cause: Internet Assigned Numbers Authority (also known as IANA) is a standards organization that oversees global IP address allocation, autonomous system number allocation, root zone management in the Domain Name System (DNS), media types, and other Internet Protocol-related symbols and Internet numbers. As part of its mission, IANA maintains global time zone information [1], commonly known as the time zone database, the Olson time zone database, or just the “tzdb”. This database is not released on a schedule, just when global time zone changes require it. Chile had a scheduled time zone change on Sunday, 04 September 2022. However, because of elections occurring around the same time, the government decided to postpone the start date of Daylight Savings time from Sunday, 04 September 2022 to Sunday, 11 September 2022. The Chilean government announced this decision on 08 August 2022, less than a month in advance. IANA released version 2022b of the time zone database on Thursday, 11 August 2022, followed by 2022c (to address technical issues) on Tuesday, 16 August 2022. Google integrates new versions of the time zone database as they become available in a multi-step process involving several teams. It takes approximately one month for time zone database changes to roll out for Google Calendar. [1] - https://www.iana.org/time-zones Remediation Google engineers expedited a roll out of the new time zone definitions on the morning of Wednesday, 07 September 2022 (local Chilean time). This had the following effects:
Prevention Google is committed to preventing recurrence by implementing the following action items:
Detailed Description of Impact: From 03 September 2022 21:00 to 07 September 2022 07:36 US/Pacific, Google Calendar events for all customers in Chile were impacted due to the time change event. The customer impact included:
|
| Sep 7, 2022 | 7:55 PM UTC | MINI INCIDENT REPORTWe apologize for the inconvenience this service disruption/outage may have caused. We would like to provide some information about this incident below. Please note, this information is based on our best knowledge at the time of posting and is subject to change as our investigation continues. If you have experienced impact outside of what is listed below, please reach out to Google Workspace Support using the help article https://support.google.com/a/answer/1047213. (All Times US/Pacific) Incident Start: 03 September 2022 21:00 Incident End: 07 September 2022 07:39 Duration: 3 days, 10 hours, 39 minutes Affected Services and Features: Google Calendar Regions/Zones: Chile Description: Google Calendar experienced an issue with a mismatch in daylight savings time in Chile. The issue was caused due to the decision of the Government of Chile to delay the time change by a week from 3 September 2022 to 10 September 2022. Following the announcement of the Chilean Government’s decision on 8 August 2022, Google product teams evaluated options to minimize customer impact. After careful analysis, the Calendar product team decided to not roll out an ad-hoc fix due to the number of variables involved with the fix roll out. So, the Google team published an external blog post on 1 September 2022, outlining the Government’s decision to delay the time change and workarounds to prepare the customers in Chile for the best time change experience. Upon receiving multiple customer escalations on 5 September 2022, the product team reconvened and decided to roll out the emergency fix to mitigate the impact to our customers. Customer Impact: Events in the calendar for the week of 3 September 2022 to 10 September 2022 were not in the right time for users who have events saved in the Chilean time zone or if the user's calendar is set to Chile time zone. Current time displayed on the customers calendars is an hour later than the actual time. |
| Sep 7, 2022 | 7:54 PM UTC | The problem with Google Calendar has been resolved. We apologize for the inconvenience and thank you for your patience and continued support. |
| Sep 6, 2022 | 3:50 PM UTC | We expect to resolve the problem affecting a significant subset of users of Google Calendar at Sep 7, 2022, 1:00 PM UTC. Please note that this time frame is an estimate and may change. We will provide more information by Wednesday, 2022-09-07 06:15 US/Pacific. Customers might see that the events in the calendar might not be in the right time for those who have events saved in the Chilean timezone. |
| Sep 6, 2022 | 2:04 PM UTC | We expect to resolve the problem affecting a significant subset of users of Google Calendar at Sep 11, 2022, 7:00 AM UTC. Please note that this time frame is an estimate and may change. Customers might see that the events in the calendar might not be in the right time for those who have events saved in the Chilean timezone. The issue will have been fixed by Sunday, September 11th 2022 (after the timezone change on Saturday-Sunday midnight) |
| Sep 6, 2022 | 7:12 AM UTC | We're aware of a problem with Google Calendar affecting a significant subset of users. We will provide an update by Sep 6, 2022, 7:07 AM UTC detailing when we expect to resolve the problem. Please note that this resolution time is an estimate and may change. Customers might see that the events in the calendar might not be in the right time for those who have events saved in the Chilean timezone. |
- Times are listed in Coordinated Universal Time (UTC)