Summary of impact:
At approximately 16:52 UTC on Thursday 14th April 2022, we detected issues with self serve Integration Hub integrations in all regions. We could see they were unable to complete their scheduled executions successfully. We resolved the issue with services being restored across all regions at approximately 18:46 UTC on Thursday 14th April 2022.
Customers may have experienced some of the following issues:
Delays in receiving data from self serve Integration Hub integrations:
Possible data loss due to being unable to process events for:
Root Cause:
The system hosting the self serve integrations experienced an issue with the data storage systems used to hold the configuration and state. This caused the integrations to be unable to retrieve their configuration reliably and caused them to error during any attempted executions during the outage period.
Mitigation:
The timeline (in UTC) for resolving this issue was:
Next Steps: