Previous incidents

This incident has been resolved. Shopify permissions have been restored, orders are syncing properly, and all missing data has been populated retroactively.

Root Cause Analysis — July 13, 2026
Incident summary
On July 13, 2026, we experienced two service interruptions related to the same underlying issue:
07:37–08:36 UTC
13:52–14:12 UTC

Root cause:
The incident began when our Kubernetes cluster stopped forwarding logs due to an issue with Fluentd, our log collection service.
To restore log forwarding, we initiated a non-disruptive upgrade of the Kubernetes node pools.
Based on the expected behavior of this procedure, the upgrade was not anticipa...

We have identified the issue, and the affected cluster is back online.

Our team is currently performing additional validation checks to ensure all services are operating as expected. We will continue investigating the root cause of the incident and will provide further updates as more information becomes available.

Allocator API recovered.

We experienced a temporary service disruption caused by a Google Cloud Platform (GCP) infrastructure issue affecting instance availability in the region. While our failover infrastructure activated as designed, the underlying provider-level capacity issue also impacted secondary recovery resources.

Services have been fully restored, and we have implemented additional resilience measures, including expanding to a third infrastructure pool to further strengthen redund...

Recommendations API recovered.