Error 503 Service Unavailable

For 4 hours period (2-6AM), we experienced an issue that was visible to customers in form of random 503 errors for approximately 40% of requests executed against our servers.

The issue was initiated by the maintenance of our third-party service provider which in consequence caused the occurrence of permanent corner-case state scenario in the failover algorithm on half of our load balances located in the US-EAST region, other regions were not affected by the problem.

We resolved the problem with a workaround at 6 AM UTC and deployed a stable fix to prevent it from happening in the future a few hours later.

Apologies for any inconvenience caused by the event.