Currents - An increase in errors and delays from our services – Incident details

The system has recovered. We will continue to investigate the root cause and will update the description of the incident with the details when we have them.

Our backlog has recovered, and the service is back to normal.

The root cause appears to have been changes in our now reverted deployment. We will continue to investigate the cause and provide more details after our investigation.

We are still seeing issues as a result of the backlog, we are scaling up to address the backlog of tasks.

We are continuing to investigate the cause in the meantime.

We have reverted the most recent release, and the error rates have gone down.

We are still experiencing some slowdowns due to the task backlog that grew during the incident, but the system is mostly recovered.

Runs that were created during the outage will be marked as timed out, and you may see errors related to those runs in your local clients if they are still in progress.

New runs should not be affected, and should now work as expected.

We are still actively investigating the root cause.