Increased Response Times

Resolved

The API latencies have returned to their usual from 1313 UTC, after switching failing over to our secondary BigTable cluster.

Thu, Nov 25, 2021, 04:28 PM

(3 years ago)

Affected components

No components marked as affected

Updates

Resolved

The API latencies have returned to their usual from 1313 UTC, after switching failing over to our secondary BigTable cluster.

Thu, Nov 25, 2021, 04:28 PM

Monitoring

We have put a fix in place and response times for all API requests have returned to normal. We are still monitoring the situation.

Thu, Nov 25, 2021, 01:25 PM(3 hours earlier)

Investigating

We are seeing a slight increase in response times from our API, affecting 2% of traffic. This increased response time is coming from increased latency of our BigTable cluster which we continue to investigate.

Thu, Nov 25, 2021, 12:04 PM(1 hour earlier)

Investigating

We are seeing a slight increase in response times from our API. This is affecting a very small number of requests. We are investigating the cause. More updates to follow

Thu, Nov 25, 2021, 11:42 AM(22 minutes earlier)

Investigating

We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.

Thu, Nov 25, 2021, 11:39 AM

Investigating

We are seeing a slight increase in response times from our APIThis is affecting a very small number of requestsWe are investigating the causeMore updates to follow

Thu, Nov 25, 2021, 11:36 AM