# LiveKit: Investigating failing calls and RoomService API failures in US East and dashboard issues

- Provider: [LiveKit](https://outages.live/livekit.md)
- Type: Incident
- State: Resolved
- Worst impact: Degraded performance
- Started: 2026-10-28 23:47 UTC
- Resolved: 2026-10-29 01:19 UTC (lasted 1 h 32 min)
- Components: Cloud Dashboard (cloud.livekit.io), US East - SIP, US Central - SIP, US Central - Real Time Communication, US East - Real Time Communication
- Official update: https://stspg.io/rxfmxyfndqvq

## Updates from LiveKit

### postmortem, 2026-11-01 15:41 UTC

## Summary On October 28, 2026, a network disruption at our cloud provider affected our US East data center. Starting at 23:28 UTC, services in US East lost the ability to reach our database and certain external services, such as model providers. Connections to end users and to our other regions kept working, so realtime media continued to flow. This caused widespread failures across SIP calls, Room Service, Egress and Ingress APIs, and Cloud Agents in US East. A related issue affected our Mexico region for longer. Connectivity in US East came back at around 23:58 UTC. Mexico recovered at 01:01 UTC after we moved its traffic to nearby regions. Our automatic failover should have moved traffic away from US East, and it didn't. That's the main thing we're fixing. We sincerely apologize to customers whose calls and agents were disrupted. ## Impact **US East \(23:28 to 23:58 UTC\)** * **SIP inbound:** a large share of inbound calls failed, rejected with 500 or 503 responses. Answered inboun

### resolved, 2026-10-29 01:19 UTC

This incident has been resolved. Between 23:30 and 23:58 UTC, a network disruption at an upstream infrastructure provider affected our US East region. During this window: Inbound SIP calls in US East failed at elevated rates, with affected calls rejected with 500 or 503 responses. Answered inbound calls were about 65% below normal across the window, and up to 90% below normal between 23:45 and 23:55 UTC. About 10% of outbound SIP call requests (CreateSIPParticipant) in US East failed, some returning 408 deadline_exceeded. Between 23:28 and 23:58 UTC, there were elevated rates of Room Service, Egress, and Ingress API request server errors in US East. Some participants saw failed room joins or increased packet loss. The LiveKit Cloud dashboard was inaccessible for part of this window. Network connectivity recovered at approximately 23:58 UTC, and error rates and call volumes returned to normal by 00:20 UTC. A related network issue also affected our much smaller Mexico region from 23:29 U

### monitoring, 2026-10-29 00:41 UTC

We've applied a mitigation for our Mexico region and services have returned to baseline. We are continuing to monitor and will update again within 15 minutes.

### identified, 2026-10-29 00:36 UTC

While the US regions still appear to be stable, we are tracking degraded services including SIP, RTC, and APIs in our Mexico region. We will update again as soon as possible.

### monitoring, 2026-10-29 00:16 UTC

We believe the mitigation was successful and are seeing services return to normal. The dashboard is accessible and error rates have gone down across services. We are continuing to monitor to make sure that the situation is resolved. We will update again as soon as possible.

### investigating, 2026-10-29 00:09 UTC

We are still determining the full scope of impact, but we believe that the Room Service has also been impacted. We will update again within 15 minutes.

### investigating, 2026-10-29 00:00 UTC

We are currently attempting a mitigation. We will follow up with more information in the next 15 minutes.

### investigating, 2026-10-28 23:57 UTC

We believe there is also impact to inbound calls in the affected regions. We are working on identifying the cause and will update again within 15 minutes.

### investigating, 2026-10-28 23:51 UTC

The LiveKit cloud dashboard is currently inaccessible. We are investigating this and will provide another update within 15 minutes.

### investigating, 2026-10-28 23:47 UTC

We are currently investigating an increased rate of failing outbound calls in US East. We will post another update with more information as soon as possible.