Snapshot 255584
Normalized text
Scripts and page chrome removed; this is what change detection compares.
Subscribe to UpdatesSubscribe All Systems Operational Uptime over the past 90 days. View historical uptime. Global Real Time Communication Operational Cloud Dashboard (cloud.livekit.io) Operational Global Egress Operational Global Ingress Operational Global SIP Operational Global Cloud Agents Operational Global Inference Operational Regional Real Time Communication Operational Japan - Real Time Communication Operational Brazil - Real Time Communication Operational India - Real Time Communication Operational US West - Real Time Communication Operational Australia - Real Time Communication Operational Singapore - Real Time Communication Operational US Central - Real Time Communication Operational South Africa - Real Time Communication Operational UAE - Real Time Communication Operational Israel - Real Time Communication Operational Saudi Arabia - Real Time Communication Operational Europe South - Real Time Communication Operational United Kingdom - Real Time Communication Operational US East - Real Time Communication Operational Europe Central - Real Time Communication Operational Regional TURN Operational Brazil - TURN Operational Japan - TURN Operational US West - TURN Operational India - TURN Operational Australia - TURN Operational Singapore - TURN Operational US Central - TURN Operational South Africa - TURN Operational UAE - TURN Operational Israel - TURN Operational Saudi Arabia - TURN Operational US East - TURN Operational Europe Central - TURN Operational United Kingdom - TURN Operational Europe South - TURN Operational Regional Analytics Ingestion Operational US West - Analytics Ingestion Operational Brazil - Analytics Ingestion Operational India - Analytics Ingestion Operational Japan - Analytics Ingestion Operational Australia - Analytics Ingestion Operational Singapore - Analytics Ingestion Operational US Central - Analytics Ingestion Operational South Africa - Analytics Ingestion Operational UAE - Analytics Ingestion Operational Israel - Analytics Ingestion Operational Saudi Arabia - Analytics Ingestion Operational United Kingdom - Analytics Ingestion Operational US East - Analytics Ingestion Operational Europe South - Analytics Ingestion Operational Europe Central - Analytics Ingestion Operational Regional Phone Numbers Operational US Phone Numbers Operational Regional SIP Operational US West - SIP Operational US East - SIP Operational India - SIP Operational Brazil - SIP Operational Australia - SIP Operational Japan - SIP Operational US Central - SIP Operational Israel - SIP Operational Saudi Arabia - SIP Operational UAE - SIP Operational South Africa - SIP Operational Singapore - SIP Operational Europe Central - SIP Operational Europe South - SIP Operational United Kingdom - SIP Operational Regional Ingress Operational US East - Ingress Operational US West - Ingress Operational Japan - Ingress Operational Singapore - Ingress Operational Australia - Ingress Operational South Africa - Ingress Operational Saudi Arabia - Ingress Operational India - Ingress Operational Brazil - Ingress Operational Israel - Ingress Operational UAE - Ingress Operational Europe South - Ingress Operational United Kingdom - Ingress Operational US Central - Ingress Operational Europe Central - Ingress Operational Regional Egress Operational Japan - Egress Operational US West - Egress Operational US East - Egress Operational Singapore - Egress Operational India - Egress Operational UAE - Egress Operational Brazil - Egress Operational South Africa - Egress Operational US Central - Egress Operational Saudi Arabia - Egress Operational Israel - Egress Operational Australia - Egress Operational United Kingdom - Egress Operational Europe Central - Egress Operational Europe South - Egress Operational Regional Cloud Agents Operational US East - Cloud Agents Operational Europe Central - Cloud Agents Operational India - Cloud Agents Operational UAE - Cloud Agents Operational Regional Inference Operational US East - Inference Operational Australia - Inference Operational Europe South - Inference Operational Brazil - Inference Operational South Africa - Inference Operational Singapore - Inference Operational US West - Inference Operational Saudi Arabia - Inference Operational Israel - Inference Operational United Kingdom - Inference Operational Europe Central - Inference Operational US Central - Inference Operational Japan - Inference Operational UAE - Inference Operational India - Inference Operational Operational Degraded Performance Partial Outage Major Outage Maintenance Major outage Partial outage No downtime recorded on this day. No data exists for this day. had a major outage. had a partial outage. Related No incidents or maintenance related to this downtime. Past Incidents Nov 11, 2026 No incidents reported today. Nov 10, 2026 No incidents reported. Nov 9, 2026 No incidents reported. Nov 8, 2026 No incidents reported. Nov 7, 2026 No incidents reported. Nov 6, 2026 No incidents reported. Nov 5, 2026 No incidents reported. Nov 4, 2026 Cloud Analytics – Infrastructure Upgrade Notice Completed - The scheduled maintenance has been completed. Nov 4, 20:49 PST Verifying - Verification is currently in progress Nov 4, 20:38 PST In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary. Nov 4, 20:00 PST Scheduled - We will be upgrading critical backend components supporting Cloud Analytics. During this operation, there may be minimal downtime or brief interruptions to analytics services. We will make every effort to keep the Cloud Dashboard and Analytics APIs available throughout the upgrade. No data will be lost, and real-time traffic will remain unaffected. Thank you for your patience while we perform these upgrades. Nov 3, 12:03 PST Nov 3, 2026 No incidents reported. Nov 2, 2026 No incidents reported. Nov 1, 2026 No incidents reported. Oct 31, 2026 Disconnections and failed connections in multiple regions Postmortem - Read details Nov 3, 05:59 PST Resolved - This incident has been resolved. Between 07:10 and 07:43 UTC on October 31, a software bug caused media servers in several regions to restart repeatedly. During this window: - Participants connected to affected servers were disconnected. Impact was heaviest in US East, US Central, US West, Canada and Mexico, where about 18% of participants were disconnected at least once. Many were disconnected more than once, as automatic reconnects landed on servers that then restarted as well. A small share of participants in Europe Central, Europe South, UAE, Saudi Arabia and Israel were also disconnected. Most disconnected participants reconnected automatically, about half within 5 seconds, but each reconnect started a new session rather than resuming the existing one, so participants may have seen repeated audio and video interruptions. Some participants did not reconnect. Participants joining during this window may also have taken longer to connect or failed to join. - Most agents reconnected and continued their conversations, but a small number of agent sessions ended or restarted. Some SIP call transfers also failed. - About 1.3% of Room Service API requests failed during this period. ListParticipants and GetParticipant were the most affected. Some WHIP ingress update and delete requests also failed. The bug was triggered when a specific type of data message was relayed between servers hosting the same multi-region room. We stopped the trigger at 07:43 UTC, and there were no further restarts after that. A fix was deployed to all regions by 08:49 UTC. Apologies for the impact. We will follow up with a postmortem sharing more details on impact and RCA as soon as possible. Oct 31, 00:43 PDT Oct 30, 2026 No incidents reported. Oct 29, 2026 No incidents reported. Oct 28, 2026 Investigating failing calls and RoomService API failures in US East and dashboard issues Postmortem - Read details Nov 1, 07:53 PST Resolved - This incident has been resolved. Between 23:30 and 23:58 UTC, a network disruption at an upstream infrastructure provider affected our US East region. During this window: Inbound SIP calls in US East failed at elevated rates, with affected calls rejected with 500 or 503 responses. Answered inbound calls were about 65% below normal across the window, and up to 90% below normal between 23:45 and 23:55 UTC. About 10% of outbound SIP call requests (CreateSIPParticipant) in US East failed, some returning 408 deadline_exceeded. Between 23:28 and 23:58 UTC, there were elevated rates of Room Service, Egress, and Ingress API request server errors in US East. Some participants saw failed room joins or increased packet loss. The LiveKit Cloud dashboard was inaccessible for part of this window. Network connectivity recovered at approximately 23:58 UTC, and error rates and call volumes returned to normal by 00:20 UTC. A related network issue also affected our much smaller Mexico region from 23:29 UTC, disconnecting active sessions and degrading service until traffic was moved to nearby regions at approximately 01:01 UTC. Sincere apologies for the impact. We will follow up with a postmortem. Oct 28, 18:19 PDT Monitoring - We've applied a mitigation for our Mexico region and services have returned to baseline. We are continuing to monitor and will update again within 15 minutes. Oct 28, 17:41 PDT Identified - While the US regions still appear to be stable, we are tracking degraded services including SIP, RTC, and APIs in our Mexico region. We will update again as soon as possible. Oct 28, 17:36 PDT Monitoring - We believe the mitigation was successful and are seeing services return to normal. The dashboard is accessible and error rates have gone down across services. We are continuing to monitor to make sure that the situation is resolved. We will update again as soon as possible. Oct 28, 17:16 PDT Update - We are still determining the full scope of impact, but we believe that the Room Service has also been impacted. We will update again within 15 minutes. Oct 28, 17:09 PDT Update - We are currently attempting a mitigation. We will follow up with more information in the next 15 minutes. Oct 28, 17:00 PDT Update - We believe there is also impact to inbound calls in the affected regions. We are working on identifying the cause and will update again within 15 minutes. Oct 28, 16:57 PDT Update - The LiveKit cloud dashboard is currently inaccessible. We are investigating this and will provide another update within 15 minutes. Oct 28, 16:51 PDT Investigating - We are currently investigating an increased rate of failing outbound calls in US East. We will post another update with more information as soon as possible. Oct 28, 16:47 PDT Incident History Powered by Atlassian Statuspage