IVAO - Major Outage Affecting Services – Incident details

All systems operational

Major Outage Affecting Services

Resolved
Major outage
Started 9 days agoLasted about 1 hour

Affected

REST APIs

Major outage from 11:08 AM to 11:14 AM, Operational from 11:14 AM to 11:28 AM, Major outage from 11:20 AM to 11:21 AM, Degraded performance from 11:20 AM to 11:21 AM, Operational from 11:21 AM to 11:28 AM, Major outage from 11:28 AM to 11:55 AM

Core

Major outage from 11:08 AM to 11:55 AM

Data

Major outage from 11:08 AM to 11:15 AM, Operational from 11:15 AM to 11:20 AM, Major outage from 11:20 AM to 11:23 AM, Operational from 11:23 AM to 11:28 AM, Major outage from 11:28 AM to 11:55 AM

Auth

Major outage from 11:08 AM to 11:55 AM

Flight Plan

Major outage from 11:08 AM to 11:14 AM, Operational from 11:14 AM to 11:20 AM, Degraded performance from 11:20 AM to 11:21 AM, Operational from 11:21 AM to 11:28 AM, Major outage from 11:28 AM to 11:55 AM

WebEye

Major outage from 11:08 AM to 11:21 AM, Operational from 11:21 AM to 11:28 AM, Major outage from 11:28 AM to 11:55 AM

Updates
  • Resolved
    Resolved

    All affected services have remained stable following the recovery actions taken earlier, and we are not currently observing any service impact.

    We will continue to closely monitor the situation, as our service provider's maintenance activities are still ongoing. Whilst we do not anticipate further disruption, there remains a possibility of service degradation until their work has been fully completed.

    Thank you for your patience and understanding. Happy flying/controlling!

  • Monitoring
    Monitoring

    Most of our services have now stabilised and are operating normally. We are currently verifying the status of all remaining affected components.

  • Identified
    Identified

    One of our service providers inadvertently degraded their service whilst performing maintenance, resulting in reduced capacity. This caused several nodes in our Kubernetes cluster, which hosts the majority of our websites and APIs, to become unresponsive.

    Our team is actively working to restore service and is manually scaling the cluster to recover affected systems as quickly as possible. We will continue to provide updates as more information becomes available.

  • Investigating
    Investigating

    A major outage affecting one of our key service providers is currently impacting most of our services. We are in contact with the provider and will share updates as more information becomes available.