So does anyone have the skinny on the Harris/L3 cascading router failure...
...on the air traffic control network yet? Do we know whether it was the DWDM layer, the MPLS layer, or one of the overlays that failed? -Bill
From the press conference this morning, it sounded like a broadcast storm or STP issue after some poor tech installed a fiber to copper converter at some remote site. Wonder if the old copper connection was plugged in still, tech installs new fiber connection, put the two into a bridge group on the equipment, fiber connection is also bridged to that same L2 network somewhere else and poof, you’re fucked. I can’t wait to read the RFO. Hopefully it is released to the public. -Mike
On Nov 14, 2026, at 12:05, Bill Woodcock via Outages <outages@outages.org> wrote:
...on the air traffic control network yet? Do we know whether it was the DWDM layer, the MPLS layer, or one of the overlays that failed?
-Bill
______________________________________________ Outages mailing list outages@outages.org Sign up for an account https://lists.outages.org/accounts/signup/ To subscribe send an email to outages-join@outages.org To unsubscribe send an email to outages-leave@outages.org To contact the list owners outages-owner@outages.org Archives https://lists.outages.org/archives/list/outages@outages.org/
Thank you for using Outages Lists! For post outage discussion, please redirect to outages-discussion@outages.org <OpenPGP_signature.asc>
On Sat, 2026-11-14 at 12:20 -0800, Mike Lyon via Outages wrote:
From the press conference this morning, it sounded like a broadcast storm or STP issue after some poor tech installed a fiber to copper converter at some remote site.
Wonder if the old copper connection was plugged in still, tech installs new fiber connection, put the two into a bridge group on the equipment, fiber connection is also bridged to that same L2 network somewhere else and poof, you’re fucked.
I guess the network DDos'd itself, huh? I'm not able to wrap my head around the fact that the system is setup so that a handful of routers and switches ground everything to a cascading overload. I'm sure there's more to this. Well, maybe I'm being too logical here, meh. Can someone please invite me to the closed-door meeting? Somebody's about to be the scapegoat. /vrode
I can’t wait to read the RFO. Hopefully it is released to the public.
-Mike
On Nov 14, 2026, at 12:05, Bill Woodcock via Outages <outages@outages.org> wrote:
...on the air traffic control network yet? Do we know whether it was the DWDM layer, the MPLS layer, or one of the overlays that failed?
-Bill
______________________________________________ Outages mailing list outages@outages.org Sign up for an account https://lists.outages.org/accounts/signup/ To subscribe send an email to outages-join@outages.org To unsubscribe send an email to outages-leave@outages.org To contact the list owners outages-owner@outages.org Archives https://lists.outages.org/archives/list/outages@outages.org/
Thank you for using Outages Lists! For post outage discussion, please redirect to outages-discussion@outages.org <OpenPGP_signature.asc>
Outages mailing list outages@outages.org Sign up for an account https://lists.outages.org/accounts/signup/ To subscribe send an email to outages-join@outages.org To unsubscribe send an email to outages-leave@outages.org To contact the list owners outages-owner@outages.org Archives https://lists.outages.org/archives/list/outages@outages.org/
Thank you for using Outages Lists! For post outage discussion, please redirect to outages-discussion@outages.org
participants (3)
-
Bill Woodcock -
Mike Lyon -
virendra rode