I have a peering with them in Atlanta which bounced during the outage. Per their noc the switch just froze and began eating (my term) packets without actually causing peerings to go down. They rebooted it which is when our peerings were reset. They are monitoring and have been stable since the issue. From: Craig Pierantozzi <tozz@tozz.net> To: outages@outages.org Date: 10/20/2009 03:29 PM Subject: Re: [outages] Level 3 down in Atlanta Sent by: <outages-bounces@outages.org> There are multiple devices there handling intra and inter-pop traffic. NOC still investigating with vendor. Redundancy won't kick in if soft or silent failures occur and the control plane keeps protocols up but forwarding is affected. Unfortunately these types of failures still happen from time to time especially with multi-member LAG groups. No details on this specific event however. * Jeremy Chadwick was thought to have said:
Level 3 has a single router or switch handling packets at a major POP? I doubt this, but the outage is confirmation something bad happened.
That said: where's the redundancy, and why didn't it kick in?
outages mailing list outages@outages.org https://puck.nether.net/mailman/listinfo/outages