It appears to have been a new issue, but possibly related to the previous one. Level(3) reported the following this morning: 13:53 GMT<x-apple-data-detectors://1> - The IP NOC reports that protocol drops following a scheduled maintenance, GCR 7622319<tel:7622319>, in Detroit, MI impacted IP services. The issue existed on a connection between two of the routers in Detroit, MI. The IP NOC has disabled that connection to allow traffic to flow through alternate routes and eliminate the protocol drops. The IP NOC will continue investigating the faulty connection in an attempt to determine the root cause and restore the connection for service. At this time, the IP NOC reports that services are up and stable Sent from my iPhone On Mar 8, 2014, at 6:36 AM, "Mitch Patterson" <mitpatterson@gmail.com<mailto:mitpatterson@gmail.com>> wrote: They were doing emergency maintance likely related to the other night On Mar 8, 2014 6:34 AM, "Greg Smythe" <greg@thesmythes.org<mailto:greg@thesmythes.org>> wrote: As I type this I am seeing Level3 issues in the Detroit area. Been going on since about 4:30am Eastern. My co-lo provider had to disable peering to get us back and running. -=-=-=-=-=-=-=-=-=-=--=-=- Greg Smythe From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Mitch Patterson Sent: Friday, March 07, 2014 12:51 AM To: Bill Wichers Cc: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Level 3 Detroit issues again Just got this *** CASCADED EXTERNAL NOTES 07-Mar-2014 05:48:37 GMT From CASE: 7621845 - Event The Operations Engineering team has isolated the cause of the packet loss failure. A change in parameters on the Detroit's network router has been initiated to restore normal operations. On Fri, Mar 7, 2014 at 12:41 AM, Mitch Patterson <mitpatterson@gmail.com<mailto:mitpatterson@gmail.com>> wrote: Just got this 03/07/2014 05:06 AM GMT *** CASCADED EXTERNAL NOTES 07-Mar-2014 05:06:43 GMT From CASE: 7621845 - Event The Technical Services Center (TSC) detected a packet loss condition on a network router in Detroit, MI. The Operations Engineering team has been engaged on the issue and they are currently analyzing the packet loss condition to determine the cause of the failure. On Fri, Mar 7, 2014 at 12:01 AM, Mitch Patterson <mitpatterson@gmail.com<mailto:mitpatterson@gmail.com>> wrote: Do you know are the circuits you are on legacy GLBX? from what i'm told by our guy who handles the colo the legacy GLBX ones are fine. but the other ones are not. On Thu, Mar 6, 2014 at 11:59 PM, Bill Wichers <billw@waveform.net<mailto:billw@waveform.net>> wrote: We connect into them in Detroit and we don't see this. We aren't in their colo though. -Bill Sent from my iPhone On Mar 6, 2014, at 11:44 PM, "Mitch Patterson" <mitpatterson@gmail.com<mailto:mitpatterson@gmail.com>> wrote:
We are seeing over 20% packet loss on our circuits at their colo in Southfield. They are telling me its been refereed to their IP core team as its a high level issue. Anyone else seeing this? _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages