Re: [outages] Level3/TW Telecom issues?

--- outages@outages.org wrote: Root Cause: An unknown issue in Chicago, IL was impacting IP services. Fix Action: Adjustments were made to resolve the issue and restore services. Summary: The IP NOC responded to an unknown issue in Chicago, IL that was impacting IP services. Tier III Technical Support were engaged to assist with investigations, and adjustments were made to resolve the issue and stabilize traffic. Monitoring continues to ensure stability. Should further issues be experienced, please contact the Level 3 Technical Service Center. ------------------------------------------ This has got to be one of the funniest (stoopidest?) tickets I've seen in a long time. We don't know what the problem is, but we made 'adjustments' to fix it and the network's now stable. If it's an unknown problem, how do you know what to 'adjust' to fix it? scott _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

On 27 August 2015 at 12:54, Scott Weeks via Outages <outages@outages.org> wrote:
--- outages@outages.org wrote:
Root Cause: An unknown issue in Chicago, IL was impacting IP services. Fix Action: Adjustments were made to resolve the issue and restore services.
Summary: The IP NOC responded to an unknown issue in Chicago, IL that was impacting IP services. Tier III Technical Support were engaged to assist with investigations, and adjustments were made to resolve the issue and stabilize traffic. Monitoring continues to ensure stability. Should further issues be experienced, please contact the Level 3 Technical Service Center. ------------------------------------------
This has got to be one of the funniest (stoopidest?) tickets I've seen in a long time. We don't know what the problem is, but we made 'adjustments' to fix it and the network's now stable. If it's an unknown problem, how do you know what to 'adjust' to fix it?
Try 100 things and hope one makes a difference.
scott
-- ------- inum: 883510009027723 sip: jungleboogie@sip2sip.info xmpp: jungle-boogie@jit.si

And that was yesterday. Today it sounds like some serious synergy is under way: "IP and Transport Tier III, Operations Engineering and Field Services continue collaboratively working the issue. " Update from 2:26pm US/Central. This has been bad for 24 hrs and seems to be impacting peering and transit.
On Aug 27, 2015, at 2:54 PM, Scott Weeks via Outages <outages@outages.org> wrote:
--- outages@outages.org wrote:
Root Cause: An unknown issue in Chicago, IL was impacting IP services. Fix Action: Adjustments were made to resolve the issue and restore services.
Summary: The IP NOC responded to an unknown issue in Chicago, IL that was impacting IP services. Tier III Technical Support were engaged to assist with investigations, and adjustments were made to resolve the issue and stabilize traffic. Monitoring continues to ensure stability. Should further issues be experienced, please contact the Level 3 Technical Service Center. ------------------------------------------
This has got to be one of the funniest (stoopidest?) tickets I've seen in a long time. We don't know what the problem is, but we made 'adjustments' to fix it and the network's now stable. If it's an unknown problem, how do you know what to 'adjust' to fix it?
scott
_______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (3)
-
jungle Boogie
-
Ryan Brooks
-
Scott Weeks