I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything? -Steve
Same here. We have four circuits located in NJ and PA that are experiencing severe packet loss, making them useless. -Brandon Porter Network Engineer 908.601.9860 From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Steve Dispensa Sent: Thursday, January 23, 2014 11:01 PM To: Outages@outages.org Subject: [outages] CenturyLink outage? I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything? -Steve
We've lost routes with CL MPLS also, though our direct connection seems to be OK. --Karl Karl Putland Senior Engineer *SimpleSignal* Anywhere: 303-242-8608 <http://www.simplesignal.com/explainer_video.php> On Thu, Jan 23, 2014 at 9:01 PM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything?
-Steve
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Direct == traditional PSTN or SIP? Or just Internet? From: Karl Putland [mailto:karl@simplesignal.com] Sent: Thursday, January 23, 2014 8:12 PM To: Steve Dispensa Cc: Outages@outages.org Subject: Re: [outages] CenturyLink outage? We've lost routes with CL MPLS also, though our direct connection seems to be OK. --Karl Karl Putland Senior Engineer SimpleSignal Anywhere: 303-242-8608 [Image removed by sender.]<http://www.simplesignal.com/explainer_video.php> [Image removed by sender.] On Thu, Jan 23, 2014 at 9:01 PM, Steve Dispensa <Steve.Dispensa@microsoft.com<mailto:Steve.Dispensa@microsoft.com>> wrote: I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything? -Steve _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
NNI IP from CE to PE in Denver seems to be OK, however we've lost routes to remote sites over MPLS. Karl Putland Senior Engineer *SimpleSignal* Anywhere: 303-242-8608 <http://www.simplesignal.com/explainer_video.php> On Thu, Jan 23, 2014 at 9:13 PM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
Direct == traditional PSTN or SIP? Or just Internet?
*From:* Karl Putland [mailto:karl@simplesignal.com] *Sent:* Thursday, January 23, 2014 8:12 PM *To:* Steve Dispensa *Cc:* Outages@outages.org *Subject:* Re: [outages] CenturyLink outage?
We've lost routes with CL MPLS also, though our direct connection seems to be OK.
--Karl
Karl Putland Senior Engineer *SimpleSignal* Anywhere: 303-242-8608
[image: Image removed by sender.]<http://www.simplesignal.com/explainer_video.php> [image: Image removed by sender.]
On Thu, Jan 23, 2014 at 9:01 PM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything?
-Steve
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
I just had 2 CL Fiber/Ethernet links drop off 11:04pm Eastern, One in LA and one in WA. On Thu, Jan 23, 2014 at 11:15 PM, Karl Putland <karl@simplesignal.com>wrote:
NNI IP from CE to PE in Denver seems to be OK, however we've lost routes to remote sites over MPLS.
Karl Putland Senior Engineer *SimpleSignal* Anywhere: 303-242-8608 <http://www.simplesignal.com/explainer_video.php>
On Thu, Jan 23, 2014 at 9:13 PM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
Direct == traditional PSTN or SIP? Or just Internet?
*From:* Karl Putland [mailto:karl@simplesignal.com] *Sent:* Thursday, January 23, 2014 8:12 PM *To:* Steve Dispensa *Cc:* Outages@outages.org *Subject:* Re: [outages] CenturyLink outage?
We've lost routes with CL MPLS also, though our direct connection seems to be OK.
--Karl
Karl Putland Senior Engineer *SimpleSignal* Anywhere: 303-242-8608
[image: Image removed by sender.]<http://www.simplesignal.com/explainer_video.php> [image: Image removed by sender.]
On Thu, Jan 23, 2014 at 9:01 PM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything?
-Steve
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Looks like this might be isolated to CL's MPLS network, as our IP transit circuits are also not affected by this outage. Perhaps someone made a boo-boo while making a change?... -Brandon Porter Network Engineer 908.601.9860 From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Steve Dispensa Sent: Thursday, January 23, 2014 11:14 PM To: Karl Putland Cc: Outages@outages.org Subject: Re: [outages] CenturyLink outage? Direct == traditional PSTN or SIP? Or just Internet? From: Karl Putland [mailto:karl@simplesignal.com] Sent: Thursday, January 23, 2014 8:12 PM To: Steve Dispensa Cc: Outages@outages.org<mailto:Outages@outages.org> Subject: Re: [outages] CenturyLink outage? We've lost routes with CL MPLS also, though our direct connection seems to be OK. --Karl Karl Putland Senior Engineer SimpleSignal Anywhere: 303-242-8608 [Image removed by sender.]<http://www.simplesignal.com/explainer_video.php> [Image removed by sender.] On Thu, Jan 23, 2014 at 9:01 PM, Steve Dispensa <Steve.Dispensa@microsoft.com<mailto:Steve.Dispensa@microsoft.com>> wrote: I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything? -Steve _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
We also lost our layer 3 MPLS connections between our San Francisco and New York city offices. New York City has the "Enhanced IQ" service (CTL will send to the internet if destination is not an announced prefix from us) and that doesn't seem to be working very well either. bt On Thu, Jan 23, 2014 at 8:13 PM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
Direct == traditional PSTN or SIP? Or just Internet?
*From:* Karl Putland [mailto:karl@simplesignal.com] *Sent:* Thursday, January 23, 2014 8:12 PM *To:* Steve Dispensa *Cc:* Outages@outages.org *Subject:* Re: [outages] CenturyLink outage?
We've lost routes with CL MPLS also, though our direct connection seems to be OK.
--Karl
Karl Putland Senior Engineer *SimpleSignal* Anywhere: 303-242-8608
[image: Image removed by sender.]<http://www.simplesignal.com/explainer_video.php> [image: Image removed by sender.]
On Thu, Jan 23, 2014 at 9:01 PM, Steve Dispensa < Steve.Dispensa@microsoft.com> wrote:
I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything?
-Steve
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
We have MPLS in VA MD CA all down From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Karl Putland Sent: Thursday, January 23, 2014 11:12 PM To: Steve Dispensa Cc: Outages@outages.org Subject: Re: [outages] CenturyLink outage? We've lost routes with CL MPLS also, though our direct connection seems to be OK. --Karl Karl Putland Senior Engineer SimpleSignal Anywhere: 303-242-8608 [http://www.simplesignal.com/images/email/ico-sig-exp-video.png]<http://www.simplesignal.com/explainer_video.php> [http://www.simplesignal.com/images/email/ico-sig-frost-sullivan.png] On Thu, Jan 23, 2014 at 9:01 PM, Steve Dispensa <Steve.Dispensa@microsoft.com<mailto:Steve.Dispensa@microsoft.com>> wrote: I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything? -Steve _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
All good here in Fargo, ND. Seeing some higher pings but not terribly higher. Jeremy On Jan 23, 2014 10:05 PM, "Steve Dispensa" <Steve.Dispensa@microsoft.com> wrote:
I lost 3 CL connections simultaneously at ~7:30 Pacific Time. Anyone else seeing anything?
-Steve
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (7)
-
Brandon Porter -
bt -
Hugh Smallwood -
Jeremy Schwarzrock -
Karl Putland -
Mitch Patterson -
Steve Dispensa