Re: [outages] Level3 circuit issues in SoCal
Same; San Diego area fiber connection. Does not seem to be affecting our legacy TW phone circuits. Happened about an hour ago and has just started again. Was about to open a ticket. David From: Outages <outages-bounces@outages.org> on behalf of Bobin Joseph via Outages <outages@outages.org> Reply-To: Bobin Joseph <Bobin.Joseph@mitchell.com> Date: Thursday, August 25, 2016 at 5:38 PM To: "outages@outages.org" <outages@outages.org> Subject: [outages] Level3 circuit issues in SoCal Are anybody else experiencing issues with Level3 in the Southern California region? We are seeing constant intermittent outages on our internet and VPLS circuit. Thanks, Bobin
No issues on MPLS. Dino On Thu, Aug 25, 2016 at 2:46 PM, David Hubbard via Outages < outages@outages.org> wrote:
Same; San Diego area fiber connection. Does not seem to be affecting our legacy TW phone circuits. Happened about an hour ago and has just started again. Was about to open a ticket.
David
*From: *Outages <outages-bounces@outages.org> on behalf of Bobin Joseph via Outages <outages@outages.org> *Reply-To: *Bobin Joseph <Bobin.Joseph@mitchell.com> *Date: *Thursday, August 25, 2016 at 5:38 PM *To: *"outages@outages.org" <outages@outages.org> *Subject: *[outages] Level3 circuit issues in SoCal
Are anybody else experiencing issues with Level3 in the Southern California region?
We are seeing constant intermittent outages on our internet and VPLS circuit.
Thanks,
Bobin
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Just got off the phone with out account team. It is a known and widespread issue. No ETA or any other details yet. ________________________________ From: Dino Panagiotopoulos <dino.panagiotopoulos@gmail.com> Sent: Thursday, August 25, 2016 2:50 PM To: David Hubbard Cc: Bobin Joseph; outages@outages.org Subject: Re: [outages] Level3 circuit issues in SoCal No issues on MPLS. Dino On Thu, Aug 25, 2016 at 2:46 PM, David Hubbard via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Same; San Diego area fiber connection. Does not seem to be affecting our legacy TW phone circuits. Happened about an hour ago and has just started again. Was about to open a ticket. David From: Outages <outages-bounces@outages.org<mailto:outages-bounces@outages.org>> on behalf of Bobin Joseph via Outages <outages@outages.org<mailto:outages@outages.org>> Reply-To: Bobin Joseph <Bobin.Joseph@mitchell.com<mailto:Bobin.Joseph@mitchell.com>> Date: Thursday, August 25, 2016 at 5:38 PM To: "outages@outages.org<mailto:outages@outages.org>" <outages@outages.org<mailto:outages@outages.org>> Subject: [outages] Level3 circuit issues in SoCal Are anybody else experiencing issues with Level3 in the Southern California region? We are seeing constant intermittent outages on our internet and VPLS circuit. Thanks, Bobin _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
What in the world is going on with the Level3 network over the last two weeks? It's falling apart.
On Aug 25, 2016, at 17:46, David Hubbard via Outages <outages@outages.org> wrote:
Same; San Diego area fiber connection. Does not seem to be affecting our legacy TW phone circuits. Happened about an hour ago and has just started again. Was about to open a ticket.
David
From: Outages <outages-bounces@outages.org> on behalf of Bobin Joseph via Outages <outages@outages.org> Reply-To: Bobin Joseph <Bobin.Joseph@mitchell.com> Date: Thursday, August 25, 2016 at 5:38 PM To: "outages@outages.org" <outages@outages.org> Subject: [outages] Level3 circuit issues in SoCal
Are anybody else experiencing issues with Level3 in the Southern California region? We are seeing constant intermittent outages on our internet and VPLS circuit.
Thanks, Bobin
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Just got this: *** CASCADED EXTERNAL NOTES 25-Aug-2016 22:11:34 GMT From CASE: 11364554 - Event The IP NOC reported that an unknown issue was causing a link to bounce in San Diego, CA, impacting IP services. The IP NOC shutdown the bouncing link to resolve the issue and return services to a stable state. Tier III Technical Support and the equipment vendor were engaged for further investigation into the root cause. The IP NOC is continuing to monitor and a final notification will be sent when stability has been confirmed. But yeah, I feel the same way. Their network has been an absolute mess since they started trying to merge the legacy Twtelecom network together; it’s been really bad as of late, and any redundancy we had via the other provider is now gone as we have some locations with only L3 / TW circuits; both have issues at the same time now if it’s routing related. Ugh David From: Matt Hoppes <mattlists@rivervalleyinternet.net> Date: Thursday, August 25, 2016 at 6:11 PM To: David Hubbard <dhubbard@dino.hostasaurus.com> Cc: Bobin Joseph <Bobin.Joseph@mitchell.com>, "outages@outages.org" <outages@outages.org> Subject: Re: [outages] Level3 circuit issues in SoCal What in the world is going on with the Level3 network over the last two weeks? It's falling apart. On Aug 25, 2016, at 17:46, David Hubbard via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Same; San Diego area fiber connection. Does not seem to be affecting our legacy TW phone circuits. Happened about an hour ago and has just started again. Was about to open a ticket. David From: Outages <outages-bounces@outages.org<mailto:outages-bounces@outages.org>> on behalf of Bobin Joseph via Outages <outages@outages.org<mailto:outages@outages.org>> Reply-To: Bobin Joseph <Bobin.Joseph@mitchell.com<mailto:Bobin.Joseph@mitchell.com>> Date: Thursday, August 25, 2016 at 5:38 PM To: "outages@outages.org<mailto:outages@outages.org>" <outages@outages.org<mailto:outages@outages.org>> Subject: [outages] Level3 circuit issues in SoCal Are anybody else experiencing issues with Level3 in the Southern California region? We are seeing constant intermittent outages on our internet and VPLS circuit. Thanks, Bobin _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
Got this couple hours ago. *** CASCADED EXTERNAL NOTES 25-Aug-2016 23:03:17 GMT From CASE: 11364554 - Event Event Conclusion Summary Outage Start: August 25, 2016 20:00 GMT Outage Stop: August 25, 2016 21:50 GMT Root Cause: An unknown issue was causing a link to bounce in San Diego, CA, impacting IP services. Fix Action: The IP NOC shutdown the bouncing link to resolve the issue and return services to a stable state. Reason for Outage (RFO) Summary: The IP NOC reported that an unknown issue was causing a link to bounce in San Diego, CA, impacting IP services. The IP NOC shutdown the bouncing link to resolve the issue and return services to a stable state. Tier III Technical Support and the equipment vendor were engaged for further investigation into the root cause. This service impact has concluded; however, there may be additional analysis and discovery that occurs as the incident is reviewed by NOC management. Any available updates will be relayed upon event ticket closure. If additional issues are experienced, please contact the Level 3 Technical Service Center at 1-877-4LEVEL3. Thanks, Bobin ________________________________ From: Outages <outages-bounces@outages.org> on behalf of Eric Kuhnke via Outages <outages@outages.org> Sent: Thursday, August 25, 2016 3:20 PM To: outages@outages.org Subject: Re: [outages] Level3 circuit issues in SoCal It is interesting to see that the reliability of an IP transit provider sometimes has no direct correlation with their pricing structure for various commitments in $/MRC for a given value of Gbps. No matter what the marketing materials/sales say about how awesome their network is. In my experience, in a particular metro area, buying transit from a well-peered medium sized regional tier 2/3 size carrier where you personally know the people who have enable on the core routers can result in a more resilient network. On 8/25/16 3:15 PM, David Hubbard via Outages wrote: Just got this: *** CASCADED EXTERNAL NOTES 25-Aug-2016 22:11:34 GMT From CASE: 11364554 - Event The IP NOC reported that an unknown issue was causing a link to bounce in San Diego, CA, impacting IP services. The IP NOC shutdown the bouncing link to resolve the issue and return services to a stable state. Tier III Technical Support and the equipment vendor were engaged for further investigation into the root cause. The IP NOC is continuing to monitor and a final notification will be sent when stability has been confirmed. But yeah, I feel the same way. Their network has been an absolute mess since they started trying to merge the legacy Twtelecom network together; it’s been really bad as of late, and any redundancy we had via the other provider is now gone as we have some locations with only L3 / TW circuits; both have issues at the same time now if it’s routing related. Ugh David From: Matt Hoppes <mattlists@rivervalleyinternet.net><mailto:mattlists@rivervalleyinternet.net> Date: Thursday, August 25, 2016 at 6:11 PM To: David Hubbard <dhubbard@dino.hostasaurus.com><mailto:dhubbard@dino.hostasaurus.com> Cc: Bobin Joseph <Bobin.Joseph@mitchell.com><mailto:Bobin.Joseph@mitchell.com>, "outages@outages.org"<mailto:outages@outages.org> <outages@outages.org><mailto:outages@outages.org> Subject: Re: [outages] Level3 circuit issues in SoCal What in the world is going on with the Level3 network over the last two weeks? It's falling apart. On Aug 25, 2016, at 17:46, David Hubbard via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Same; San Diego area fiber connection. Does not seem to be affecting our legacy TW phone circuits. Happened about an hour ago and has just started again. Was about to open a ticket. David From: Outages <outages-bounces@outages.org<mailto:outages-bounces@outages.org>> on behalf of Bobin Joseph via Outages <outages@outages.org<mailto:outages@outages.org>> Reply-To: Bobin Joseph <Bobin.Joseph@mitchell.com<mailto:Bobin.Joseph@mitchell.com>> Date: Thursday, August 25, 2016 at 5:38 PM To: "outages@outages.org<mailto:outages@outages.org>" <outages@outages.org<mailto:outages@outages.org>> Subject: [outages] Level3 circuit issues in SoCal Are anybody else experiencing issues with Level3 in the Southern California region? We are seeing constant intermittent outages on our internet and VPLS circuit. Thanks, Bobin _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
participants (5)
-
Bobin Joseph -
David Hubbard -
Dino Panagiotopoulos -
Eric Kuhnke -
Matt Hoppes