Level 3 issues in NE?

Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.

Yes, same here. I just drained L3 entirely and opened a ticket. Micah On Mon, May 9, 2016 at 1:38 PM, Erik Wooding via Outages < outages@outages.org> wrote:
Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Yes. Im told it's a fiber cut in VA. A bunch of our circuits dropped, followed by complaints of call quality issues (congestion on the alternate routes?) On May 9, 2016, at 16:41, Micah Croff via Outages <outages@outages.org> wrote: Yes, same here. I just drained L3 entirely and opened a ticket. Micah
On Mon, May 9, 2016 at 1:38 PM, Erik Wooding via Outages <outages@outages.org> wrote: Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Can confirm. Level 3 fiber cut. We have issues with our NE sites. On Mon, May 9, 2016 at 3:44 PM, Peter E via Outages <outages@outages.org> wrote:
Yes. Im told it's a fiber cut in VA. A bunch of our circuits dropped, followed by complaints of call quality issues (congestion on the alternate routes?)
On May 9, 2016, at 16:41, Micah Croff via Outages <outages@outages.org> wrote:
Yes, same here. I just drained L3 entirely and opened a ticket.
Micah
On Mon, May 9, 2016 at 1:38 PM, Erik Wooding via Outages < outages@outages.org> wrote:
Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Yes I am as well. Primary circuit is Qwest. Changed my routes to use our backup circuit to avoid Level3. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Micah Croff via Outages Sent: Monday, May 09, 2016 4:42 PM To: Erik Wooding <ewooding@mdsol.com> Cc: outages@outages.org Subject: Re: [outages] Level 3 issues in NE? Yes, same here. I just drained L3 entirely and opened a ticket. Micah On Mon, May 9, 2016 at 1:38 PM, Erik Wooding via Outages <outages@outages.org <mailto:outages@outages.org> > wrote: Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays. _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

many clients running over level 3 on our network, are reporting issues too seems like an issue with level 3 On Mon, May 9, 2016 at 4:41 PM, Micah Croff via Outages <outages@outages.org
wrote:
Yes, same here. I just drained L3 entirely and opened a ticket.
Micah
On Mon, May 9, 2016 at 1:38 PM, Erik Wooding via Outages < outages@outages.org> wrote:
Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Izzy Goldstein Main: (212) 477.1000 Fax: (212) 477.8900 igoldstein@telego.com Website <http://www.telego.com/> | LinkedIn <https://www.linkedin.com/company/telego> | Blog <http://www.telego.com/blog> | Confidentially Notice: This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error please notify us immediately by email reply and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of TeleGo (T). Employees of TeleGo are expressly required not to make defamatory statements and not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to TeleGo policy and outside the scope of the employment of the individual concerned. TeleGo will not accept any liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising. Think before you print.

http://downdetector.com/status/level3
From the above:
Todd Murphy<https://www.facebook.com/todd.murphy.509> · Commercial Engineer<https://www.facebook.com/pages/Commercial-Engineer/841151435901484> at Time Warner Cable<https://www.facebook.com/twc/> Level3 is dealing with two critical fiber cuts in the Northeast. One is in Auburn Mass the other is between Phili and Wilmington, this is causing a massive issue for services providers in NYC.? We are up in Rochester, NY but seeing intermittent packet loss and increased latency over the L3 link. ________________________________ From: Outages <outages-bounces@outages.org> on behalf of Micah Croff via Outages <outages@outages.org> Sent: Monday, May 9, 2016 4:41 PM To: Erik Wooding Cc: outages@outages.org Subject: Re: [outages] Level 3 issues in NE? Yes, same here. I just drained L3 entirely and opened a ticket. Micah Brad Jervis | Senior Cloud Engineer OffsiteDataSync | A Top 100 Cloud Service Provider Main: 585.256.2054 www.offsitedatasync.com<http://www.offsitedatasync.com/> 100 Chestnut Street, 18th Floor | Rochester NY 14604 On Mon, May 9, 2016 at 1:38 PM, Erik Wooding via Outages<outages@outages.org<mailto:outages@outages.org>> wrote: Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

We've got a Wave between the US and Europe down, as well as service degradation from the East coast to a couple Level 3 DIA connections in EMEA. Here's latest case update from Level 3 I have: *** CASCADED EXTERNAL NOTES 09-May-2016 20:35:11 GMT - Event Fiber crews are onsite and are prepping the and pulling the replacement fiber at this time. The fiber splicing crew is en route, and an estimated arrival time of 22:00 GMT has been provided. 05/09/2016 20:35:48 GMT - *** CASCADED EXTERNAL NOTES 09-May-2016 20:35:11 GMT Event Fiber crews are onsite and are prepping the and pulling the replacement fiber at this time. The fiber splicing crew is en route, and an estimated arrival time of 22:00 GMT has been provided. 05/09/2016 19:58:30 GMT - 05/09/2016 19:42:57 GMT - A fiber issue between Wilmington, DE and Philadelphia, PA is impacting unprotected services. The fault has been identified and Field Services have been engaged to dispatch to the site, an estimated arrival time has not been provided. Please be advised that updates for this event will be relayed at a minimum of hourly unless otherwise noted. The information conveyed hereafter is associated to live troubleshooting effort and as the discovery process evolves through to service resolution, ticket closure, or post incident review, details may evolve. On Mon, May 9, 2016 at 1:50 PM, Brad Jervis via Outages <outages@outages.org
wrote:
http://downdetector.com/status/level3
From the above: Todd Murphy <https://www.facebook.com/todd.murphy.509> · Commercial Engineer <https://www.facebook.com/pages/Commercial-Engineer/841151435901484> at Time Warner Cable <https://www.facebook.com/twc/> Level3 is dealing with two critical fiber cuts in the Northeast. One is in Auburn Mass the other is between Phili and Wilmington, this is causing a massive issue for services providers in NYC.
We are up in Rochester, NY but seeing intermittent packet loss and increased latency over the L3 link. ------------------------------ *From:* Outages <outages-bounces@outages.org> on behalf of Micah Croff via Outages <outages@outages.org> *Sent:* Monday, May 9, 2016 4:41 PM *To:* Erik Wooding *Cc:* outages@outages.org *Subject:* Re: [outages] Level 3 issues in NE?
Yes, same here. I just drained L3 entirely and opened a ticket.
Micah
*Brad Jervis | Senior Cloud Engineer*
OffsiteDataSync | A Top 100 Cloud Service Provider
Main: 585.256.2054
*www.offsitedatasync.com* <http://www.offsitedatasync.com/>
*100 Chestnut Street, 18th Floor | Rochester NY 14604* On Mon, May 9, 2016 at 1:38 PM, Erik Wooding via Outages< outages@outages.org> wrote:
Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Lost Level 3 transport waves from Ashburn to New York and Ashburn to Paris ~2 hours ago, Level3 is aware no new updates at this time. 05/09/2016 20:28:47 GMT - The local provider continues to investigate the issue at this time. No new information is available at this time. 05/09/2016 20:02:10 GMT - The local provider continues to investigate the issue at this time. 05/09/2016 18:41:45 GMT - An unknown issue in New York, NY is impacting protected services. The Transport NOC isolated the issue to a local providers network. The local provider has been engaged to investigate the issue, and investigation efforts are ongoing at this time. Please be advised that updates for this event will be relayed at a minimum of hourly unless otherwise noted. The information conveyed hereafter is associated to live troubleshooting effort and as the discovery process evolves through to service resolution, ticket closure, or post incident review, details may evolve. -Malachi *Malachi Middlebrook* Principal Network Consultant Loci Network Solutions LLC www.locinetworks.com <http://locinetworks.com> C: 949-378-2826 On Mon, May 9, 2016 at 1:41 PM, Micah Croff via Outages <outages@outages.org
wrote:
Yes, same here. I just drained L3 entirely and opened a ticket.
Micah
On Mon, May 9, 2016 at 1:38 PM, Erik Wooding via Outages < outages@outages.org> wrote:
Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

We are seeing call quality issues in PA and NY. We were trying to isolate when the outage.org emails started coming in. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Erik Wooding via Outages Sent: Monday, May 09, 2016 16:39 To: outages@outages.org Subject: [outages] Level 3 issues in NE? Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.

+1 also have voice services here riding L3 that were affected had to drop L3 On Mon, May 9, 2016 at 4:54 PM, Kevin Miller via Outages < outages@outages.org> wrote:
We are seeing call quality issues in PA and NY. We were trying to isolate when the outage.org emails started coming in.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Erik Wooding via Outages *Sent:* Monday, May 09, 2016 16:39 *To:* outages@outages.org *Subject:* [outages] Level 3 issues in NE?
Anyone experiencing any internet issues with Level 3 in the NE? I have two sites experiencing significant delays.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (11)
-
Brad Jervis
-
chris
-
Erik Wooding
-
Hyoun Kim
-
Izzy Goldstein - TeleGo
-
Kevin Miller
-
Malachi Middlebrook
-
Matt Williamson
-
Micah Croff
-
Michael Bolton
-
Peter E