July 2018 - Outages - Outages Lists

Let's Encrypt DNS broken
by Chris Adams 30 Jul '18

30 Jul '18

The domain for Let's Encrypt, letsencrypt.org, appears to have been dropped from the .org servers (whois is not showing it as expired). This is causing problems for things that try to check CRLs because the Let's Encrypt CRL servers don't resolve. -- Chris Adams <cma(a)cmadams.net>

5 5

Wide Open West <-> Level3 Traffic Dropping in Cleveland
by Nate Burke 29 Jul '18

29 Jul '18

I have a Wide Open West Circuit in Chicago, IP traffic on that circuit traversing a Level3 to Wide Open West handoff in Cleveland (4.53.197.82) is dropping. The problem started on Friday evening at 11pmGMT. Wide Open West has acknowledged that there is an issue, but said that they have to work with Level3 to resolve the problem. I just spoke to front line support again this morning, and was told that this has been escalated to network engineering, but have no ETA on a resolution, and my traffic traversing that hop is still dropping. Front line Support said that there may not be any movement until business hours monday. Does anyone have any other updates or experiencing similar? It appears to only be affecting traffic that traverses this one hop. Traffic coming into Wide Open West from other peers is unaffected. traceroute to 216.152.49.202 (216.152.49.202), 30 hops max, 64 byte packets 1 64.136.164.253 (64.136.164.253) 0.320 ms 0.383 ms 0.455 ms 2 64.136.161.253 (64.136.161.253) 0.162 ms 0.163 ms 0.173 ms 3 4.14.72.61 (4.14.72.61) 3.699 ms 3.713 ms 3.725 ms 4 4.53.197.82 (4.53.197.82) 5.508 ms 5.521 ms 5.531 ms 5 * * * 6 * * * 7 * * * 8 * * * traceroute to 216.152.49.202 (216.152.49.202), 30 hops max, 60 byte packets 1 ssdsemi3.a2hosting.com <http://ssdsemi3.a2hosting.com> (199.195.117.14) 0.051 ms 0.014 ms 0.011 ms 2 75.98.175.211.static.a2webhosting.com <http://75.98.175.211.static.a2webhosting.com> (75.98.175.211) 0.433 ms 0.512 ms 0.571 ms 3 75.98.175.254.static.a2webhosting.com <http://75.98.175.254.static.a2webhosting.com> (75.98.175.254) 0.274 ms 0.293 ms 0.272 ms 4 xe-11-0-1.bar2.Detroit1.Level3.net <http://xe-11-0-1.bar2.Detroit1.Level3.net> (4.31.124.141) 0.554 ms 0.579 ms 0.560 ms 5 ae-0-11.bar1.Cleveland1.Level3.net <http://ae-0-11.bar1.Cleveland1.Level3.net> (4.69.136.185) 3.821 ms ae-8-13.bar1.Cleveland1.Level3.net <http://ae-8-13.bar1.Cleveland1.Level3.net> (4.69.135.118) 3.830 ms ae-0-11.bar1.Cleveland1.Level3.net <http://ae-0-11.bar1.Cleveland1.Level3.net> (4.69.136.185) 3.813 ms 6 WIDEOPENWES.bar1.Cleveland1.Level3.net <http://WIDEOPENWES.bar1.Cleveland1.Level3.net> (4.53.197.82) 12.600 ms 11.649 ms 11.669 ms 7 * * * 8 * * * 9 * * * 10 * * * Nate

1 0

Fiber cut, Northern VA?
by Eric Van Tol 28 Jul '18

28 Jul '18

Hi all, Wondering if anyone knows anything about a fiber cut in NoVA or DC region today. We had a Zayo circuit and several GTT circuits go down earlier today around 11am EDT. GTT claimed no issues and we're still waiting word from Zayo. This would be the second cut we've had in the past 24 hours, if true. Did someone let the backhoes loose last night for the yearly purge? -evt

2 1

Comcast CT Outage?
by Cory Luba 26 Jul '18

26 Jul '18

Anyone else without service in the New Haven, CT area? Residential connection is down and Metro-E also appears down. Reported outage in the app. Regards, Cory Luba https://www.coryluba.com/ me(a)coryluba.com

1 0

Equinix SV8 Peering fabric flooding as of 2PM PST
by Peter Kranz 25 Jul '18

25 Jul '18

Something looks to be going on with the Equinix SV8 Peering fabric since around 2PM PST.. We are seeing a constant ingress stream of 10 Gbps of unknown traffic not destined to our peering sessions. Peter Kranz www.UnwiredLtd.com <http://www.unwiredltd.com/> Desk: 510-868-1614 x100 Mobile: 510-207-0000 pkranz(a)unwiredltd.com <mailto:pkranz@unwiredltd.com>

1 0

Re: [outages] Verizon Calling Issues
by Patrick M. McCarren 24 Jul '18

24 Jul '18

I can confirm issues sending and receiving issues to/from toll free and other numbers with Verizon cell numbers. We started receiving alerts from clients start at 8:00 PM EST. Also perhaps noteworthy, Verizon’s OneTalk offering seems to be unaffected (from what we’ve seen). -Patrick Patrick M. McCarren MMSC Consultants LLC | Partner, CTO Director of Core Operations & Infrastructure | Dell PartnerDirect Certified Confidentiality Notice | This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential or proprietary information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, immediately contact the sender by reply e-mail and destroy all copies of the original message. From: Outages <outages-bounces(a)outages.org> on behalf of Jordan Morris via Outages <outages(a)outages.org> Reply-To: Jordan Morris <jmorris(a)crosswindvoip.com> Date: Tuesday, July 24, 2018 at 8:08 PM To: "outages(a)outages.org" <outages(a)outages.org> Subject: [outages] Verizon Calling Issues Anyone else getting reports of people having issue calling toll free and other numbers on Verizon cell phones we are starting to get reports from multiple regions.

1 0

Verizon Calling Issues
by Jordan Morris 24 Jul '18

24 Jul '18

Anyone else getting reports of people having issue calling toll free and other numbers on Verizon cell phones we are starting to get reports from multiple regions.

2 1

Spectrum Outage
by Jeff Waddell 24 Jul '18

24 Jul '18

About 35 minutes ago we saw every Spectrum connection (both fiber and coax) we monitor drop from multiple locations in Ohio and KY (different regions) this is from multiple monitoring points as well. Currently on the phone holding for enterprise support

5 5

fiber cut due to train derailment in Worcester, MA
by Chuck Anderson 24 Jul '18

24 Jul '18

FYI, fiber cut on Saturday morning in Worcester is affecting some of our circuits as of 2018-07-22 06:30 EDT: http://www.telegram.com/news/20180721/csx-cars-derail-at-cambridge-street-b… http://www.wcvb.com/article/train-derails-in-worcester-after-striking-overp… Repairs cannot proceed until the wreckage is cleared.

2 1

Fwd: Primus PRIs down in Ontario
by Chester Rieman 23 Jul '18

23 Jul '18

canada > > Lots of PRIs down rogers having issues as well. > > http://ssd.primus.ca/ <http://ssd.primus.ca/>

1 0