January 2022 - Outages - Outages Lists

Hetzner: ECMP outage Nuremberg -> Cogent
by Lukas Tribus 30 Jan '22

30 Jan '22

Hetzner has once again a huge ECMP problem from their Nuremberg location towards their transit Cogent, just like a few months ago. This started at approximately 2205Z on January, 29th and is still ongoing (14 hours plus): lukas@htznr2:~$ mtr 150.252.224.78 -c 3 -rw Start: 2022-01-30T12:15:58+0100 HOST: htznr2 Loss% Snt Last Avg Best Wrst StDev 1.|-- _gateway 0.0% 3 4.2 4.7 4.2 5.3 0.6 2.|-- 10114.your-cloud.host 66.7% 3 0.3 0.3 0.3 0.3 0.0 3.|-- ??? 100.0 3 0.0 0.0 0.0 0.0 0.0 4.|-- 85-10-250-153.clients.your-server.de 0.0% 3 1.3 1.2 1.0 1.3 0.1 5.|-- spine11.cloud1.nbg1.hetzner.com 0.0% 3 1.1 1.3 1.0 1.8 0.4 6.|-- static.213-133-112-65.clients.your-server.de 0.0% 3 4.6 5.0 2.3 8.0 2.9 7.|-- ??? 100.0 3 0.0 0.0 0.0 0.0 0.0 lukas@htznr2:~$ mtr 150.252.224.79 -c 3 -rw Start: 2022-01-30T12:16:10+0100 HOST: htznr2 Loss% Snt Last Avg Best Wrst StDev 1.|-- _gateway 0.0% 3 5.1 5.2 5.1 5.4 0.2 2.|-- 10114.your-cloud.host 33.3% 3 0.4 0.4 0.3 0.4 0.0 3.|-- ??? 100.0 3 0.0 0.0 0.0 0.0 0.0 4.|-- 85-10-250-157.clients.your-server.de 0.0% 3 1.2 3.7 1.1 8.9 4.5 5.|-- spine12.cloud1.nbg1.hetzner.com 0.0% 3 1.1 1.1 1.1 1.1 0.0 6.|-- 213-239-239-141.clients.your-server.de 0.0% 3 0.6 0.9 0.6 1.6 0.6 7.|-- juniper6.dc2.nbg1.hetzner.com 0.0% 3 0.9 0.8 0.7 0.9 0.1 8.|-- be6496.nr01.b040138-0.nue01.atlas.cogentco.com 0.0% 3 1.2 1.8 1.2 2.6 0.8 9.|-- be2830.rcr21.nue01.atlas.cogentco.com 0.0% 3 1.2 1.3 1.2 1.5 0.2 10.|-- be2995.ccr21.muc03.atlas.cogentco.com 0.0% 3 3.5 26.0 3.5 71.1 39.0 11.|-- be3072.ccr51.zrh02.atlas.cogentco.com 0.0% 3 9.1 9.0 8.9 9.1 0.1 12.|-- be2195.rcr21.mil01.atlas.cogentco.com 0.0% 3 13.1 13.6 13.1 14.7 1.0 13.|-- 149.6.152.214 0.0% 3 15.8 15.8 15.6 15.8 0.1 14.|-- 185.25.74.133 0.0% 3 16.9 17.4 16.2 19.0 1.5 15.|-- te-2-1-0.asr1k-jn2.network.twt.it 0.0% 3 15.6 17.7 15.6 21.7 3.5 16.|-- res-ars103402d.ppp.twt.it 0.0% 3 28.8 28.7 28.7 28.8 0.1 lukas@htznr2:~$ mtr 150.252.224.80 -c 3 -rw Start: 2022-01-30T12:16:22+0100 HOST: htznr2 Loss% Snt Last Avg Best Wrst StDev 1.|-- _gateway 0.0% 3 4.0 5.0 4.0 5.9 1.0 2.|-- 10114.your-cloud.host 0.0% 3 0.3 0.4 0.3 0.6 0.1 3.|-- ??? 100.0 3 0.0 0.0 0.0 0.0 0.0 4.|-- 85-10-250-157.clients.your-server.de 0.0% 3 1.2 1.2 1.1 1.2 0.1 5.|-- spine12.cloud1.nbg1.hetzner.com 0.0% 3 1.1 1.2 1.1 1.5 0.3 6.|-- 213-239-239-121.clients.your-server.de 0.0% 3 0.6 2.6 0.6 6.5 3.4 7.|-- ??? 100.0 3 0.0 0.0 0.0 0.0 0.0 lukas@htznr2:~$ mtr 150.252.224.81 -c 3 -rw Start: 2022-01-30T12:16:34+0100 HOST: htznr2 Loss% Snt Last Avg Best Wrst StDev 1.|-- _gateway 0.0% 3 3.2 4.4 3.2 5.4 1.1 2.|-- 10114.your-cloud.host 0.0% 3 0.3 0.4 0.3 0.5 0.1 3.|-- ??? 100.0 3 0.0 0.0 0.0 0.0 0.0 4.|-- 85-10-250-153.clients.your-server.de 0.0% 3 1.1 1.1 1.0 1.1 0.1 5.|-- spine11.cloud1.nbg1.hetzner.com 0.0% 3 1.0 9.7 1.0 26.9 14.9 6.|-- static.213-133-112-69.clients.your-server.de 0.0% 3 0.7 0.8 0.7 1.1 0.2 7.|-- juniper6.dc2.nbg1.hetzner.com 0.0% 3 13.1 4.8 0.7 13.1 7.2 8.|-- be6496.nr01.b040138-0.nue01.atlas.cogentco.com 0.0% 3 1.6 1.4 1.3 1.6 0.1 9.|-- be2830.rcr21.nue01.atlas.cogentco.com 0.0% 3 1.7 1.4 1.2 1.7 0.3 10.|-- be2996.ccr22.muc03.atlas.cogentco.com 0.0% 3 5.1 4.1 3.5 5.1 0.9 11.|-- be3073.ccr52.zrh02.atlas.cogentco.com 0.0% 3 8.7 8.8 8.7 8.8 0.1 12.|-- be2196.rcr21.mil01.atlas.cogentco.com 0.0% 3 13.0 13.0 12.7 13.2 0.2 13.|-- 149.6.152.214 0.0% 3 16.0 16.0 15.9 16.0 0.1 14.|-- 185.25.74.133 0.0% 3 16.4 18.2 16.4 21.3 2.7 15.|-- te-0-2-0.asr1k-jn1.network.twt.it 0.0% 3 16.5 18.0 16.1 21.3 2.9 16.|-- res-103520d.ppp.twt.it 0.0% 3 31.5 31.8 31.5 32.1 0.3 lukas@htznr2:~$

1 0

icloud
by Randy Bush 25 Jan '22

25 Jan '22

having icloud auth problems on comcast in portland. anyone seeing similar? randy

6 5

Microsoft Availability
by Adam Gregory 25 Jan '22

25 Jan '22

We are seeing high latency and packet drops to Microsoft in the NYC area from Cogent, HE, and Lumen.

1 0

Zoom issues
by Chris Boyd 24 Jan '22

24 Jan '22

We’re seeing multiple reports of users not able to log in to Zoom or join meetings. Austin TX metro area, across several ISPs. Common element seems to be DNS resolutions into their 170.114.0.0/16 address space. Stuff that resolves to AWS IPs seems to be working normally. Downdetector is also showing a small spike in issues with zoom. —Chris

1 0

Re: [outages] Outages Digest, Vol 164, Issue 7
by John-Paul Reed 21 Jan '22

21 Jan '22

I am in South Texas. I just heard from our upstream SDWan/VPN provider (Omninet) that they believe Spectrum had pushed a routing table update which they since have rolled back. They only saw issues with Spectrum Internet customers in South Texas. They confirmed the issue looks to be resolved. Regards, John-Paul On Fri, Jan 21, 2022, 9:23 AM <outages-request(a)outages.org> wrote: > Send Outages mailing list submissions to > outages(a)outages.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://puck.nether.net/mailman/listinfo/outages > or, via email, send a message with subject or body 'help' to > outages-request(a)outages.org > > You can reach the person managing the list at > outages-owner(a)outages.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Outages digest..." > > > Today's Topics: > > 1. Re: Spectrum Issues in Texas (James Breeden) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 21 Jan 2022 15:12:14 +0000 > From: James Breeden <James(a)arenalgroup.co> > To: "outages(a)outages.org" <outages(a)outages.org> > Subject: Re: [outages] Spectrum Issues in Texas > Message-ID: > < > SA0PR20MB343870531C247B0F79D2CDD0C25B9(a)SA0PR20MB3438.namprd20.prod.outlook.com > > > > Content-Type: text/plain; charset="us-ascii" > > I'm in the Austin area and not seeing anything. > > > > > James W. Breeden > > Managing Partner > > > > > [cid:storage_emulated_0__EmailTempImage_3_TempSignature_signature_Outlook-zwrpfok2_png_1619537816666] > > Arenal Group: Arenal Consulting Group | Acilis Telecom | Pines Media | > Atheral | BlueNinja > > PO Box 1063 | Smithville, TX 78957 > > Email: james(a)arenalgroup.co<mailto:james@arenalgroup.co> | office > 512.360.0000<tel:512.360.0000> | cell 512.304.0745<tel:512.304.0745> | > www.arenalgroup.co<http://www.arenalgroup.co/> > Executive Assistant: Chelsea Nichols: chelsea(a)arenalgroup.co<mailto: > chelsea(a)arenalgroup.co> | 737.302.8742<tel:737.302.8742> > > Sent via mobile device, errors are not intentional but may occur. > > > > -------- Original message -------- > From: David Eddleman via Outages <outages(a)outages.org> > Date: 1/21/22 9:11 AM (GMT-06:00) > To: outages(a)outages.org > Subject: Re: [outages] Spectrum Issues in Texas > > What parts of Texas are you seeing this in? I'm in North Texas (Fort Worth > area) and on Spectrum, no issues here. > > David Eddleman > > > On Fri, Jan 21, 2022 at 8:43 AM John-Paul Reed via Outages < > outages(a)outages.org<mailto:outages@outages.org>> wrote: > Good morning, > I have quite a few Spectrum cable modem customers that are down right > now. Spectrum Helpdesk says that call volume is through the roof. No > outage declared yet and no root cause identified. Anyone else seeing this? > > -- > Sincerely, > > John-Paul > TW Enterprises > _______________________________________________ > Outages mailing list > Outages(a)outages.org<mailto:Outages@outages.org> > https://puck.nether.net/mailman/listinfo/outages >

1 0

Spectrum Issues in Texas
by John-Paul Reed 21 Jan '22

21 Jan '22

Good morning, I have quite a few Spectrum cable modem customers that are down right now. Spectrum Helpdesk says that call volume is through the roof. No outage declared yet and no root cause identified. Anyone else seeing this? -- Sincerely, John-Paul TW Enterprises

4 3

TNS SS7 Outage
by Mike Hammett 19 Jan '22

19 Jan '22

TNS has an SS7 outage. Both of our A-links go to different facilities (Chicago and Ashburn) over different VPNs (which are up). TNS has acknowledged that it's a carrier issue that they're investigating. ----- Mike Hammett [ http://www.ics-il.com/ | Intelligent Computing Solutions ] [ https://www.facebook.com/ICSIL ] [ https://plus.google.com/+IntelligentComputingSolutionsDeKalb ] [ https://www.linkedin.com/company/intelligent-computing-solutions ] [ https://twitter.com/ICSIL ] [ http://www.midwest-ix.com/ | Midwest Internet Exchange ] [ https://www.facebook.com/mdwestix ] [ https://www.linkedin.com/company/midwest-internet-exchange ] [ https://twitter.com/mdwestix ] [ http://www.thebrotherswisp.com/ | The Brothers WISP ] [ https://www.facebook.com/thebrotherswisp ] [ https://www.youtube.com/channel/UCXSdfxQv7SpoRQYNyLwntZg ]

1 1

Coverage of the .to outage
by Jay R. Ashworth 18 Jan '22

18 Jan '22

This piece: https://www.npr.org/2022/01/18/1073863310/an-undersea-cable-fault-could-cut… drills down to this piece with slightly more detail: https://www.reuters.com/markets/funds/undersea-cable-fault-could-cut-off-to… I'm told their national carrier is trying to bring in a ground station as well, though not whom it will connect to. Redirect discussion, please. [ Yes, embarassingly, Zimbra won't let me add the right header... ] Cheers, -- jra -- Jay R. Ashworth Baylink jra(a)baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://www.bcp38.info 2000 Land Rover DII St Petersburg FL USA BCP38: Ask For It By Name! +1 727 647 1274

1 0

Hurricane Electric STL Down
by Neader, Brent 17 Jan '22

17 Jan '22

Lost BGP peer, and getting an error on their LG when trying to test from STL, "Problem logging into core2.stl1.he.net at this time", pop appears to be dark?

3 2

HE STL POP
by Michael B. Williams 17 Jan '22

17 Jan '22

Anyone having issues with HE STL POP?

1 0