March 2020 - Outages - Outages Lists

FiOS issue in NYC Area?
by Izzy Goldstein - TeleGo 16 Feb '21

16 Feb '21

Many of our clients who are using fios are reporting issues with their voip phones when i switch them to their backup ISP (Optimum etc) it works fine anyone else experiencing any fios issues ? -- Izzy Goldstein Chief Technology Officer Main: (212) 477-1000 x 2085 <(212)%20477-1000> Direct: (929) 477-2085 Website: www.telego.com <http://www.telego.net/> <http://www.telego.com/> Confidentiality Notice: This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error please notify us immediately by email reply and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of TeleGo (T). Employees of TeleGo are expressly required not to make defamatory statements and not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to TeleGo policy and outside the scope of the employment of the individual concerned. TeleGo will not accept any liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising. TeleGo Hosted PBX <https://youtu.be/DaT8YAZ4V0w>

7 18

freshbooks timeouts
by Izzy Goldstein - TeleGo 31 Mar '20

31 Mar '20

anyone else experiencing timeouts with freshbooks Classic APIs -- Izzy Goldstein Chief Technology Officer Main: (212) 477-1000 x 2085 <(212)%20477-1000> Direct: (929) 477-2085 Website: www.telego.com <http://www.telego.net/> <http://www.telego.com/> Confidentiality Notice: This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error please notify us immediately by email reply and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of TeleGo (T). Employees of TeleGo are expressly required not to make defamatory statements and not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to TeleGo policy and outside the scope of the employment of the individual concerned. TeleGo will not accept any liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising. TeleGo Hosted PBX <https://youtu.be/DaT8YAZ4V0w>

2 1

Bandwidth Outage in Fresno, CA
by Rob Whitlatch 31 Mar '20

31 Mar '20

Bandwidth Local Market Impairment - 728 - Fresno, CA New incident: Identified We are experiencing a transport issue on the Bandwidth network affecting your inbound origination service only. We are currently working with our carrier for resolution. Time posted Mar 31, 05:01 EDT Components affected Major Outage Local Market Status - 728 - Fresno, CA Rob Whitlatch Director of DevOps White Label Communications 215-987-4500

1 0

Utopia AS53407 high latency/loss, northern half of Utah
by Dutt, Ron 30 Mar '20

30 Mar '20

~6:25pm PDT our WAN circuit with Utopia jumped ~300ms to all destinations. Calling XMission (commercial ISP branch of Utopia from what I gather) results in a prerecorded message indicate a fiber issue with Utopia, confirmed via their twitter as well: https://twitter.com/XMissionStatus/status/1244808671021785090?s=20

2 1

ovh network outage
by hiro 30 Mar '20

30 Mar '20

i had issues with tcp SYN, dns traffic and icmp not getting through. finally they added an entry, too: http://travaux.ovh.net/?do=details&id=43793&

1 0

Vz Cellular issues in Western PA?
by Allen Kitchen 29 Mar '20

29 Mar '20

Noticing lots of oddities in Vz cell service around 16001, Butler PA. Wi-fi fallback calls also not completing. I'll watch Outages-discussion for any replies / me-too's / not-here's ... Allen Kitchen N2AEL Butler, PA

2 1

Google services/Youtube degradation
by Musee Ullah 27 Mar '20

27 Mar '20

I'm seeing a lot of reports on Twitter and elsewhere over the past hour that live streams on the Youtube platform are not functioning and indeed they are not. Video on demand appears to be fine. Other Google owned products (Docs, etc) appear to be suffering as well: https://twitter.com/gsuite/status/1243208675487072259

5 5

San Francisco metro Cogent outage 3/26/20 4:40PM PDT - Ongoing
by Peter Kranz 26 Mar '20

26 Mar '20

Cogent ports in San Francisco and Oakland became black holes at ~4:40PM PDT. They are currently only advertising 110 routes as their full tables in that area. Peter Kranz <http://www.unwiredltd.com/> www.UnwiredLtd.com Desk: 510-868-1614 x100 Mobile: 510-207-0000 <mailto:pkranz@unwiredltd.com> pkranz(a)unwiredltd.com

6 6

Re: [outages] Outages Digest, Vol 142, Issue 19
by Joel Rodriguez 26 Mar '20

26 Mar '20

Nest and Chrome Remote Desktop appears to be affected as well. Thanks in advance, Joel Rodriguez -----Original Message----- From: Outages <outages-bounces(a)outages.org> On Behalf Of outages-request(a)outages.org Sent: Thursday, March 26, 2020 12:29 To: outages(a)outages.org Subject: Outages Digest, Vol 142, Issue 19 This message is from an external source. Please use caution when opening attachments, clicking links or responding to this email. Send Outages mailing list submissions to outages(a)outages.org To subscribe or unsubscribe via the World Wide Web, visit https://puck.nether.net/mailman/listinfo/outages or, via email, send a message with subject or body 'help' to outages-request(a)outages.org You can reach the person managing the list at outages-owner(a)outages.org When replying, please edit your Subject line so it is more specific than "Re: Contents of Outages digest..." Today's Topics: 1. Re: Spectrum <-> Zayo Packet Loss / RTT (jd) 2. Re: Spectrum <-> Zayo Packet Loss / RTT (Shawn Solomon) 3. Google services/Youtube degradation (Musee Ullah) 4. Re: Google services/Youtube degradation (Matt Zaglin) 5. Re: Google services/Youtube degradation (Ryan McGinnis) ---------------------------------------------------------------------- Message: 1 Date: Tue, 24 Mar 2020 12:57:19 -0700 (PDT) From: jd <jd(a)boldnetworks.net> To: <outages(a)outages.org> Subject: Re: [outages] Spectrum <-> Zayo Packet Loss / RTT Message-ID: <131601d60216$6baf6080$430e2180$(a)boldnetworks.net> Content-Type: text/plain; charset="us-ascii" I'm seeing the same thing in Los Angeles. -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Shawn Solomon via Outages Sent: Tuesday, March 24, 2020 12:49 PM To: outages(a)outages.org Subject: [outages] Spectrum <-> Zayo Packet Loss / RTT Fyi, I am seeing high rtt and pl on a spectrum / zayo interconnect. Also, the path seems pretty bizarre, seems like they'd be exchanging in dallas. 2. cpe-69-132-132-1.carolina.res.rr.com 0.0% 2612 13.3 16.8 3.3 79.3 8.7 3. cpe-174-111-099-002.triad.res.rr.com 0.0% 2612 20.1 17.3 4.1 122.2 7.5 4. chrlncnor-vis1.carolina.rr.com 0.0% 2612 7.5 15.0 2.7 72.2 6.3 5. 24.93.67.204 0.0% 2612 5.1 19.2 3.3 73.2 6.6 6. bu-ether11.atlngamq46w-bcr00.tbone.rr. 0.0% 2612 17.0 23.7 9.0 86.8 6.9 7. 0.ge-0-0-0.ar0.den30.tbone.rr.com 0.0% 2612 45.7 40.2 25.7 87.2 6.7 8. 0.ae3.pr1.dfw10.tbone.rr.com 0.0% 2612 38.6 40.0 25.4 90.9 6.4 9. 66.109.5.138 0.0% 2612 43.4 40.1 25.1 91.9 6.7 10. ge-1-3-0.a0.buf00.tbone.rr.com 0.0% 2612 49.3 39.7 23.8 153.5 12.5 11. 66.109.7.42 0.1% 2612 879.7 127.5 90.2 879.7 18.2 12. ae16.cs2.lga5.us.zip.zayo.com 13.0% 2612 201.0 195.4 181.1 247.1 7.2 13. ae4.cs2.dca2.us.eth.zayo.com 13.3% 2612 203.0 196.7 181.1 433.9 8.9 14. ae3.cs2.iah1.us.eth.zayo.com 14.6% 2611 197.1 192.4 176.7 244.8 7.6 15. ae5.cs2.dfw2.us.eth.zayo.com 13.1% 2611 190.7 195.0 179.8 245.8 7.3 16. ae1.mcs2.dfw2.us.eth.zayo.com 12.4% 2611 192.9 192.6 178.1 231.6 7.3 17. ae5.mpr2.dfw5.us.zip.zayo.com 13.4% 2611 191.2 190.9 176.9 247.8 6.8 _______________________________________________ Outages mailing list Outages(a)outages.org https://puck.nether.net/mailman/listinfo/outages ------------------------------ Message: 2 Date: Tue, 24 Mar 2020 16:22:28 -0400 From: Shawn Solomon <sdsolomo(a)gmail.com> To: jd <jd(a)boldnetworks.net> Cc: outages(a)outages.org Subject: Re: [outages] Spectrum <-> Zayo Packet Loss / RTT Message-ID: <CAHRRK1tWmJneuWH4cqwot_=CduMA5Md9kY_ioHorWLCvA8Y_0g(a)mail.gmail.com> Content-Type: text/plain; charset="UTF-8" trying to make progress at zayo and rr, but... If anyone on list is +clue at either charter/spectrum/rr or zayo and would like some additional traceroutes, feel free to contact me off-list. s On Tue, Mar 24, 2020 at 4:07 PM jd via Outages <outages(a)outages.org> wrote: > > I'm seeing the same thing in Los Angeles. > > -----Original Message----- > From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Shawn > Solomon via Outages > Sent: Tuesday, March 24, 2020 12:49 PM > To: outages(a)outages.org > Subject: [outages] Spectrum <-> Zayo Packet Loss / RTT > > Fyi, I am seeing high rtt and pl on a spectrum / zayo interconnect. > > Also, the path seems pretty bizarre, seems like they'd be exchanging > in dallas. > > 2. cpe-69-132-132-1.carolina.res.rr.com 0.0% 2612 13.3 16.8 > 3.3 79.3 8.7 > 3. cpe-174-111-099-002.triad.res.rr.com 0.0% 2612 20.1 17.3 > 4.1 122.2 7.5 > 4. chrlncnor-vis1.carolina.rr.com 0.0% 2612 7.5 15.0 > 2.7 72.2 6.3 > 5. 24.93.67.204 0.0% 2612 5.1 19.2 > 3.3 73.2 6.6 > 6. bu-ether11.atlngamq46w-bcr00.tbone.rr. 0.0% 2612 17.0 23.7 > 9.0 86.8 6.9 > 7. 0.ge-0-0-0.ar0.den30.tbone.rr.com 0.0% 2612 45.7 40.2 > 25.7 87.2 6.7 > 8. 0.ae3.pr1.dfw10.tbone.rr.com 0.0% 2612 38.6 40.0 > 25.4 90.9 6.4 > 9. 66.109.5.138 0.0% 2612 43.4 40.1 > 25.1 91.9 6.7 > 10. ge-1-3-0.a0.buf00.tbone.rr.com 0.0% 2612 49.3 39.7 > 23.8 153.5 12.5 > 11. 66.109.7.42 0.1% 2612 879.7 127.5 > 90.2 879.7 18.2 > 12. ae16.cs2.lga5.us.zip.zayo.com 13.0% 2612 201.0 195.4 > 181.1 247.1 7.2 > 13. ae4.cs2.dca2.us.eth.zayo.com 13.3% 2612 203.0 196.7 > 181.1 433.9 8.9 > 14. ae3.cs2.iah1.us.eth.zayo.com 14.6% 2611 197.1 192.4 > 176.7 244.8 7.6 > 15. ae5.cs2.dfw2.us.eth.zayo.com 13.1% 2611 190.7 195.0 > 179.8 245.8 7.3 > 16. ae1.mcs2.dfw2.us.eth.zayo.com 12.4% 2611 192.9 192.6 > 178.1 231.6 7.3 > 17. ae5.mpr2.dfw5.us.zip.zayo.com 13.4% 2611 191.2 190.9 > 176.9 247.8 6.8 > _______________________________________________ > Outages mailing list > Outages(a)outages.org > https://puck.nether.net/mailman/listinfo/outages > _______________________________________________ > Outages mailing list > Outages(a)outages.org > https://puck.nether.net/mailman/listinfo/outages ------------------------------ Message: 3 Date: Thu, 26 Mar 2020 11:19:59 -0500 From: Musee Ullah <systems(a)lae.is> To: outages(a)outages.org Subject: [outages] Google services/Youtube degradation Message-ID: <c839f709-71f0-3b59-2ee0-652348dffa9d(a)lae.is> Content-Type: text/plain; charset=utf-8 I'm seeing a lot of reports on Twitter and elsewhere over the past hour that live streams on the Youtube platform are not functioning and indeed they are not. Video on demand appears to be fine. Other Google owned products (Docs, etc) appear to be suffering as well: https://twitter.com/gsuite/status/1243208675487072259 ------------------------------ Message: 4 Date: Thu, 26 Mar 2020 12:27:52 -0400 From: Matt Zaglin <mzaglin(a)thomasnet.com> To: outages(a)outages.org Subject: Re: [outages] Google services/Youtube degradation Message-ID: <CAHZcqtF84OwZ_MF19OwnXM+mfsE8xpY+j-_Gi6m9bSiVpJr-hA(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" Google has acknowledged the problem, and is actively investigating: https://www.google.com/appsstatus#hl=en&v=status Thank you, Matthew Zaglin -- *Matthew Zaglin* IT Infrastructure & Operations Manager | Thomas Thomasnet.com <https://www.thomasnet.com> | #ThomasForIndustry <https://www.thomasnet.com> <https://www.thomasnet.com>[image: Thomas For Industry] <https://www.thomasnet.com> On Thu, Mar 26, 2020 at 12:25 PM Musee Ullah via Outages < outages(a)outages.org> wrote: > I'm seeing a lot of reports on Twitter and elsewhere over the past > hour that live streams on the Youtube platform are not functioning and > indeed they are not. Video on demand appears to be fine. > > Other Google owned products (Docs, etc) appear to be suffering as well: > > https://twitter.com/gsuite/status/1243208675487072259 > > _______________________________________________ > Outages mailing list > Outages(a)outages.org > https://puck.nether.net/mailman/listinfo/outages >

1 0

Spectrum <-> Zayo Packet Loss / RTT
by Shawn Solomon 24 Mar '20

24 Mar '20

Fyi, I am seeing high rtt and pl on a spectrum / zayo interconnect. Also, the path seems pretty bizarre, seems like they'd be exchanging in dallas. 2. cpe-69-132-132-1.carolina.res.rr.com 0.0% 2612 13.3 16.8 3.3 79.3 8.7 3. cpe-174-111-099-002.triad.res.rr.com 0.0% 2612 20.1 17.3 4.1 122.2 7.5 4. chrlncnor-vis1.carolina.rr.com 0.0% 2612 7.5 15.0 2.7 72.2 6.3 5. 24.93.67.204 0.0% 2612 5.1 19.2 3.3 73.2 6.6 6. bu-ether11.atlngamq46w-bcr00.tbone.rr. 0.0% 2612 17.0 23.7 9.0 86.8 6.9 7. 0.ge-0-0-0.ar0.den30.tbone.rr.com 0.0% 2612 45.7 40.2 25.7 87.2 6.7 8. 0.ae3.pr1.dfw10.tbone.rr.com 0.0% 2612 38.6 40.0 25.4 90.9 6.4 9. 66.109.5.138 0.0% 2612 43.4 40.1 25.1 91.9 6.7 10. ge-1-3-0.a0.buf00.tbone.rr.com 0.0% 2612 49.3 39.7 23.8 153.5 12.5 11. 66.109.7.42 0.1% 2612 879.7 127.5 90.2 879.7 18.2 12. ae16.cs2.lga5.us.zip.zayo.com 13.0% 2612 201.0 195.4 181.1 247.1 7.2 13. ae4.cs2.dca2.us.eth.zayo.com 13.3% 2612 203.0 196.7 181.1 433.9 8.9 14. ae3.cs2.iah1.us.eth.zayo.com 14.6% 2611 197.1 192.4 176.7 244.8 7.6 15. ae5.cs2.dfw2.us.eth.zayo.com 13.1% 2611 190.7 195.0 179.8 245.8 7.3 16. ae1.mcs2.dfw2.us.eth.zayo.com 12.4% 2611 192.9 192.6 178.1 231.6 7.3 17. ae5.mpr2.dfw5.us.zip.zayo.com 13.4% 2611 191.2 190.9 176.9 247.8 6.8

2 2