September 2020 - Outages

FiOS issue in NYC Area?
by Izzy Goldstein - TeleGo 16 Feb '21

16 Feb '21

Many of our clients who are using fios are reporting issues with their voip phones when i switch them to their backup ISP (Optimum etc) it works fine anyone else experiencing any fios issues ? -- Izzy Goldstein Chief Technology Officer Main: (212) 477-1000 x 2085 <(212)%20477-1000> Direct: (929) 477-2085 Website: www.telego.com <http://www.telego.net/> <http://www.telego.com/> Confidentiality Notice: This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error please notify us immediately by email reply and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of TeleGo (T). Employees of TeleGo are expressly required not to make defamatory statements and not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to TeleGo policy and outside the scope of the employment of the individual concerned. TeleGo will not accept any liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising. TeleGo Hosted PBX <https://youtu.be/DaT8YAZ4V0w>

7 18

Nationwide Comcast outages due to botched firmware upgrade
by Cary Wiedemann 30 Sep '20

30 Sep '20

If you noticed your Comcast sites all over the country were down last night it was due to a botched firmware upgrade pushed to many Cisco modems. Comcast Business uses Cisco DPC3941B modems in many regions and these were particularly affected. Comcast can't reboot these modems remotely anymore. They all need to be physically power cycled and will downgrade their firmware to an operational version during the boot process. I've had modems impacted from coast to coast, but not in every region. The first wave of outages began yesterday 9/30 at 5:47pm EDT, but many other sites didn't experience their first outage until well after midnight. Just an FYI if anyone else saw their branch networks in shambles this morning. The Comcast master "service incident" number is: SI045791942 - Cary

1 0

Apple services down
by Kenneth Padgett 29 Sep '20

29 Sep '20

Apple is having an services outage since about 8pm EST and most effecting us is the App Store outage which has caused LOB apps to fail to authenticate their subscriptions, so they’re reporting unlicensed. “Error 0” 🤦‍♂️ https://www.apple.com/support/systemstatus/ KP

1 0

Slack down?
by Ivan Kovacevic 29 Sep '20

29 Sep '20

Few users reporting they cannot log in and sluggishness for users who are logged in <http://www.startelecom.ca> *Ivan Kovacevic* *Co-Founder and VP Client Services* *STAR TELECOM* -- NOTE: This email message and any attachments are for the sole use of the intended recipient(s) and may contain confidential and/or privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by replying to this email, and destroy all copies of the original message.

2 2

MN/CL 911 outage
by Jay Ashworth 28 Sep '20

28 Sep '20

In what I've heard incorrectly dubbed a nationwide outage, CenturyLink in and around Minnesota apparently had a wide area 911 outage of some type. If anybody has any specific details, it would be great to hear them, because this attached news story is pretty mediocre, as you'd expect. Cheers, -- jra -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

1 0

Office 365 outlook makes the news
by Jay Ashworth 28 Sep '20

28 Sep '20

Oops: https://www.zdnet.com/article/office-365-outage-ongoing-after-roll-back-fai… -- Sent from my Android device with K-9 Mail. Please excuse my brevity.

3 2

flightradar24.com down as of 1:55 CDT
by Andy Ringsmuth 28 Sep '20

28 Sep '20

downforeveryoneorjustme.com shows them down. Unreachable via the web. Mobile app mostly non-functional as well. For people who have their own receiver set up to send data to them, they seem to work fine which makes sense as it is a local device. Cloudflare Error 522 when trying to access their site, saying “Host Error." They are the largest, or one of the largest, flight tracking sites globally. ---- Andy Ringsmuth 5609 Harding Drive Lincoln, NE 68521-5831 (402) 304-0083 andy(a)andyring.com “Better even die free, than to live slaves.” - Frederick Douglas, 1863

3 3

Outlook issues
by Brah Man 28 Sep '20

28 Sep '20

Yes, I can't authenticate to Azure portal or any O365 service. Everything else in Azure is running, it seems to hang on the authentication portal. Thanks, Matt On Mon, Sep 28, 2020 at 5:02 PM <outages-request(a)outages.org> wrote: > Send Outages mailing list submissions to > outages(a)outages.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://puck.nether.net/mailman/listinfo/outages > or, via email, send a message with subject or body 'help' to > outages-request(a)outages.org > > You can reach the person managing the list at > outages-owner(a)outages.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Outages digest..." > > > Today's Topics: > > 1. Re: Zayo fiber cut in Herndon, VA (Ross Tajvar) > 2. flightradar24.com down as of 1:55 CDT (Andy Ringsmuth) > 3. Re: flightradar24.com down as of 1:55 CDT (Joly MacFie) > 4. Outlook issues (Jason Kuehl) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 18 Sep 2020 12:20:54 -0400 > From: Ross Tajvar <ross(a)tajvar.io> > To: OUTAGES Mailing List <outages(a)outages.org> > Subject: Re: [outages] Zayo fiber cut in Herndon, VA > Message-ID: > < > CA+FDdDRU2Cnv_pyRijYRYzgHLM9sPOXmjU_jt6GcjUqstEt1hg(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > I skipped some updates but here's the most recent oneL > *Fri Sep 18 15:07:10 GMT 2020* > Current Update:All repairs have been completed, we are calling Dark fiber > customers now to verify services are restored. once confirmed we will > notify you when crews are hands-off > > On Thu, Sep 17, 2020 at 11:37 PM Ross Tajvar <ross(a)tajvar.io> wrote: > > > Fri Sep 18 03:18:07 GMT 2020 > > Current Update: > > OSP has completed the conduit repair and is proofing it now. The crew > will > > begin to pull cable shortly and begin to splice after the pulling is > > completed. > > > > On Thu, Sep 17, 2020, 9:41 PM Ross Tajvar <ross(a)tajvar.io> wrote: > > > >> CASE UPDATES > >> Fri Sep 18 01:20:30 GMT 2020 > >> All conduit has been exposed. They are working to repair the damaged > >> sections now. > >> > >> Fri Sep 18 00:27:43 GMT 2020 > >> Current Update: > >> The Crew has exposed one end of the damage and proofed about 500'. They > >> are digging the asphalt bike trail to get to the other end of the > damage. > >> Estimate about 2 hrs before the conduit is ready. > >> > >> On Thu, Sep 17, 2020, 4:36 PM Ross Tajvar <ross(a)tajvar.io> wrote: > >> > >>> *Zayo NOC** on **2020-09-17* > >>> Current Update:Our OSP crew has arrived Onsite at the second location > >>> (Fair Lakes Parkway & Rippling Pond in Fairfax.) The damage was caused > by > >>> construction, our crews will have to replace1500 feet of 864 and 432 ct > >>> fiber. We are expecting the repair to take approx 18 hours to complete. > >>> > >>> > >>> On Thu, Sep 17, 2020 at 3:39 PM Ross Tajvar <ross(a)tajvar.io> wrote: > >>> > >>>> *Thu Sep 17 18:27:03 GMT 2020* > >>>> Current Update:OSP crews are still on-site removing debris to expose > >>>> the damaged fiber. crews are taking caution as to not cause injury to > >>>> themselves or make further damages on the fibers below, there is no > ETR at > >>>> this time. > >>>> > >>>> *Thu Sep 17 19:31:36 GMT 2020* > >>>> Current Update:Our teams have worked to pull away the debris within > >>>> the handhold structure and did not identify that are cables were > damaged > >>>> there as we initially expected.We now have crews en route to a second > >>>> location where our utility locating crews have identified a cable > strike. > >>>> The location of this damage is at Fairlakes Pkwy and Ripling Pond Dr. > >>>> Construction and splicers are headed to this location now to assess > the > >>>> damage. We know this is an 864 ct cable at this location. Will have > more > >>>> details on the amount of damage once our crews arrive on site. > >>>> > >>>> On Thu, Sep 17, 2020 at 1:26 PM Ross Tajvar <ross(a)tajvar.io> wrote: > >>>> > >>>>> We have some waves impacted. > >>>>> > >>>>> Latest update from Zayo: > >>>>> > >>>>> *Zayo NOC** on **2020-09-17* > >>>>> Current Update:Our OSP crews have arrived on the location where the > >>>>> lid to a vault has collapsed in Herndon, VA. > >>>>> The damage was caused by a Semi trailer crashing into our vault > >>>>> crushing all-fiber splice cases. at this time we are approximating > an 864 > >>>>> fiber count damaged.We are currently removing the debris to assess > >>>>> the extent of damage and to work towards a plan of repair, no ETR at > this > >>>>> time. > >>>>> > >>>>> > >>>>> >

3 2

Re: [outages] Outlook issues (John Schiel)
by Brah Man 28 Sep '20

28 Sep '20

Hey John, The status page reads only Green (Good) for everything but Down detector is starting to show some reports for everywhere: https://downdetector.com/status/windows-azure/map/ Thanks, Matt On Mon, Sep 28, 2020 at 5:06 PM <outages-request(a)outages.org> wrote: > Send Outages mailing list submissions to > outages(a)outages.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://puck.nether.net/mailman/listinfo/outages > or, via email, send a message with subject or body 'help' to > outages-request(a)outages.org > > You can reach the person managing the list at > outages-owner(a)outages.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Outages digest..." > > > Today's Topics: > > 1. Re: Outlook issues (John Schiel) > 2. Outlook issues (Brah Man) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 28 Sep 2020 16:06:01 -0600 > From: John Schiel <jschiel(a)flowtools.net> > To: outages(a)outages.org > Subject: Re: [outages] Outlook issues > Message-ID: <6ac72ef3-4d21-22bd-2886-77db0b982950(a)flowtools.net> > Content-Type: text/plain; charset="utf-8"; Format="flowed" > > Yes. > > https://status.azure.com/en-us/status > > --John > > On 9/28/20 4:00 PM, Jason Kuehl via Outages wrote: > > Anyone else having issues?with this? > > > > Unable to login to outlook mail or office 365. > > > > _______________________________________________ > > Outages mailing list > > Outages(a)outages.org > > https://puck.nether.net/mailman/listinfo/outages > >

2 1

Azure including Authenticator and Government outage
by Anthony Hook 28 Sep '20

28 Sep '20

The Azure Portal, including Microsoft Authenticator, and Azure Government are experiencing some kind of outage not reflected in their service status pages yet. Sorry so vague, it's all I have at the moment. - Anthony Hook

1 0