January 2020 - Outages - Outages Lists

FiOS issue in NYC Area?
by Izzy Goldstein - TeleGo 16 Feb '21

16 Feb '21

Many of our clients who are using fios are reporting issues with their voip phones when i switch them to their backup ISP (Optimum etc) it works fine anyone else experiencing any fios issues ? -- Izzy Goldstein Chief Technology Officer Main: (212) 477-1000 x 2085 <(212)%20477-1000> Direct: (929) 477-2085 Website: www.telego.com <http://www.telego.net/> <http://www.telego.com/> Confidentiality Notice: This e-mail may contain confidential and/or privileged information. If you are not the intended recipient or have received this e-mail in error please notify us immediately by email reply and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. Any views or opinions presented in this email are solely those of the author and do not necessarily represent those of TeleGo (T). Employees of TeleGo are expressly required not to make defamatory statements and not to infringe or authorize any infringement of copyright or any other legal right by email communications. Any such communication is contrary to TeleGo policy and outside the scope of the employment of the individual concerned. TeleGo will not accept any liability in respect of such communication, and the employee responsible will be personally liable for any damages or other liability arising. TeleGo Hosted PBX <https://youtu.be/DaT8YAZ4V0w>

7 18

CenturyLink (Fiber+) - Orlando, FL
by Wyn Bryant 31 Jan '20

31 Jan '20

Multiple CenturyLink Fiber+ circuits down throughout Orlando metro area, ack by carrier. 01/31/2020 20:52:57 GMT - Field Operations have arrived on site and are investigating the issue. 01/31/2020 20:13:27 GMT - Field Operations will arrive on site shortly. 01/31/2020 19:22:12 GMT - The IP NOC suspects an equipment issue and was unable to successfully remotely restart the equipment. Field Operations has been engaged and dispatched to the fault location with an estimated time of arrival (ETA) of 20:30 GMT. 01/31/2020 18:34:53 GMT - **Correction This impact is located in Orlando, FL, not in Charlotte, NC as previously stated.

1 0

Google Docs down
by Kenneth Padgett 27 Jan '20

27 Jan '20

Getting "Our systems have detected unusual traffic from your computer network. Please try your request again later." trying to open docs/sheets. Not on Google's official status dashboard yet, but a couple reddit posts already confirming: https://www.reddit.com/r/sysadmin/comments/eurzs1/g_suitegoogle_docs_and_sh… https://www.reddit.com/r/sysadmin/comments/eury6g/gsuite_slowness/ No confirmation replies needed, thanks! KP

4 4

Seemingly Nationwide Comcast DNS Outage
by Christopher Trudeau 23 Jan '20

23 Jan '20

Seeing many recent reports on the interwebs regarding a "nationwide Comcast outage". Looks like it's an issue with Comcast DNS (75.75.75.75 / 75.75.76.76) and not anything else, as queries to other public DNS servers (ex: 1.1.1.1 / 8.8.8.8) work just fine over my Comcast service. For reference, I'm located in Chicago, but I did perform NSLookup's from a box in NYC, Dallas, and Seattle which resulted in similar behavior as seen below. nslookup google.com 75.75.75.75 Server: UnKnown Address: 75.75.75.75 *** UnKnown can't find google.com: Query refused nslookup google.com 75.75.76.76 Server: UnKnown Address: 75.75.76.76 *** UnKnown can't find google.com: Query refused nslookup google.com 1.1.1.1 Server: one.one.one.one Address: 1.1.1.1 Non-authoritative answer: Name: google.com Addresses: 2607:f8b0:4009:812::200e 172.217.5.14 nslookup google.com 8.8.8.8 Server: dns.google Address: 8.8.8.8 Non-authoritative answer: Name: google.com Addresses: 2607:f8b0:4009:80f::200e 216.58.192.238 ________________________________ CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you.

4 3

Dyn DNS API Outage
by Rob Whitlatch 23 Jan '20

23 Jan '20

The Dyn / Oracle DNS API is having a major outage. https://www.dynstatus.com/ Rob Whitlatch *Director of DevOps* White Label Communications o: 215-987-4500 f: 215-987-4499 a: 710 Springdale Drive Exton, Pennsylvania 19341 e: rwhitlatch(a)whitelabelcomm.com w: www.whitelabelcomm.com <http://wlc.cc/> <http://wlc.cc/> <http://lnk.wlc.cc/2fqWD44> <http://lnk.wlc.cc/1xz4WNb> <http://lnk.wlc.cc/2fr3zyb> <http://lnk.wlc.cc/googleWLC> <http://lnk.wlc.cc/2fF3HI1>

1 0

Pilot fiber down in midtown Manhattan
by Anthony Oren 20 Jan '20

20 Jan '20

They sent a maintenance email stating they would do maintenance work tonight at 11pm but right now they are down completely in midtown NYC and I’ve been on hold for over 40 minutes to no avail. Anyone else seeing this or have info on how to check status? (Can’t find them even listed at DownDetector). Anthony -- Anthony Oren *Nero Consulting Inc.* C: 347-699-6376 O: 888-212-5307 Is your company ready for New York State's Cyber Security Regulations? *www.nero-consulting.com <http://www.nero-consulting.com> * *Trusted+Technology+Partner* Notice: The information contained in this email is CONFIDENTIAL and intended only for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution, or copy of this communication is strictly PROHIBITED and will be considered a tortuous interference in our confidential business relationships. Additionally, unauthorized dissemination of this confidential information subjects you to criminal and civil penalties. If you have received this communication in error, please notify us immediately by email, and delete the original message.

3 2

AccessOne Inc/Google issues Chicago
by Dustin Sneath 18 Jan '20

18 Jan '20

Unable to reach *any* Google services using MPLS and DIA from AccessOne Inc (AS36498) via AT&T fiber. Ticket is now open (#513000). Dustin Sneath Superintendent of I.T. Elk Grove Park District 224-800-2146

1 0

Akamai Geolocation Concerns
by Dan White 17 Jan '20

17 Jan '20

We are seeing some geolocation oddities with a couple of websites hosted at, or resolved by, Akamai. Two hostnames I'm looking at include: business.officedepot.com www.teacherspayteachers.com 'A' records for both have a TTL of 20 seconds, and randomly resolve to IPs in the US, and Europe (we are in the US/Oklahoma). For example, business.officedepot.com is resolving to both 96.17.32.230 and 88.221.37.87 (at different times). I've verified the same inconsistent behavior against 8.8.8.8 and 1.1.1.1. This is causing issues for an educational customer of ours. Is anyone aware of issues within Akamai that may be causing them to source content from Europe? -- Dan White BTC Broadband Network Admin Lead Ph 918.366.0248 (direct) main: (918)366-8000 Fax 918.366.6610 email: dwhite(a)mybtc.com http://www.btcbroadband.com

4 5

Intermittent internet issues in NYC area? (Verizon/Cogent)
by Andrew Bunde 15 Jan '20

15 Jan '20

Anyone else seeing intermittent problems like random destinations not loading/partially loading today? Seems mostly related to anything http/ssl relate, haven't had complaints for any other services. No signs of issue at our edge/dmz. Time of issue seems to correlate to https://downdetector.com/status/reddit/ , maybe some CDN or DDOS issue somewhere...

2 1

Global Root Hints (DNS)
by Bruce Freshwater 10 Jan '20

10 Jan '20

Anyone seeing any major latencies? Regards, Bruce Freshwater Direct: 412.722.1701 Mobile: 412.292.0282 Main: 866.707.5869 Fax: 412.774.2469 Email: BFreshwater(a)SierraExperts.com<mailto:BFreshwater@SierraExperts.com> Request Help: Support Portal (SIM)<sim.sierraincidentmanager.com> Sierra Experts [cid:image002.jpg@01D1C645.CF870330] 2 Robinson Plaza, Suite 300, Pittsburgh, PA 15205-1017 Our Services: Managed Services<http://www.sierraexperts.com/managed-services/> | Development & Design<http://www.sierraexperts.com/development-and-design/> | Telephony & VoIP<http://www.sierraexperts.com/telephony-and-voip/> | Hardware & Software<http://www.sierraexperts.com/hardware-and-software/> | Data Center<http://sierradatacenters.com/> Stay Connected: Website<http://www.sierraexperts.com/> | Awards<http://www.sierraexperts.com/about-us/awards/> | Facebook<https://www.facebook.com/SierraExperts> | Twitter<https://twitter.com/sierraexperts> | LinkedIn<https://www.linkedin.com/company/sierraexperts> | Blog<http://www.sierraexperts.com/about-us/blog/> [cid:image001.png@01D573C1.8B84DB80]

2 2