March 2017 - Outages - Outages Lists

Google DNS in Atlanta Market Slow or timing out
by Erik Sundberg 03 Apr '17

03 Apr '17

Anyone else seeing issues with Google DNS (8.8.8.8) in the Atlanta Market? We have customer's calling in reporting slow or timing out DNS requests. Yes I know this is DNS anycast and have narrowed it down only to the Atlanta Market for traffic going over the Atlant Telx Internet Exchange. Popular websites that are cached like google, amazon, and yahoo seem fine. LinuxBox# dig +trace -t mx cnn.com @8.8.8.8 ; <<>> DiG 9.8.2rc1-RedHat-9.8.2-0.37.rc1.el6_7.7 <<>> +trace -t mx cnn.com @8.8.8.8 ;; global options: +cmd ;; connection timed out; no servers could be reached LinuxBox# dig +trace -t mx cltv.com @8.8.8.8 ; <<>> DiG 9.8.2rc1-RedHat-9.8.2-0.37.rc1.el6_7.7 <<>> +trace -t mx cltv.com @8.8.8.8 ;; global options: +cmd ;; connection timed out; no servers could be reached LinuxBox# ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8) 56(84) bytes of data. 64 bytes from 8.8.8.8: icmp_seq=1 ttl=49 time=0.962 ms 64 bytes from 8.8.8.8: icmp_seq=2 ttl=49 time=1.01 ms 64 bytes from 8.8.8.8: icmp_seq=3 ttl=49 time=0.981 ms 64 bytes from 8.8.8.8: icmp_seq=4 ttl=49 time=1.00 ms 64 bytes from 8.8.8.8: icmp_seq=5 ttl=49 time=1.01 ms ^C --- 8.8.8.8 ping statistics --- 5 packets transmitted, 5 received, 0% packet loss, time 4542ms rtt min/avg/max/mdev = 0.962/0.995/1.015/0.035 ms LinuxBox# traceroute 8.8.8.8 traceroute to 8.8.8.8 (8.8.8.8), 30 hops max, 60 byte packets 1 g-0-0-22.ear1.atl1.nitelusa.net (64.191.93.205) 1.048 ms 1.108 ms 1.172 ms 2 te-0-7-1-0.ar1.atl1.nitelusa.net (207.200.195.221) 4.473 ms 4.479 ms 4.473 ms 3 te-0-7-0-0.ar2.atl1.nitelusa.net (207.200.195.202) 2.145 ms 2.138 ms 2.129 ms 4 aix.pr1.atl.google.com (198.32.132.41) 0.367 ms 0.377 ms 0.369 ms 5 209.85.243.11 (209.85.243.11) 1.052 ms 0.778 ms 209.85.242.249 (209.85.242.249) 0.510 ms 6 216.239.59.153 (216.239.59.153) 1.396 ms 72.14.233.119 (72.14.233.119) 1.171 ms 72.14.233.145 (72.14.233.145) 1.073 ms 7 209.85.142.157 (209.85.142.157) 0.980 ms 72.14.237.109 (72.14.237.109) 1.049 ms 72.14.237.155 (72.14.237.155) 0.990 ms 8 * * * 9 google-public-dns-a.google.com (8.8.8.8) 1.008 ms 1.011 ms 0.989 ms Erik Sundberg Sr. Network Engineering Network Engineering Department p: 773.661.5532 c: 708.710.7419 e: esundberg(a)nitelusa.com Main: 888.450.2100 NOC 24/7: 866.892.0915 1101 W. Lake Street, 6th Floor | Chicago, IL 60607 www.nitelusa.com<http://www.nitelusa.com/> [Nitel] Managed Telecom Services MPLS | Ethernet | Private Line | Internet | Voice | Security ________________________________ CONFIDENTIALITY NOTICE: This e-mail transmission, and any documents, files or previous e-mail messages attached to it may contain confidential information that is legally privileged. If you are not the intended recipient, or a person responsible for delivering it to the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of any of the information contained in or attached to this transmission is STRICTLY PROHIBITED. If you have received this transmission in error please notify the sender immediately by replying to this e-mail. You must destroy the original transmission and its attachments without reading or saving in any manner. Thank you.

2 1

Dreamhost issues
by Scott Whyte 30 Mar '17

30 Mar '17

Dreamhost is having some widespread problems this morning https://www.dreamhoststatus.com/

3 2

Level3 Voice in Houston down?
by Warren, David 29 Mar '17

29 Mar '17

We lost all our PRIs in our Houston, TX office. Anybody else having problems? I am opening a ticket now with Level3. David Warren, Systems Engineer Winstead PC | 500 Winstead Building | 2728 N. Harwood Street | Dallas, Texas 75201 214.745.5778 (Office) | 214.745.5390 (Fax) | dwarren(a)winstead.com<mailto:dwarren@winstead.com> | www.winstead.com<http://www.winstead.com/> ________________________________ Information contained in this transmission is attorney privileged and confidential. It is intended for the use of the individual or entity named above. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copy of this communication is strictly prohibited. If you have received this communication in error, please immediately notify us by telephone. --

1 0

CableOne DNS issue?
by frnkblk＠iname.com 24 Mar '17

24 Mar '17

Was just alerted that our outbound email queues have a few messages to cableone.net queued up, because there's no MX record (even Google and OpenDNS don't have an MX record cached). DNSInspect (http://www.dnsinspect.com/cableone.net/10059114) is showing that their two nameservers aren't resolving their A record. DownDetector is reporting issues: http://downdetector.com/status/cable-one There's also few posts on Twitter, too: https://twitter.com/lucky_boym/status/845441576973295616 https://twitter.com/AnonySerb/status/845441954599092224 And just now posted, from CableONE: https://twitter.com/cableONE/status/845460682560688128 Frank

1 0

[US] DNS issue
by Charles D'Aoust 24 Mar '17

24 Mar '17

We've seen spikes in resolution times during the afternoon on all of our recursive DNS (everywhere in the country) for about 10 minutes this afternoon. The issue resolved itself before I could see anything wrong. Can anybody confirm seeing such an outage/slowness? This event occurred between 15:00 and 15:30 EDT. --- Charles D’Aoust

3 2

Google DNS - West Coast
by Ben Burns 23 Mar '17

23 Mar '17

Anyone else experiencing Google DNS issues on the West Coast US? We are seeing intermittent failed lookups from multiple DCs across the West Coast US.

1 0

Seeing something funky on Telia
by Eric Tykwinski 23 Mar '17

23 Mar '17

I’m running a couple of servers on OVH, and noticed some weird issues on Verizon. Looks like Telia is having some routing issues from the looking glass: 3 be100-154.nwk-5-a9.nj.us (192.99.146.38) 3.327 ms 2.985 ms 3.015 ms 4 be100-1298.ldn-5-a9.uk.eu (192.99.146.132) [AS 16276 <http://apps.db.ripe.net/search/query.html?searchtext=AS16276>] 71.274 ms 71.828 ms 71.631 ms 5 gblx.as3549.ny.us (213.251.130.102) [AS 16276 <http://apps.db.ripe.net/search/query.html?searchtext=AS16276>] 75.864 ms 76.561 ms 76.423 ms Sincerely, Eric Tykwinski TrueNet, Inc. P: 610-429-8300

2 2

Frontier FiOS issues anyone?
by Neil Ticktin 23 Mar '17

23 Mar '17

Hi all, Anyone seeing issues with Frontier FiOS (we're in Southern California) where www.google.com works, but most other sites, including Apple, FedEx, and our own sites, do not come up? We're getting a web page that just says: Not Found Url not found: / for basically every site (including Frontier's btw). Pings and traceroutes work fine. DNS resolves. I either need more coffee, or something is going on. Anyone seeing any issues? Thanks! Neil

2 2

Allstream / Zayo issues in Montreal
by Stephen Fulton 22 Mar '17

22 Mar '17

We've been having issues with transit from Allstream / Zayo in Montreal starting about 16:45 EDT, continuing until now. Physical port will drop for multiple minutes then return. I have no reports of transport services being affected. -- Stephen

1 0

USA Communications Nebraska telco outage
by Ryan McGinnis 22 Mar '17

22 Mar '17

USA Communications in Nebraska appears to be having a total telco outage. Internet services are not affected, but all inbound calls to numbers serviced by the provider ring to the failover (Cellular) numbers customers have set up, and all outbound lines are dead. So far have confirmed this is affecting customers in Kearney and Lexington, Nebraska, but it likely affects anyone they are servicing in Nebraska. -- -Ryan McGinnis Platte Valley Communications Minilock ID: E1RYjV5VFoDRXkXPYB92L5eoHWebeHfVHJkfoZiquHC4W

1 1