December 2013 - Outages - Outages Lists

Re: [outages] Bluehost.com outage
by Bryan Inks 03 Jan '14

03 Jan '14

Just in case my ASSP modification to the subject caused a rejection.... Frank, I confirmed with some mates of mine that still work at Bluehost. They're saying it's not just outside DNS that is failing. VPN, etc., is down as well. -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Frank Bulk Sent: Tuesday, December 31, 2013 11:32 AM To: outages(a)outages.org Subject: [SPAM] [outages] Bluehost.com outage We have one customer whose domain is on Bluehost and we can't find their MX record. The two DNS servers, ns1.bluehost.com and ns2.bluehost.com, are not responding on TCP port 53. Twitter jabber confirms an issue. Frank _______________________________________________ Outages mailing list Outages(a)outages.org https://puck.nether.net/mailman/listinfo/outages

3 6

Re: [outages] Possible Issues with Level3 - Confirmed Chicago Area, possibly others
by Bryan Inks 03 Jan '14

03 Jan '14

We're now seeing 20% packet loss and 200+ms latency. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Bryan Inks Sent: Tuesday, December 31, 2013 8:25 AM To: outages(a)outages.org Subject: [outages] Possible Issues with Level3 - Confirmed Chicago Area, possibly others Just received a call from a client here in CA. They are seeing bi-directional issues with Level3 in the Chicago area. Approximately 7% packet loss and 70+ms latency.

8 10

Bluehost.com outage
by Frank Bulk 31 Dec '13

31 Dec '13

We have one customer whose domain is on Bluehost and we can't find their MX record. The two DNS servers, ns1.bluehost.com and ns2.bluehost.com, are not responding on TCP port 53. Twitter jabber confirms an issue. Frank

7 7

Re: [outages] HostGator issues?
by Bryan Inks 31 Dec '13

31 Dec '13

The parent company moved HostGator into the BlueHost/HostMonster/FastDomain DC in Provo, UT. Don't know if you saw my conversation with Frank, but the network there (internal included) is currently down. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Neil Ticktin Sent: Tuesday, December 31, 2013 11:07 AM To: outages Subject: [SPAM] [outages] HostGator issues? Anyone seeing issues with HostGator? It appears that they may be having serious problems affecting client servers and even the HostGator phones to find out more. Thanks! Neil

1 0

Re: [outages] Bluehost.com outage
by Bryan Inks 31 Dec '13

31 Dec '13

Update from my L3 friend. Their internal network is down. They are currently trying to reach a senior admin to resolve the issue. I won't get full details until my friends get in. -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Frank Bulk Sent: Tuesday, December 31, 2013 11:32 AM To: outages(a)outages.org Subject: [SPAM] [outages] Bluehost.com outage We have one customer whose domain is on Bluehost and we can't find their MX record. The two DNS servers, ns1.bluehost.com and ns2.bluehost.com, are not responding on TCP port 53. Twitter jabber confirms an issue. Frank _______________________________________________ Outages mailing list Outages(a)outages.org https://puck.nether.net/mailman/listinfo/outages

1 0

HostGator issues?
by Neil Ticktin 31 Dec '13

31 Dec '13

Anyone seeing issues with HostGator? It appears that they may be having serious problems affecting client servers and even the HostGator phones to find out more. Thanks! Neil

2 1

CenturyLink packet loss in Chicago?
by Radde, Darrin 31 Dec '13

31 Dec '13

Seeing packet loss from Verizon circuits to destinations in Chicago. All starts at CL's router 67.14.8.90 (cer-edge-17.inet.qwest.net<http://cer-edge-17.inet.qwest.net>). Anyone else seeing CL issues in Chicago? D This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by e-mail and delete the message and any attachments from your system.

1 0

Possible Issues with Level3 - Confirmed Chicago Area, possibly others
by Bryan Inks 31 Dec '13

31 Dec '13

Just received a call from a client here in CA. They are seeing bi-directional issues with Level3 in the Chicago area. Approximately 7% packet loss and 70+ms latency.

1 0

Re: [outages] AT&T "over saturation" Southwest USA
by Bryan Inks 30 Dec '13

30 Dec '13

Update 1:13pm Pacific Traffic appears to be normalizing across the area. I'm seeing 50-100ms and no drops at this moment on affected nodes. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Bryan Inks Sent: Monday, December 30, 2013 12:48 PM To: Mike Hale; Michael Cannon Cc: outages(a)outages.org Subject: Re: [outages] AT&T "over saturation" Southwest USA My internal testing doesn't show that. I just received word from Internap that they are the target of a DDoS as well. I'm still seeing the same symptoms as reported across all of my upstream providers that hit the ATT network. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mike Hale Sent: Monday, December 30, 2013 12:42 PM To: Michael Cannon Cc: outages(a)outages.org<mailto:outages@outages.org> Subject: Re: [outages] AT&T "over saturation" Southwest USA We were told by our provider that it was a Ddos as well. They said it was mitigated as of about thirty minutes ago. On Dec 30, 2013 11:20 AM, "Michael Cannon" <m.cannon9802(a)gmail.com<mailto:m.cannon9802@gmail.com>> wrote: Passing along the good word from /r/networking "For anyone in the southwest US (specifically anything that goes through southern California, ATT is experiencing an "over saturation" on their network. It appears to be affecting every handoff in the area. Problem nodes: 12.122.x.x Symptoms include dropped packets and 400+ms latency. Internap, Cogent, and Level3 have confirmed tickets opened with ATT NOC. Update: ATT reports it as a DDoS attack that is causing the issue. They are working to mitigate." http://www.reddit.com/r/networking/comments/1u12y9/att_over_saturation_repo… I'm outside the affected area so I don't have anything technical to add and wasn't sure if appropriate for me to notify the list. _______________________________________________ Outages mailing list Outages(a)outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

3 2

AT&T "over saturation" Southwest USA
by Michael Cannon 30 Dec '13

30 Dec '13

Passing along the good word from /r/networking "For anyone in the southwest US (specifically anything that goes through southern California, ATT is experiencing an "over saturation" on their network. It appears to be affecting every handoff in the area. Problem nodes: 12.122.x.x Symptoms include dropped packets and 400+ms latency. Internap, Cogent, and Level3 have confirmed tickets opened with ATT NOC. Update: ATT reports it as a DDoS attack that is causing the issue. They are working to mitigate." http://www.reddit.com/r/networking/comments/1u12y9/att_over_saturation_repo… I'm outside the affected area so I don't have anything technical to add and wasn't sure if appropriate for me to notify the list.

3 2