Re: [outages] AT&T "over saturation" Southwest USA

Update 1:13pm Pacific Traffic appears to be normalizing across the area. I'm seeing 50-100ms and no drops at this moment on affected nodes. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Bryan Inks Sent: Monday, December 30, 2013 12:48 PM To: Mike Hale; Michael Cannon Cc: outages@outages.org Subject: Re: [outages] AT&T "over saturation" Southwest USA My internal testing doesn't show that. I just received word from Internap that they are the target of a DDoS as well. I'm still seeing the same symptoms as reported across all of my upstream providers that hit the ATT network. From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mike Hale Sent: Monday, December 30, 2013 12:42 PM To: Michael Cannon Cc: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] AT&T "over saturation" Southwest USA We were told by our provider that it was a Ddos as well. They said it was mitigated as of about thirty minutes ago. On Dec 30, 2013 11:20 AM, "Michael Cannon" <m.cannon9802@gmail.com<mailto:m.cannon9802@gmail.com>> wrote: Passing along the good word from /r/networking "For anyone in the southwest US (specifically anything that goes through southern California, ATT is experiencing an "over saturation" on their network. It appears to be affecting every handoff in the area. Problem nodes: 12.122.x.x Symptoms include dropped packets and 400+ms latency. Internap, Cogent, and Level3 have confirmed tickets opened with ATT NOC. Update: ATT reports it as a DDoS attack that is causing the issue. They are working to mitigate." http://www.reddit.com/r/networking/comments/1u12y9/att_over_saturation_repor... I'm outside the affected area so I don't have anything technical to add and wasn't sure if appropriate for me to notify the list. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

Yup. We got an email that another attack took place about 1230 and has been mitigated as well. On Dec 30, 2013 1:21 PM, "Bryan Inks" <Binks@keyinfo.com> wrote:
Update 1:13pm Pacific
Traffic appears to be normalizing across the area. I’m seeing 50-100ms and no drops at this moment on affected nodes.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Bryan Inks *Sent:* Monday, December 30, 2013 12:48 PM *To:* Mike Hale; Michael Cannon *Cc:* outages@outages.org *Subject:* Re: [outages] AT&T "over saturation" Southwest USA
My internal testing doesn’t show that.
I just received word from Internap that they are the target of a DDoS as well. I’m still seeing the same symptoms as reported across all of my upstream providers that hit the ATT network.
*From:* Outages [mailto:outages-bounces@outages.org<outages-bounces@outages.org>] *On Behalf Of *Mike Hale *Sent:* Monday, December 30, 2013 12:42 PM *To:* Michael Cannon *Cc:* outages@outages.org *Subject:* Re: [outages] AT&T "over saturation" Southwest USA
We were told by our provider that it was a Ddos as well. They said it was mitigated as of about thirty minutes ago.
On Dec 30, 2013 11:20 AM, "Michael Cannon" <m.cannon9802@gmail.com> wrote:
Passing along the good word from /r/networking
"For anyone in the southwest US (specifically anything that goes through southern California, ATT is experiencing an "over saturation" on their network.
It appears to be affecting every handoff in the area.
Problem nodes: 12.122.x.x
Symptoms include dropped packets and 400+ms latency.
Internap, Cogent, and Level3 have confirmed tickets opened with ATT NOC.
Update: ATT reports it as a DDoS attack that is causing the issue. They are working to mitigate."
http://www.reddit.com/r/networking/comments/1u12y9/att_over_saturation_repor...
I'm outside the affected area so I don't have anything technical to add and wasn't sure if appropriate for me to notify the list.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

At a guess i would say this is most likely the culprit. Stupid kids. http://kotaku.com/hackers-claim-takedown-of-battle-net-league-of-legends-149... --Damian On Tue, Dec 31, 2013 at 5:31 AM, Mike Hale <eyeronic.design@gmail.com>wrote:
Yup. We got an email that another attack took place about 1230 and has been mitigated as well. On Dec 30, 2013 1:21 PM, "Bryan Inks" <Binks@keyinfo.com> wrote:
Update 1:13pm Pacific
Traffic appears to be normalizing across the area. I’m seeing 50-100ms and no drops at this moment on affected nodes.
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Bryan Inks *Sent:* Monday, December 30, 2013 12:48 PM *To:* Mike Hale; Michael Cannon *Cc:* outages@outages.org *Subject:* Re: [outages] AT&T "over saturation" Southwest USA
My internal testing doesn’t show that.
I just received word from Internap that they are the target of a DDoS as well. I’m still seeing the same symptoms as reported across all of my upstream providers that hit the ATT network.
*From:* Outages [mailto:outages-bounces@outages.org<outages-bounces@outages.org>] *On Behalf Of *Mike Hale *Sent:* Monday, December 30, 2013 12:42 PM *To:* Michael Cannon *Cc:* outages@outages.org *Subject:* Re: [outages] AT&T "over saturation" Southwest USA
We were told by our provider that it was a Ddos as well. They said it was mitigated as of about thirty minutes ago.
On Dec 30, 2013 11:20 AM, "Michael Cannon" <m.cannon9802@gmail.com> wrote:
Passing along the good word from /r/networking
"For anyone in the southwest US (specifically anything that goes through southern California, ATT is experiencing an "over saturation" on their network.
It appears to be affecting every handoff in the area.
Problem nodes: 12.122.x.x
Symptoms include dropped packets and 400+ms latency.
Internap, Cogent, and Level3 have confirmed tickets opened with ATT NOC.
Update: ATT reports it as a DDoS attack that is causing the issue. They are working to mitigate."
http://www.reddit.com/r/networking/comments/1u12y9/att_over_saturation_repor...
I'm outside the affected area so I don't have anything technical to add and wasn't sure if appropriate for me to notify the list.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (3)
-
Bryan Inks
-
Damian Guppy
-
Mike Hale