Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California: $ dig @ns2.p34.dynect.net video.twimg.com ; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;video.twimg.com. IN A ;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33
Attack just re-started. Watch your flows. Help out if you can. -- TTFN, patrick
On Oct 21, 2016, at 12:12 PM, Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
$ dig @ns2.p34.dynect.net video.twimg.com
; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;video.twimg.com. IN A
;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Seems more widespread and affecting the backend of Dyn. The fact that I get SERVFAIL sometimes means their DNS answered - Just couldn't give me THE answer :) I've tested it from Ashburn, VA, Miami, FL, New York, NY and Chicao, IL. Chicago is the only one that worked. On Fri, Oct 21, 2016 at 9:13 AM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Attack just re-started.
Watch your flows. Help out if you can.
-- TTFN, patrick
On Oct 21, 2016, at 12:12 PM, Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
$ dig @ns2.p34.dynect.net video.twimg.com
; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;video.twimg.com. IN A
;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
On 10/21/16 09:12, Terry Hardie via Outages wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
I was able to access Twitter this morning and now it's dead. I'm west coast. twitter.com. 172800 IN NS ns1.p34.dynect.net. twitter.com. 172800 IN NS ns2.p34.dynect.net. twitter.com. 172800 IN NS ns3.p34.dynect.net. twitter.com. 172800 IN NS ns4.p34.dynect.net. Traceroutes seem to point towards San Jose or Palo Alto or Los Angeles. ~Seth
The attacks appear to be continuing again. We are experiencing issues in Europe/Asia. On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages < outages@outages.org> wrote: Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California: $ dig @ns2.p34.dynect.net video.twimg.com ; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;video.twimg.com. IN A ;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages -- KAYAK Neil Hanlon Devops Engineer +1 978 902 8171
Previously it was not affecting upper midwest for me, traces went to Chicago. Now traces to twitter DNS servers in Chicago are failing. ________________________________ From: Neil Hanlon via Outages [outages@outages.org] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org Subject: Re: [outages] Dyn outage continuing The attacks appear to be continuing again. We are experiencing issues in Europe/Asia. On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California: $ dig @ns2.p34.dynect.net<http://ns2.p34.dynect.net> video.twimg.com<http://video.twimg.com> ; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net<http://ns2.p34.dynect.net> video.twimg.com<http://video.twimg.com> ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;video.twimg.com<http://video.twimg.com>. IN A ;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- KAYAK Neil Hanlon Devops Engineer +1 978 902 8171
It's a shame services like PagerDuty use Dyn. Now they're down too... On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages <outages@outages.org> wrote:
Previously it was not affecting upper midwest for me, traces went to Chicago.
Now traces to twitter DNS servers in Chicago are failing.
________________________________ From: Neil Hanlon via Outages [outages@outages.org] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org Subject: Re: [outages] Dyn outage continuing
The attacks appear to be continuing again. We are experiencing issues in Europe/Asia.
On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
$ dig @ns2.p34.dynect.net video.twimg.com
; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;video.twimg.com. IN A
;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
KAYAK
Neil Hanlon
Devops Engineer
+1 978 902 8171
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
It is a shame in that PagerDuty is affected. However, Dyn is far, far better positioned to withstand attacks than a company like PagerDuty could possibly be on their own. So I think PagerDuty did the right thing in using Dyn. Remember, Twitter, Pingdom, github, and lots of other people use Dyn. And this is the first major outage I have heard of their service. Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. This is a serious attack, and the entire community should help track this miscreant down, then crush them like a bug. -- TTFN, patrick
On Oct 21, 2016, at 1:00 PM, Terry Hardie via Outages <outages@outages.org> wrote:
It's a shame services like PagerDuty use Dyn. Now they're down too...
On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages <outages@outages.org> wrote:
Previously it was not affecting upper midwest for me, traces went to Chicago.
Now traces to twitter DNS servers in Chicago are failing.
________________________________ From: Neil Hanlon via Outages [outages@outages.org] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org Subject: Re: [outages] Dyn outage continuing
The attacks appear to be continuing again. We are experiencing issues in Europe/Asia.
On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
$ dig @ns2.p34.dynect.net video.twimg.com
; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;video.twimg.com. IN A
;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
KAYAK
Neil Hanlon
Devops Engineer
+1 978 902 8171
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
This is just a horribly painful example of why we/they should all follow the route of NetFlix ( http://techblog.netflix.com/2013/05/denominating-multi-region-sites.html ) and use multiple DNS providers. Denominator ( https://github.com/Netflix/denominator ) the tool NetFlix uses for this and open-sourced, currently supports managing (mirrored) DNS records across AWS Route53, RackSpace CloudDNS, DynECT and UltraDNS. -Jason On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages < outages@outages.org> wrote:
It is a shame in that PagerDuty is affected.
However, Dyn is far, far better positioned to withstand attacks than a company like PagerDuty could possibly be on their own. So I think PagerDuty did the right thing in using Dyn.
Remember, Twitter, Pingdom, github, and lots of other people use Dyn. And this is the first major outage I have heard of their service.
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. This is a serious attack, and the entire community should help track this miscreant down, then crush them like a bug.
-- TTFN, patrick
On Oct 21, 2016, at 1:00 PM, Terry Hardie via Outages <outages@outages.org> wrote:
It's a shame services like PagerDuty use Dyn. Now they're down too...
On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages <outages@outages.org> wrote:
Previously it was not affecting upper midwest for me, traces went to Chicago.
Now traces to twitter DNS servers in Chicago are failing.
________________________________ From: Neil Hanlon via Outages [outages@outages.org] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org Subject: Re: [outages] Dyn outage continuing
The attacks appear to be continuing again. We are experiencing issues in Europe/Asia.
On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
$ dig @ns2.p34.dynect.net video.twimg.com
; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;video.twimg.com. IN A
;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
KAYAK
Neil Hanlon
Devops Engineer
+1 978 902 8171
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Don’t forget https://bit.namecoin.info/ From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Jason Antman via Outages Sent: Friday, October 21, 2016 1:25 PM Cc: outages@outages.org Subject: Re: [outages] Dyn outage continuing This is just a horribly painful example of why we/they should all follow the route of NetFlix ( http://techblog.netflix.com/2013/05/denominating-multi-region-sites.html ) and use multiple DNS providers. Denominator ( https://github.com/Netflix/denominator ) the tool NetFlix uses for this and open-sourced, currently supports managing (mirrored) DNS records across AWS Route53, RackSpace CloudDNS, DynECT and UltraDNS. -Jason On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: It is a shame in that PagerDuty is affected. However, Dyn is far, far better positioned to withstand attacks than a company like PagerDuty could possibly be on their own. So I think PagerDuty did the right thing in using Dyn. Remember, Twitter, Pingdom, github, and lots of other people use Dyn. And this is the first major outage I have heard of their service. Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. This is a serious attack, and the entire community should help track this miscreant down, then crush them like a bug. -- TTFN, patrick On Oct 21, 2016, at 1:00 PM, Terry Hardie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: It's a shame services like PagerDuty use Dyn. Now they're down too... On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Previously it was not affecting upper midwest for me, traces went to Chicago. Now traces to twitter DNS servers in Chicago are failing. ________________________________ From: Neil Hanlon via Outages [outages@outages.org<mailto:outages@outages.org>] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Dyn outage continuing The attacks appear to be continuing again. We are experiencing issues in Europe/Asia. On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California: $ dig @ns2.p34.dynect.net<http://ns2.p34.dynect.net> video.twimg.com<http://video.twimg.com> ; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net<http://ns2.p34.dynect.net> video.twimg.com<http://video.twimg.com> ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;video.twimg.com<http://video.twimg.com>. IN A ;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- KAYAK Neil Hanlon Devops Engineer +1 978 902 8171<tel:%2B1%20978%20902%208171> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
It appears most of the world cant reach Dyn : https://pulse.turbobytes.com/results/580a5178ecbe402e2201a74c/ But for the most part, its resolving thru Google DNS/OpenDNS : https://pulse.turbobytes.com/results/580a51ceecbe402e2201a74e/ On Sat, Oct 22, 2016 at 12:31 AM Andrew Bunde via Outages < outages@outages.org> wrote:
Don’t forget https://bit.namecoin.info/
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Jason Antman via Outages *Sent:* Friday, October 21, 2016 1:25 PM *Cc:* outages@outages.org
*Subject:* Re: [outages] Dyn outage continuing
This is just a horribly painful example of why we/they should all follow the route of NetFlix ( http://techblog.netflix.com/2013/05/denominating-multi-region-sites.html ) and use multiple DNS providers. Denominator ( https://github.com/Netflix/denominator ) the tool NetFlix uses for this and open-sourced, currently supports managing (mirrored) DNS records across AWS Route53, RackSpace CloudDNS, DynECT and UltraDNS.
-Jason
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages < outages@outages.org> wrote:
It is a shame in that PagerDuty is affected.
However, Dyn is far, far better positioned to withstand attacks than a company like PagerDuty could possibly be on their own. So I think PagerDuty did the right thing in using Dyn.
Remember, Twitter, Pingdom, github, and lots of other people use Dyn. And this is the first major outage I have heard of their service.
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. This is a serious attack, and the entire community should help track this miscreant down, then crush them like a bug.
--
TTFN,
patrick
On Oct 21, 2016, at 1:00 PM, Terry Hardie via Outages <outages@outages.org> wrote:
It's a shame services like PagerDuty use Dyn. Now they're down too...
On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages <outages@outages.org> wrote:
Previously it was not affecting upper midwest for me, traces went to Chicago.
Now traces to twitter DNS servers in Chicago are failing.
________________________________ From: Neil Hanlon via Outages [outages@outages.org] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org Subject: Re: [outages] Dyn outage continuing
The attacks appear to be continuing again. We are experiencing issues in Europe/Asia.
On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
$ dig @ns2.p34.dynect.net video.twimg.com
; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;video.twimg.com. IN A
;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
KAYAK
Neil Hanlon
Devops Engineer
+1 978 902 8171
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Does anyone have volume or attack information? What sort of attack(s) are suspected? -Mike Kun
On Oct 21, 2016, at 1:40 PM, Sajal Kayan via Outages <outages@outages.org> wrote:
It appears most of the world cant reach Dyn : https://pulse.turbobytes.com/results/580a5178ecbe402e2201a74c/ <https://urldefense.proofpoint.com/v2/url?u=https-3A__pulse.turbobytes.com_results_580a5178ecbe402e2201a74c_&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=xo1rCQZipTQbUei0LoYKV-rqVaj3BIcZ11klJCE8lIM&e=> But for the most part, its resolving thru Google DNS/OpenDNS : https://pulse.turbobytes.com/results/580a51ceecbe402e2201a74e/ <https://urldefense.proofpoint.com/v2/url?u=https-3A__pulse.turbobytes.com_results_580a51ceecbe402e2201a74e_&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=QGOdvuwYNF_7tdMiWdrf0JaBxlalMIIdfStw8rcnLDE&e=>
On Sat, Oct 22, 2016 at 12:31 AM Andrew Bunde via Outages <outages@outages.org <mailto:outages@outages.org>> wrote: Don’t forget https://bit.namecoin.info/ <https://urldefense.proofpoint.com/v2/url?u=https-3A__bit.namecoin.info_&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=rJP7Os_7EgCO59pliAnbnIx4WmpVRgaKUsTNRUIgIG8&e=>
From: Outages [mailto:outages-bounces@outages.org <mailto:outages-bounces@outages.org>] On Behalf Of Jason Antman via Outages Sent: Friday, October 21, 2016 1:25 PM Cc: outages@outages.org <mailto:outages@outages.org>
Subject: Re: [outages] Dyn outage continuing
This is just a horribly painful example of why we/they should all follow the route of NetFlix ( http://techblog.netflix.com/2013/05/denominating-multi-region-sites.html <https://urldefense.proofpoint.com/v2/url?u=http-3A__techblog.netflix.com_2013_05_denominating-2Dmulti-2Dregion-2Dsites.html&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=Z8GkKqlEGlieBt3NindCLAcFVWecC-y9JLtSKzsWPxg&e=> ) and use multiple DNS providers. Denominator ( https://github.com/Netflix/denominator <https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Netflix_denominator&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=5IyT0KIl6YhsW30mOHzSC6O5nLy_kYKPNEzYvg2Nr7U&e=> ) the tool NetFlix uses for this and open-sourced, currently supports managing (mirrored) DNS records across AWS Route53, RackSpace CloudDNS, DynECT and UltraDNS.
-Jason
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org <mailto:outages@outages.org>> wrote:
It is a shame in that PagerDuty is affected.
However, Dyn is far, far better positioned to withstand attacks than a company like PagerDuty could possibly be on their own. So I think PagerDuty did the right thing in using Dyn.
Remember, Twitter, Pingdom, github, and lots of other people use Dyn. And this is the first major outage I have heard of their service.
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. This is a serious attack, and the entire community should help track this miscreant down, then crush them like a bug.
--
TTFN,
patrick
On Oct 21, 2016, at 1:00 PM, Terry Hardie via Outages <outages@outages.org <mailto:outages@outages.org>> wrote:
It's a shame services like PagerDuty use Dyn. Now they're down too...
On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages <outages@outages.org <mailto:outages@outages.org>> wrote:
Previously it was not affecting upper midwest for me, traces went to Chicago.
Now traces to twitter DNS servers in Chicago are failing.
________________________________ From: Neil Hanlon via Outages [outages@outages.org <mailto:outages@outages.org>] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org <mailto:outages@outages.org> Subject: Re: [outages] Dyn outage continuing
The attacks appear to be continuing again. We are experiencing issues in Europe/Asia.
On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org <mailto:outages@outages.org>> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
$ dig @ns2.p34.dynect.net <https://urldefense.proofpoint.com/v2/url?u=http-3A__ns2.p34.dynect.net&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=nYgZcWsJA0qHxpscoM-las_Fkv2f_TC9OWy-twSs530&e=> video.twimg.com <https://urldefense.proofpoint.com/v2/url?u=http-3A__video.twimg.com&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=3YtpUj_uVR1HzhOlgLFT2JMnLwLB4rzUWdpUQq61Ht0&e=>
; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net <https://urldefense.proofpoint.com/v2/url?u=http-3A__ns2.p34.dynect.net&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=nYgZcWsJA0qHxpscoM-las_Fkv2f_TC9OWy-twSs530&e=> video.twimg.com <https://urldefense.proofpoint.com/v2/url?u=http-3A__video.twimg.com&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=3YtpUj_uVR1HzhOlgLFT2JMnLwLB4rzUWdpUQq61Ht0&e=> ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;video.twimg.com <https://urldefense.proofpoint.com/v2/url?u=http-3A__video.twimg.com&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=3YtpUj_uVR1HzhOlgLFT2JMnLwLB4rzUWdpUQq61Ht0&e=>. IN A
;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages <https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=>
--
KAYAK
Neil Hanlon
Devops Engineer
+1 978 902 8171 <tel:%2B1%20978%20902%208171>
_______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages <https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=> _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages <https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=>
_______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages <https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=>
_______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages <https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=> _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Trump sponsored internet outage...... ————————— Best regards, Michael Self This email composed on my iPhone 8 while driving with my knees. Please excuse brevity and typos due to Siri's hearing problems, accidents, cops or other mishaps. On Oct 21, 2016, at 13:53, Kun, Mike via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Does anyone have volume or attack information? What sort of attack(s) are suspected? -Mike Kun On Oct 21, 2016, at 1:40 PM, Sajal Kayan via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: It appears most of the world cant reach Dyn : https://pulse.turbobytes.com/results/580a5178ecbe402e2201a74c/<https://urldefense.proofpoint.com/v2/url?u=https-3A__pulse.turbobytes.com_results_580a5178ecbe402e2201a74c_&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=xo1rCQZipTQbUei0LoYKV-rqVaj3BIcZ11klJCE8lIM&e=> But for the most part, its resolving thru Google DNS/OpenDNS : https://pulse.turbobytes.com/results/580a51ceecbe402e2201a74e/<https://urldefense.proofpoint.com/v2/url?u=https-3A__pulse.turbobytes.com_results_580a51ceecbe402e2201a74e_&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=QGOdvuwYNF_7tdMiWdrf0JaBxlalMIIdfStw8rcnLDE&e=> On Sat, Oct 22, 2016 at 12:31 AM Andrew Bunde via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Don’t forget https://bit.namecoin.info/<https://urldefense.proofpoint.com/v2/url?u=https-3A__bit.namecoin.info_&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=rJP7Os_7EgCO59pliAnbnIx4WmpVRgaKUsTNRUIgIG8&e=> From: Outages [mailto:outages-bounces@outages.org<mailto:outages-bounces@outages.org>] On Behalf Of Jason Antman via Outages Sent: Friday, October 21, 2016 1:25 PM Cc: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Dyn outage continuing This is just a horribly painful example of why we/they should all follow the route of NetFlix ( http://techblog.netflix.com/2013/05/denominating-multi-region-sites.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__techblog.netflix.com_2013_05_denominating-2Dmulti-2Dregion-2Dsites.html&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=Z8GkKqlEGlieBt3NindCLAcFVWecC-y9JLtSKzsWPxg&e=> ) and use multiple DNS providers. Denominator ( https://github.com/Netflix/denominator<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_Netflix_denominator&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=5IyT0KIl6YhsW30mOHzSC6O5nLy_kYKPNEzYvg2Nr7U&e=> ) the tool NetFlix uses for this and open-sourced, currently supports managing (mirrored) DNS records across AWS Route53, RackSpace CloudDNS, DynECT and UltraDNS. -Jason On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: It is a shame in that PagerDuty is affected. However, Dyn is far, far better positioned to withstand attacks than a company like PagerDuty could possibly be on their own. So I think PagerDuty did the right thing in using Dyn. Remember, Twitter, Pingdom, github, and lots of other people use Dyn. And this is the first major outage I have heard of their service. Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. This is a serious attack, and the entire community should help track this miscreant down, then crush them like a bug. -- TTFN, patrick On Oct 21, 2016, at 1:00 PM, Terry Hardie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: It's a shame services like PagerDuty use Dyn. Now they're down too... On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Previously it was not affecting upper midwest for me, traces went to Chicago. Now traces to twitter DNS servers in Chicago are failing. ________________________________ From: Neil Hanlon via Outages [outages@outages.org<mailto:outages@outages.org>] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Dyn outage continuing The attacks appear to be continuing again. We are experiencing issues in Europe/Asia. On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California: $ dig @ns2.p34.dynect.net<https://urldefense.proofpoint.com/v2/url?u=http-3A__ns2.p34.dynect.net&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=nYgZcWsJA0qHxpscoM-las_Fkv2f_TC9OWy-twSs530&e=> video.twimg.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__video.twimg.com&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=3YtpUj_uVR1HzhOlgLFT2JMnLwLB4rzUWdpUQq61Ht0&e=> ; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net<https://urldefense.proofpoint.com/v2/url?u=http-3A__ns2.p34.dynect.net&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=nYgZcWsJA0qHxpscoM-las_Fkv2f_TC9OWy-twSs530&e=> video.twimg.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__video.twimg.com&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=3YtpUj_uVR1HzhOlgLFT2JMnLwLB4rzUWdpUQq61Ht0&e=> ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;video.twimg.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__video.twimg.com&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=3YtpUj_uVR1HzhOlgLFT2JMnLwLB4rzUWdpUQq61Ht0&e=>. IN A ;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=> -- KAYAK Neil Hanlon Devops Engineer +1 978 902 8171<tel:%2B1%20978%20902%208171> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailman_listinfo_outages&d=DQMFaQ&c=96ZbZZcaMF4w0F4jpN6LZg&r=JKX8L6GOKvRiNpSp-mnjjQ&m=NlUSnBfE_pOQTYFrnNz03CXHFDf-thc56BitRGGX2HE&s=XPLQiTtTSnqFkQpyPWGEQCbi4k2BRGuDxT51QCjhMpY&e=> _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
What are you basing your claims on? On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
It is a shame in that PagerDuty is affected.
However, Dyn is far, far better positioned to withstand attacks than a company like PagerDuty could possibly be on their own. So I think PagerDuty did the right thing in using Dyn.
Remember, Twitter, Pingdom, github, and lots of other people use Dyn. And this is the first major outage I have heard of their service.
Everyone has issues. Here is one: http://hub.dyn.com/dyn-status/update-managed-dns-issue-july-6-2015
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. This is a serious attack, and the entire community should help track this miscreant down, then crush them like a bug.
Let's actually be clear... Do you have some inside information the rest of us are not privy to? Sources? How did you come to your earlier statement re: this being a ransom attack? Do you have detailed information describing the top 10 DNS infrastructures on the planet, such that you could make any sort of comparison of infrastructure or size? I'll grant you Akamai, how about the other 9? What do you know about this attack, such that you can make claims that this is "serious" or that there is a single miscreant that can be tracked down or that the community can assist in any way? Without actual details this looks to be wild conjecture and doesn't provide any helpful direction. -DMM [ I work for DNS Made Easy ]
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for. -Jim P.
Dear colleagues, On Fri, Oct 21, 2016 at 02:14:34PM -0400, Jim Popovitch via Outages wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn?
To be clear, according to https://www.dynstatus.com/ (which is the place you will actually find out about Dyn's status), this attack is against the Dyn managed DNS infrastructure, which is the anycast deployment. I'm not in a position to disclose details about the attack just now (partly because I'm leaving the people doing the mitigation alone so they can focus on that rather than providing detailed attack reports), but this is a significant attack. The communications people at Dyn are actively keeping the status pages accurate, so if you want to know what's going on the URI above is the place to look. I hope this is helpful to make clear what infrastructure people are talking about. Best regards, A -- Andrew Sullivan Dyn asullivan@dyn.com
A buddy of mine just forwarded this story my way. It gives some insight as to what may have triggered the events. https://krebsonsecurity.com/2016/10/ddos-on-dyn-impacts-twitter-spotify-redd... -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Andrew Sullivan via Outages Sent: Friday, October 21, 2016 12:27 PM To: outages@outages.org Subject: Re: [outages] Dyn outage continuing Dear colleagues, On Fri, Oct 21, 2016 at 02:14:34PM -0400, Jim Popovitch via Outages wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn?
To be clear, according to https://www.dynstatus.com/ (which is the place you will actually find out about Dyn's status), this attack is against the Dyn managed DNS infrastructure, which is the anycast deployment. I'm not in a position to disclose details about the attack just now (partly because I'm leaving the people doing the mitigation alone so they can focus on that rather than providing detailed attack reports), but this is a significant attack. The communications people at Dyn are actively keeping the status pages accurate, so if you want to know what's going on the URI above is the place to look. I hope this is helpful to make clear what infrastructure people are talking about. Best regards, A -- Andrew Sullivan Dyn asullivan@dyn.com _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more visit the Mimecast website.
That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for. How much do you pay a yr for www.google.com, yet that is fairly robust. So as with anything you don't always get what you pay for.
This electronic mail transmission contains information from Warner Pacific Insurance Services that may be confidential or privileged. Such information is solely for the intended recipient, and use by any other party is not authorized. If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of this message, its contents or any attachments is prohibited. Any wrongful interception of this message is punishable as a Federal Crime. If you have received this message in error, please notify the sender immediately by telephone (800) 801-2300 or by electronic mail at postmaster@warnerpacific.com.
Google has a completely different revenue stream than Dyn, not sure that's a valid argument. Dominick Colangelo * Systems Administrator * Technology Services * wit.edu/dts * Follow us on Twitter @ DTSatWIT -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Gareth Tupper via Outages Sent: Friday, October 21, 2016 2:33 PM To: 'outages@outages.org' <outages@outages.org> Subject: Re: [outages] Dyn outage continuing
That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for. How much do you pay a yr for www.google.com, yet that is fairly robust. So as with anything you don't always get what you pay for.
This electronic mail transmission contains information from Warner Pacific Insurance Services that may be confidential or privileged. Such information is solely for the intended recipient, and use by any other party is not authorized. If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of this message, its contents or any attachments is prohibited. Any wrongful interception of this message is punishable as a Federal Crime. If you have received this message in error, please notify the sender immediately by telephone (800) 801-2300 or by electronic mail at postmaster@warnerpacific.com. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something? On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages < outages@outages.org> wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
They run on different DNS servers. One was targeted, one wasn’t. The perpetrators clearly wanted to impact the most damage on commercial services, who are the ones who can afford Managed DNS services, so they picked those to target. Thus, your cheap services weren’t impacted because they weren’t the target. From: Outages <outages-bounces@outages.org> on behalf of Mike Lieman via Outages <outages@outages.org> Reply-To: Mike Lieman <mikelieman@gmail.com> Date: Friday, October 21, 2016 at 11:35 AM To: Jim Popovitch <jimpop@gmail.com> Cc: "outages@outages.org" <outages@outages.org> Subject: Re: [outages] Dyn outage continuing The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something? On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for. -Jim P. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
Just guessing here, but I'm assuming the $40 plans don't utilize Dyn's anycast infrastructure, which is apparently the target of this attack? Literally just a guess, though. On Fri, Oct 21, 2016 at 2:36 PM Mike Lieman via Outages <outages@outages.org> wrote:
The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something?
On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages < outages@outages.org> wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- KAYAK Neil Hanlon Devops Engineer +1 978 902 8171
Weird... I thought I was subscribed to a mailing list about outages, not pricing debates and pee contests..... I'll have to evaluate my account settings. On Fri, Oct 21, 2016 at 11:35 AM, Mike Lieman via Outages < outages@outages.org> wrote:
The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something?
On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages < outages@outages.org> wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
IMO it's important to factor in the business aspect into our IT work in networking. Then again I came from accounting before IT so I sort of see things in scope of dollars anyway. I appreciate the dialogue. Get Outlook for Android<https://aka.ms/ghei36> On Fri, Oct 21, 2016 at 11:39 AM -0700, "Mike Davis via Outages" <outages@outages.org<mailto:outages@outages.org>> wrote: Weird... I thought I was subscribed to a mailing list about outages, not pricing debates and pee contests..... I'll have to evaluate my account settings. On Fri, Oct 21, 2016 at 11:35 AM, Mike Lieman via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something? On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org<mailto:outages@outages.org>> wrote:
Let's all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for. -Jim P. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages
This is a list for OUTAGE NOTIFICATIONS ONLY. Even my message is noise not signal, but I'm hoping it helps. Many of us get this via text and just need to know what's on fire. There's outages-discuss and other places to talk. THIS IS FOR NOTIFICATIONS ONLY. On Fri, Oct 21, 2016 at 11:52 AM, Russell Zen via Outages < outages@outages.org> wrote:
IMO it's important to factor in the business aspect into our IT work in networking. Then again I came from accounting before IT so I sort of see things in scope of dollars anyway. I appreciate the dialogue.
Get Outlook for Android <https://aka.ms/ghei36>
On Fri, Oct 21, 2016 at 11:39 AM -0700, "Mike Davis via Outages" < outages@outages.org> wrote:
Weird... I thought I was subscribed to a mailing list about outages, not pricing debates and pee contests..... I'll have to evaluate my account settings.
On Fri, Oct 21, 2016 at 11:35 AM, Mike Lieman via Outages < outages@outages.org> wrote:
The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something?
On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages < outages@outages.org> wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Carlos Alvarez 602-368-6403
To be honest, this discussion should be on outages-discussion@outages.org, not the main outages list for reporting... But that doesn't really matter now. On Oct 21, 2016 2:53 PM, "Russell Zen via Outages" <outages@outages.org> wrote:
IMO it's important to factor in the business aspect into our IT work in networking. Then again I came from accounting before IT so I sort of see things in scope of dollars anyway. I appreciate the dialogue.
Get Outlook for Android <https://aka.ms/ghei36>
On Fri, Oct 21, 2016 at 11:39 AM -0700, "Mike Davis via Outages" < outages@outages.org> wrote:
Weird... I thought I was subscribed to a mailing list about outages, not pricing debates and pee contests..... I'll have to evaluate my account settings.
On Fri, Oct 21, 2016 at 11:35 AM, Mike Lieman via Outages < outages@outages.org> wrote:
The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something?
On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages < outages@outages.org> wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Interesting though it may be, it's probably a topic better pursued on outages-discussion. My understanding is that outages is really supposed to be limited to what's down, according to whom, impact, ETR, etc. Can we get a mod to weigh in? --Dj Sent from my iPhone
On Oct 21, 2016, at 11:52 AM, Russell Zen via Outages <outages@outages.org> wrote:
IMO it's important to factor in the business aspect into our IT work in networking. Then again I came from accounting before IT so I sort of see things in scope of dollars anyway. I appreciate the dialogue.
Get Outlook for Android
On Fri, Oct 21, 2016 at 11:39 AM -0700, "Mike Davis via Outages" <outages@outages.org> wrote:
Weird... I thought I was subscribed to a mailing list about outages, not pricing debates and pee contests..... I'll have to evaluate my account settings.
On Fri, Oct 21, 2016 at 11:35 AM, Mike Lieman via Outages <outages@outages.org> wrote: The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something?
On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages <outages@outages.org> wrote: On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Changing from fire suite to admin hat after this morning's event due to hosted services going dark. My salute to Dyn team, we all know this is a thankless job for the folks on the frontline. Anyway yes that's correct, typically conversation does shift to outages-discussion not much direction needed here but just asserting. Anyway, shifting hats and getting off the channel. 73, /vrode
On Oct 21, 2016, at 12:06 PM, Dj Padzensky via Outages <outages@outages.org> wrote:
Interesting though it may be, it's probably a topic better pursued on outages-discussion. My understanding is that outages is really supposed to be limited to what's down, according to whom, impact, ETR, etc.
Can we get a mod to weigh in?
--Dj
Sent from my iPhone
On Oct 21, 2016, at 11:52 AM, Russell Zen via Outages <outages@outages.org> wrote:
IMO it's important to factor in the business aspect into our IT work in networking. Then again I came from accounting before IT so I sort of see things in scope of dollars anyway. I appreciate the dialogue.
Get Outlook for Android
On Fri, Oct 21, 2016 at 11:39 AM -0700, "Mike Davis via Outages" <outages@outages.org> wrote:
Weird... I thought I was subscribed to a mailing list about outages, not pricing debates and pee contests..... I'll have to evaluate my account settings.
On Fri, Oct 21, 2016 at 11:35 AM, Mike Lieman via Outages <outages@outages.org> wrote: The strangest thing was that while our premium Managed DNS ( Dynect ) domains were having issues, the 40 dollar ones I use for my own personal stuff were rock solid. Guess that layer isn't high profile enough or something?
On Fri, Oct 21, 2016 at 2:14 PM, Jim Popovitch via Outages <outages@outages.org> wrote: On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
-Jim P. _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
----- Original Message -----
From: "Dj Padzensky via Outages" <outages@outages.org>
Interesting though it may be, it's probably a topic better pursued on outages-discussion. My understanding is that outages is really supposed to be limited to what's down, according to whom, impact, ETR, etc.
Can we get a mod to weigh in?
Sure. :-) <mod> Everyone who said the followups should go to -discussion was right, and thanks to everyone who's already moved over there. I was on the road earlier, my apologies. </mod> Cheers, -- jra -- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://www.bcp38.info 2000 Land Rover DII St Petersburg FL USA BCP38: Ask For It By Name! +1 727 647 1274
On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
I disagree Jim. I pay $60/year to DNS Made Easy for 25 domains and 10M queries per month, and I get amazing service, a great UI, an API, globally Anycasted, and with a single exception of about 6 hours of intermittent problems 6 years ago due to a 50Gbps DDoS, literally 100% uptime. And they were super transparent about it all too and paid out an SLA credit: https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/ I get SO much more than I pay for. I would say DME is the end-all-be-all of value and affordability. Given my experience over the last 9 years of being a DME customer, I know that amazing hosted DNS exists and can be affordable. I'd trust no one else with my business DNS service. Not even me. Beckman --------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ---------------------------------------------------------------------------
Guys is this outage still going on? Can we move the discussion to -discussion, please... Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Fri, Oct 21, 2016 at 4:23 PM, Peter Beckman via Outages < outages@outages.org> wrote:
On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages
<outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
I disagree Jim.
I pay $60/year to DNS Made Easy for 25 domains and 10M queries per month, and I get amazing service, a great UI, an API, globally Anycasted, and with a single exception of about 6 hours of intermittent problems 6 years ago due to a 50Gbps DDoS, literally 100% uptime.
And they were super transparent about it all too and paid out an SLA credit: https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/
I get SO much more than I pay for. I would say DME is the end-all-be-all of value and affordability.
Given my experience over the last 9 years of being a DME customer, I know that amazing hosted DNS exists and can be affordable. I'd trust no one else with my business DNS service.
Not even me.
Beckman ------------------------------------------------------------ --------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ------------------------------------------------------------ --------------- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
i’ll second that, all in favor?
On Oct 21, 2016, at 1:26 PM, Josh Luthman via Outages <outages@outages.org> wrote:
Guys is this outage still going on?
Can we move the discussion to -discussion, please...
Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373
On Fri, Oct 21, 2016 at 4:23 PM, Peter Beckman via Outages <outages@outages.org <mailto:outages@outages.org>> wrote: On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org <mailto:outages@outages.org>> wrote: Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
I disagree Jim.
I pay $60/year to DNS Made Easy for 25 domains and 10M queries per month, and I get amazing service, a great UI, an API, globally Anycasted, and with a single exception of about 6 hours of intermittent problems 6 years ago due to a 50Gbps DDoS, literally 100% uptime.
And they were super transparent about it all too and paid out an SLA credit: https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/ <https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/>
I get SO much more than I pay for. I would say DME is the end-all-be-all of value and affordability.
Given my experience over the last 9 years of being a DME customer, I know that amazing hosted DNS exists and can be affordable. I'd trust no one else with my business DNS service.
Not even me.
Beckman --------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com <mailto:beckman@angryox.com> http://www.angryox.com/ <http://www.angryox.com/> --------------------------------------------------------------------------- _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
The outage is still ongoing. But the horse has been flogged to death (and then some). Best Regards, Ivan Kovacevic Vice President, Client Services Star Telecom | www.startelecom.ca <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.startelecom.ca%2F&si=6470560385859584&pi=df20127b-0a92-4e36-876e-5855947cd1f6> | SIP Based Services for Contact Centers | LinkedIn <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fstar-telecom-www.startelecom.ca-%3Ftrk%3Dtop_nav_home&si=6470560385859584&pi=df20127b-0a92-4e36-876e-5855947cd1f6> *From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Josh Luthman via Outages *Sent:* October 21, 2016 4:27 PM *To:* Peter Beckman <beckman@angryox.com> *Cc:* outages@outages.org *Subject:* Re: [outages] Dyn outage continuing Guys is this outage still going on? Can we move the discussion to -discussion, please... Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Fri, Oct 21, 2016 at 4:23 PM, Peter Beckman via Outages < outages@outages.org> wrote: On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote: On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote: Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for. I disagree Jim. I pay $60/year to DNS Made Easy for 25 domains and 10M queries per month, and I get amazing service, a great UI, an API, globally Anycasted, and with a single exception of about 6 hours of intermittent problems 6 years ago due to a 50Gbps DDoS, literally 100% uptime. And they were super transparent about it all too and paid out an SLA credit: https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/ I get SO much more than I pay for. I would say DME is the end-all-be-all of value and affordability. Given my experience over the last 9 years of being a DME customer, I know that amazing hosted DNS exists and can be affordable. I'd trust no one else with my business DNS service. Not even me. Beckman --------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ --------------------------------------------------------------------------- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages [image: http://t.sidekickopen06.com/e1t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9gXrN7sKj6v4L...]
Seems like everything's back up now as far as I can tell as of a few min ago On Fri, Oct 21, 2016 at 2:36 PM, Ivan Kovacevic via Outages < outages@outages.org> wrote:
The outage is still ongoing. But the horse has been flogged to death (and then some).
Best Regards,
Ivan Kovacevic
Vice President, Client Services
Star Telecom | www.startelecom.ca <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.startelecom.ca%2F&si=6470560385859584&pi=df20127b-0a92-4e36-876e-5855947cd1f6> | SIP Based Services for Contact Centers | LinkedIn <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fstar-telecom-www.startelecom.ca-%3Ftrk%3Dtop_nav_home&si=6470560385859584&pi=df20127b-0a92-4e36-876e-5855947cd1f6>
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Josh Luthman via Outages *Sent:* October 21, 2016 4:27 PM *To:* Peter Beckman <beckman@angryox.com> *Cc:* outages@outages.org *Subject:* Re: [outages] Dyn outage continuing
Guys is this outage still going on?
Can we move the discussion to -discussion, please...
Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373
On Fri, Oct 21, 2016 at 4:23 PM, Peter Beckman via Outages < outages@outages.org> wrote:
On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
I disagree Jim.
I pay $60/year to DNS Made Easy for 25 domains and 10M queries per month, and I get amazing service, a great UI, an API, globally Anycasted, and with a single exception of about 6 hours of intermittent problems 6 years ago due to a 50Gbps DDoS, literally 100% uptime.
And they were super transparent about it all too and paid out an SLA credit: https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/
I get SO much more than I pay for. I would say DME is the end-all-be-all of value and affordability.
Given my experience over the last 9 years of being a DME customer, I know that amazing hosted DNS exists and can be affordable. I'd trust no one else with my business DNS service.
Not even me.
Beckman ------------------------------------------------------------ --------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ------------------------------------------------------------ --------------- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
[image: http://t.sidekickopen06.com/e1t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9gXrN7sKj6v4L...]
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Yep. Looks like my email must have fixed it. J Best Regards, Ivan Kovacevic Vice President, Client Services Star Telecom | www.startelecom.ca <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.startelecom.ca%2F&si=6470560385859584&pi=df0533a1-dd30-4831-877e-6252fbef5c90> | SIP Based Services for Contact Centers | LinkedIn <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fstar-telecom-www-startelecom-ca-%3Ftrk%3Dbiz-companies-cym&si=6470560385859584&pi=df0533a1-dd30-4831-877e-6252fbef5c90> *From:* lucky225@gmail.com [mailto:lucky225@gmail.com] *On Behalf Of *Lucky 225 *Sent:* October 21, 2016 4:44 PM *To:* Ivan Kovacevic <ivan.kovacevic@startelecom.ca> *Cc:* Josh Luthman <josh@imaginenetworksllc.com>; outages@outages.org *Subject:* Re: [outages] Dyn outage continuing Seems like everything's back up now as far as I can tell as of a few min ago On Fri, Oct 21, 2016 at 2:36 PM, Ivan Kovacevic via Outages < outages@outages.org> wrote: The outage is still ongoing. But the horse has been flogged to death (and then some). Best Regards, Ivan Kovacevic Vice President, Client Services Star Telecom | www.startelecom.ca <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.startelecom.ca%2F&si=6470560385859584&pi=df0533a1-dd30-4831-877e-6252fbef5c90> | SIP Based Services for Contact Centers | LinkedIn <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=&si=6470560385859584&pi=df0533a1-dd30-4831-877e-6252fbef5c90> *From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Josh Luthman via Outages *Sent:* October 21, 2016 4:27 PM *To:* Peter Beckman <beckman@angryox.com> *Cc:* outages@outages.org *Subject:* Re: [outages] Dyn outage continuing Guys is this outage still going on? Can we move the discussion to -discussion, please... Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Fri, Oct 21, 2016 at 4:23 PM, Peter Beckman via Outages < outages@outages.org> wrote: On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote: On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote: Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service. Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for. I disagree Jim. I pay $60/year to DNS Made Easy for 25 domains and 10M queries per month, and I get amazing service, a great UI, an API, globally Anycasted, and with a single exception of about 6 hours of intermittent problems 6 years ago due to a 50Gbps DDoS, literally 100% uptime. And they were super transparent about it all too and paid out an SLA credit: https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/ I get SO much more than I pay for. I would say DME is the end-all-be-all of value and affordability. Given my experience over the last 9 years of being a DME customer, I know that amazing hosted DNS exists and can be affordable. I'd trust no one else with my business DNS service. Not even me. Beckman --------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ --------------------------------------------------------------------------- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages [image: http://t.sidekickopen06.com/e1t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9gXrN7sKj6v4L...]
Twitter images (from Reddit links) weren't working before and are now. Twitter home page loads. Netflix video starts now (wasn't before). Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373 On Fri, Oct 21, 2016 at 4:43 PM, Lucky 225 <Lucky225@2600.com> wrote:
Seems like everything's back up now as far as I can tell as of a few min ago
On Fri, Oct 21, 2016 at 2:36 PM, Ivan Kovacevic via Outages < outages@outages.org> wrote:
The outage is still ongoing. But the horse has been flogged to death (and then some).
Best Regards,
Ivan Kovacevic
Vice President, Client Services
Star Telecom | www.startelecom.ca <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.startelecom.ca%2F&si=6470560385859584&pi=df20127b-0a92-4e36-876e-5855947cd1f6> | SIP Based Services for Contact Centers | LinkedIn <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fstar-telecom-www.startelecom.ca-%3Ftrk%3Dtop_nav_home&si=6470560385859584&pi=df20127b-0a92-4e36-876e-5855947cd1f6>
*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Josh Luthman via Outages *Sent:* October 21, 2016 4:27 PM *To:* Peter Beckman <beckman@angryox.com> *Cc:* outages@outages.org *Subject:* Re: [outages] Dyn outage continuing
Guys is this outage still going on?
Can we move the discussion to -discussion, please...
Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373
On Fri, Oct 21, 2016 at 4:23 PM, Peter Beckman via Outages < outages@outages.org> wrote:
On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
I disagree Jim.
I pay $60/year to DNS Made Easy for 25 domains and 10M queries per month, and I get amazing service, a great UI, an API, globally Anycasted, and with a single exception of about 6 hours of intermittent problems 6 years ago due to a 50Gbps DDoS, literally 100% uptime.
And they were super transparent about it all too and paid out an SLA credit: https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/
I get SO much more than I pay for. I would say DME is the end-all-be-all of value and affordability.
Given my experience over the last 9 years of being a DME customer, I know that amazing hosted DNS exists and can be affordable. I'd trust no one else with my business DNS service.
Not even me.
Beckman ------------------------------------------------------------ --------------- Peter Beckman Internet Guy beckman@angryox.com http://www.angryox.com/ ------------------------------------------------------------ --------------- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
[image: http://t.sidekickopen06.com/e1t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9gXrN7sKj6v4L...]
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
github is back now as well, however it looks like they switched to route53.
On Oct 21, 2016, at 1:50 PM, Josh Luthman via Outages <outages@outages.org> wrote:
Twitter images (from Reddit links) weren't working before and are now. Twitter home page loads. Netflix video starts now (wasn't before).
Josh Luthman Office: 937-552-2340 Direct: 937-552-2343 1100 Wayne St Suite 1337 Troy, OH 45373
On Fri, Oct 21, 2016 at 4:43 PM, Lucky 225 <Lucky225@2600.com <mailto:Lucky225@2600.com>> wrote: Seems like everything's back up now as far as I can tell as of a few min ago
On Fri, Oct 21, 2016 at 2:36 PM, Ivan Kovacevic via Outages <outages@outages.org <mailto:outages@outages.org>> wrote: The outage is still ongoing. But the horse has been flogged to death (and then some). <>
Best Regards,
Ivan Kovacevic
Vice President, Client Services
Star Telecom | www.startelecom.ca <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.startelecom.ca%2F&si=6470560385859584&pi=df20127b-0a92-4e36-876e-5855947cd1f6> | SIP Based Services for Contact Centers | LinkedIn <http://t.sidekickopen06.com/e1t/c/5/f18dQhb0S7lC8dDMPbW2n0x6l2B9nMJW7t5XYg1qMvVnW3LjyBM63K6FlW63JXmj56dLPjf6TyZWx02?t=http%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fstar-telecom-www.startelecom.ca-%3Ftrk%3Dtop_nav_home&si=6470560385859584&pi=df20127b-0a92-4e36-876e-5855947cd1f6>
From: Outages [mailto:outages-bounces@outages.org <mailto:outages-bounces@outages.org>] On Behalf Of Josh Luthman via Outages Sent: October 21, 2016 4:27 PM To: Peter Beckman <beckman@angryox.com <mailto:beckman@angryox.com>> Cc: outages@outages.org <mailto:outages@outages.org> Subject: Re: [outages] Dyn outage continuing
Guys is this outage still going on?
Can we move the discussion to -discussion, please...
Josh Luthman Office: 937-552-2340 <tel:937-552-2340> Direct: 937-552-2343 <tel:937-552-2343> 1100 Wayne St Suite 1337 Troy, OH 45373
On Fri, Oct 21, 2016 at 4:23 PM, Peter Beckman via Outages <outages@outages.org <mailto:outages@outages.org>> wrote:
On Fri, 21 Oct 2016, Jim Popovitch via Outages wrote:
On Fri, Oct 21, 2016 at 1:09 PM, Patrick W. Gilmore via Outages <outages@outages.org <mailto:outages@outages.org>> wrote:
Let’s all be clear that Dyn has to be in the top 10 DNS infrastructures on the planet. Possibly the largest that sells DNS as a service.
Which part of Dyn? IIRC, there are multiple layers, and the cheaper layer(s) weren't anycast and only in 5 locations on single IPs. That's not saying that Dyn is bad, but some people like to tout them as the end-all-be-all at $40/yr.... so as with anything you get what you pay for.
I disagree Jim.
I pay $60/year to DNS Made Easy for 25 domains and 10M queries per month, and I get amazing service, a great UI, an API, globally Anycasted, and with a single exception of about 6 hours of intermittent problems 6 years ago due to a 50Gbps DDoS, literally 100% uptime.
And they were super transparent about it all too and paid out an SLA credit: https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/ <https://bytestopshere.wordpress.com/2010/08/09/dnsmadeeasy-ddos-attack/>
I get SO much more than I pay for. I would say DME is the end-all-be-all of value and affordability.
Given my experience over the last 9 years of being a DME customer, I know that amazing hosted DNS exists and can be affordable. I'd trust no one else with my business DNS service.
Not even me.
Beckman --------------------------------------------------------------------------- Peter Beckman Internet Guy beckman@angryox.com <mailto:beckman@angryox.com> http://www.angryox.com/ <http://www.angryox.com/> --------------------------------------------------------------------------- _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
_______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages <https://puck.nether.net/mailman/listinfo/outages>
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
On Fri, Oct 21, 2016 at 01:52:10PM -0700, Neal Lawson via Outages <outages@outages.org> wrote a message of 404 lines which said:
github is back now as well, however it looks like they switched to route53.
The TTL of the NS record set was 86400 seconds so it will take some time before everyone see that change.
On 10/21/16 13:52, Neal Lawson via Outages wrote:
github is back now as well, however it looks like they switched to route53.
I'm seeing almost all the domains I've been watching start to add other NS if they were exclusively using Dyn before. ~Seth
We had issues resolving www.paypal.com via Comcast coming from NW sub-burb of Chicago from ~7:26a-8:11a (CT). Worked via another ISP. Issue started again for us. -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Terry Hardie via Outages Sent: Friday, October 21, 2016 12:00 PM To: Justin Krejci Cc: outages@outages.org Subject: Re: [outages] Dyn outage continuing It's a shame services like PagerDuty use Dyn. Now they're down too... On Fri, Oct 21, 2016 at 9:57 AM, Justin Krejci via Outages <outages@outages.org> wrote:
Previously it was not affecting upper midwest for me, traces went to Chicago.
Now traces to twitter DNS servers in Chicago are failing.
________________________________ From: Neil Hanlon via Outages [outages@outages.org] Sent: Friday, October 21, 2016 11:16 AM To: Terry Hardie; outages@outages.org Subject: Re: [outages] Dyn outage continuing
The attacks appear to be continuing again. We are experiencing issues in Europe/Asia.
On Fri, Oct 21, 2016 at 12:13 PM Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
$ dig @ns2.p34.dynect.net video.twimg.com
; <<>> DiG 9.3.2 <<>> @ns2.p34.dynect.net video.twimg.com ; (1 server found) ;; global options: printcmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: SERVFAIL, id: 170 ;; flags: qr rd; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;video.twimg.com. IN A
;; Query time: 3103 msec ;; SERVER: 204.13.250.34#53(204.13.250.34) ;; WHEN: Fri Oct 21 17:11:36 2016 ;; MSG SIZE rcvd: 33 _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
--
KAYAK
Neil Hanlon
Devops Engineer
+1 978 902 8171
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
On 21 October 2016 at 09:12, Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
I can't reach github.com from Cox in Las Vegas but at work I can. ;; ANSWER SECTION: github.com. 37059 IN NS ns2.p16.dynect.net. github.com. 37059 IN NS ns3.p16.dynect.net. github.com. 37059 IN NS ns4.p16.dynect.net. github.com. 37059 IN NS ns1.p16.dynect.net. ;; ADDITIONAL SECTION: ns2.p16.dynect.net. 80634 IN A 204.13.250.16 ns3.p16.dynect.net. 80634 IN A 208.78.71.16 ns4.p16.dynect.net. 80634 IN A 204.13.251.16 ns1.p16.dynect.net. 34988 IN A 208.78.70.16 I can't even ping github.com from home. -- ------- inum: 883510009027723 sip: jungleboogie@sip2sip.info
There is a secondary outage that is still ongoing. Look on dynstatus.com for the latest updates. On Oct 21, 2016 3:16 PM, "jungle Boogie via Outages" <outages@outages.org> wrote:
On 21 October 2016 at 09:12, Terry Hardie via Outages <outages@outages.org> wrote:
Even though their page says the outage is resolved, I'm still getting DNS failures (return SERVFAIL, not no answer) to their anycast networks from California:
I can't reach github.com from Cox in Las Vegas but at work I can.
;; ANSWER SECTION: github.com. 37059 IN NS ns2.p16.dynect.net. github.com. 37059 IN NS ns3.p16.dynect.net. github.com. 37059 IN NS ns4.p16.dynect.net. github.com. 37059 IN NS ns1.p16.dynect.net.
;; ADDITIONAL SECTION: ns2.p16.dynect.net. 80634 IN A 204.13.250.16 ns3.p16.dynect.net. 80634 IN A 208.78.71.16 ns4.p16.dynect.net. 80634 IN A 204.13.251.16 ns1.p16.dynect.net. 34988 IN A 208.78.70.16
I can't even ping github.com from home.
-- ------- inum: 883510009027723 sip: jungleboogie@sip2sip.info _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (32)
-
Andrew Bunde -
Andrew Sullivan -
Carlos Alvarez -
Colangelo, Dom -
Darren Schreiber -
David Miller -
Dj Padzensky -
Gareth Tupper -
Ivan Kovacevic -
Jason Antman -
Jay R. Ashworth -
Jim Popovitch -
Josh Luthman -
jungle Boogie -
Justin Krejci -
Kun, Mike -
Lucky 225 -
Michael R. Self -
Mike Davis -
Mike Lieman -
Mike Swier -
Neal Lawson -
Neil Hanlon -
Outages -
Patrick W. Gilmore -
Peter Beckman -
Randall (Randy) Raitz -
Russell Zen -
Sajal Kayan -
Seth Mattinen -
Stephane Bortzmeyer -
Terry Hardie