
Starting this afternoon our monitoring system recorded several 5 to 15 minute outages accessing some IPv6-enabled Akamai-delivered sites. In each case, where I could catch the problem while it happened, I could not resolve the AAAA to an IPv6 address. We and our upstream provider have over 10 servers of different flavors, and they are all exhibiting this issue, though not Google or OpenDNS' servers. Just two examples are below, but in each case, I get a CNAME back, but it doesn't show an IPv6 address. And also five from https://www.digwebinterface.com/?type=SOA&colorize=on&useresolver=8.8.4.4&ns =all&nameservers. And also here: https://www.whatsmydns.net/#AAAA/www.apple.com and here http://www.preshweb.co.uk/cgi-bin/dns-propagation-tracker.pl?domain=www.appl e.com&type=AAAA&serversmode=random&servers=&nsdomain= Anyone else seeing the same? I emailed Akamai's tix address, but have not gotten anything back other than the auto-responder. Frank ; <<>> DiG 9.7.3 <<>> AAAA www.apple.com @10.20.0.10 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 9110 ;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0 ;; QUESTION SECTION: ;www.apple.com. IN AAAA ;; ANSWER SECTION: www.apple.com. 483 IN CNAME www.apple.com.edgekey.net. www.apple.com.edgekey.net. 3193 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net. www.apple.com.edgekey.net.globalredir.akadns.net. 19 IN CNAME e6858.dsce9.akamaiedge.net. ;; AUTHORITY SECTION: dsce9.akamaiedge.net. 107 IN SOA n0dsce9.akamaiedge.net. hostmaster.akamai.com. 1485306230 1000 1000 1000 1800 ;; Query time: 0 msec ;; SERVER: 10.20.0.10#53(10.20.0.10) ;; WHEN: Tue Jan 24 19:18:43 2017 ;; MSG SIZE rcvd: 228 ; <<>> DiG 9.7.3 <<>> AAAA www.apple.com @96.31.0.32 ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58259 ;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0 ;; QUESTION SECTION: ;www.apple.com. IN AAAA ;; ANSWER SECTION: www.apple.com. 1073 IN CNAME www.apple.com.edgekey.net. www.apple.com.edgekey.net. 3584 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net. www.apple.com.edgekey.net.globalredir.akadns.net. 446 IN CNAME e6858.dsce9.akamaiedge.net. ;; AUTHORITY SECTION: dsce9.akamaiedge.net. 257 IN SOA n0dsce9.akamaiedge.net. hostmaster.akamai.com. 1485306380 1000 1000 1000 1800 ;; Query time: 0 msec ;; SERVER: 96.31.0.32#53(96.31.0.32) ;; WHEN: Tue Jan 24 19:18:43 2017 ;; MSG SIZE rcvd: 228 =============================== https://www.digwebinterface.com/?hostnames=www.apple.com&type=AAAA&showcomma nd=on&colorize=on&useresolver=8.8.4.4&ns=all&nameservers= www.apple.com@168.95.1.1 (HiNet (TW)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com. @168.95.1.1 www.apple.com. 1494 IN CNAME www.apple.com.edgekey.net. www.apple.com.edgekey.net. 6888 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net. www.apple.com.edgekey.net.globalredir.akadns.net. 3289 IN CNAME e6858.dsce9.akamaiedge.net. dsce9.akamaiedge.net. 191 IN SOA n0dsce9.akamaiedge.net. hostmaster.akamai.com. 1485306682 1000 1000 1000 1800 www.apple.com@195.129.12.122 (UUNET (CH)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com. @195.129.12.122 www.apple.com. 387 IN CNAME www.apple.com.edgekey.net. www.apple.com.edgekey.net. 12797 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net. www.apple.com.edgekey.net.globalredir.akadns.net. 2145 IN CNAME e6858.dsce9.akamaiedge.net. dsce9.akamaiedge.net. 159 IN SOA n0dsce9.akamaiedge.net. hostmaster.akamai.com. 1485306650 1000 1000 1000 1800 www.apple.com@192.76.144.66 (UUNET (DE)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com. @192.76.144.66 www.apple.com. 1599 IN CNAME www.apple.com.edgekey.net. www.apple.com.edgekey.net. 11114 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net. www.apple.com.edgekey.net.globalredir.akadns.net. 588 IN CNAME e6858.dsce9.akamaiedge.net. dsce9.akamaiedge.net. 297 IN SOA n0dsce9.akamaiedge.net. hostmaster.akamai.com. 1485306788 1000 1000 1000 1800 www.apple.com@158.43.240.3 (UUNET (UK)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com. @158.43.240.3 www.apple.com. 800 IN CNAME www.apple.com.edgekey.net. www.apple.com.edgekey.net. 9769 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net. www.apple.com.edgekey.net.globalredir.akadns.net. 2596 IN CNAME e6858.dsce9.akamaiedge.net. dsce9.akamaiedge.net. 129 IN SOA n0dsce9.akamaiedge.net. hostmaster.akamai.com. 1485306620 1000 1000 1000 1800 www.apple.com@64.6.64.6 (Verisign (US)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com. @64.6.64.6 www.apple.com. 1205 IN CNAME www.apple.com.edgekey.net. www.apple.com.edgekey.net. 21323 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net. www.apple.com.edgekey.net.globalredir.akadns.net. 995 IN CNAME e6858.dsce9.akamaiedge.net. dsce9.akamaiedge.net. 681 IN SOA n0dsce9.akamaiedge.net. hostmaster.akamai.com. 1485307172 1000 1000 1000 1800

Yes, i have also seen akamai removing AAAA records today It started at 1:15 pacific and is still going on. CB On Tue, Jan 24, 2017 at 5:31 PM frnkblk--- via Outages <outages@outages.org> wrote:
Starting this afternoon our monitoring system recorded several 5 to 15
minute outages accessing some IPv6-enabled Akamai-delivered sites. In each
case, where I could catch the problem while it happened, I could not resolve
the AAAA to an IPv6 address.
We and our upstream provider have over 10 servers of different flavors, and
they are all exhibiting this issue, though not Google or OpenDNS' servers.
Just two examples are below, but in each case, I get a CNAME back, but it
doesn't show an IPv6 address. And also five from
https://www.digwebinterface.com/?type=SOA&colorize=on&useresolver=8.8.4.4&ns
=all&nameservers. And also here:
https://www.whatsmydns.net/#AAAA/www.apple.com and here
http://www.preshweb.co.uk/cgi-bin/dns-propagation-tracker.pl?domain=www.appl
e.com&type=AAAA&serversmode=random&servers=&nsdomain=
Anyone else seeing the same?
I emailed Akamai's tix address, but have not gotten anything back other than
the auto-responder.
Frank
; <<>> DiG 9.7.3 <<>> AAAA www.apple.com @10.20.0.10
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 9110
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0
;; QUESTION SECTION:
;www.apple.com. IN AAAA
;; ANSWER SECTION:
www.apple.com. 483 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 3193 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 19 IN CNAME
e6858.dsce9.akamaiedge.net.
;; AUTHORITY SECTION:
dsce9.akamaiedge.net. 107 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306230 1000 1000 1000 1800
;; Query time: 0 msec
;; SERVER: 10.20.0.10#53(10.20.0.10)
;; WHEN: Tue Jan 24 19:18:43 2017
;; MSG SIZE rcvd: 228
; <<>> DiG 9.7.3 <<>> AAAA www.apple.com @96.31.0.32
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58259
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0
;; QUESTION SECTION:
;www.apple.com. IN AAAA
;; ANSWER SECTION:
www.apple.com. 1073 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 3584 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 446 IN CNAME
e6858.dsce9.akamaiedge.net.
;; AUTHORITY SECTION:
dsce9.akamaiedge.net. 257 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306380 1000 1000 1000 1800
;; Query time: 0 msec
;; SERVER: 96.31.0.32#53(96.31.0.32)
;; WHEN: Tue Jan 24 19:18:43 2017
;; MSG SIZE rcvd: 228
===============================
https://www.digwebinterface.com/?hostnames=www.apple.com&type=AAAA&showcomma
nd=on&colorize=on&useresolver=8.8.4.4&ns=all&nameservers=
www.apple.com@168.95.1.1 (HiNet (TW)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @168.95.1.1
www.apple.com. 1494 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 6888 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 3289 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 191 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306682 1000 1000 1000 1800
www.apple.com@195.129.12.122 (UUNET (CH)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @195.129.12.122
www.apple.com. 387 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 12797 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 2145 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 159 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306650 1000 1000 1000 1800
www.apple.com@192.76.144.66 (UUNET (DE)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @192.76.144.66
www.apple.com. 1599 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 11114 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 588 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 297 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306788 1000 1000 1000 1800
www.apple.com@158.43.240.3 (UUNET (UK)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @158.43.240.3
www.apple.com. 800 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 9769 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 2596 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 129 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306620 1000 1000 1000 1800
www.apple.com@64.6.64.6 (Verisign (US)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @64.6.64.6
www.apple.com. 1205 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 21323 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 995 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 681 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485307172 1000 1000 1000 1800
_______________________________________________
Outages mailing list
Outages@outages.org

Thanks, now feeling relieved that I’m not going crazy. We saw the first event at 1:07 pm Pacific. Just saw another wave again (www.java.com <http://www.java.com> , www.oracle.com <http://www.oracle.com> , wireless.att.com, www.comcast.net <http://www.comcast.net> , www.apple.com <http://www.apple.com> , www.att.com <http://www.att.com> , www.microsoft.com <http://www.microsoft.com> , etc). Frank From: Ca By [mailto:cb.list6@gmail.com] Sent: Tuesday, January 24, 2017 8:04 PM To: frnkblk@iname.com; outages@outages.org Subject: Re: [outages] Akamai DNS issues Yes, i have also seen akamai removing AAAA records today It started at 1:15 pacific and is still going on. CB On Tue, Jan 24, 2017 at 5:31 PM frnkblk--- via Outages <outages@outages.org <mailto:outages@outages.org> > wrote: Starting this afternoon our monitoring system recorded several 5 to 15 minute outages accessing some IPv6-enabled Akamai-delivered sites. In each case, where I could catch the problem while it happened, I could not resolve the AAAA to an IPv6 address. We and our upstream provider have over 10 servers of different flavors, and they are all exhibiting this issue, though not Google or OpenDNS' servers. Just two examples are below, but in each case, I get a CNAME back, but it doesn't show an IPv6 address. And also five from https://www.digwebinterface.com/?type=SOA <https://www.digwebinterface.com/?type=SOA&colorize=on&useresolver=8.8.4.4&ns=all&nameservers> &colorize=on&useresolver=8.8.4.4&ns =all&nameservers. And also here: https://www.whatsmydns.net/#AAAA/www.apple.com and here http://www.preshweb.co.uk/cgi-bin/dns-propagation-tracker.pl?domain=www.appl <http://www.preshweb.co.uk/cgi-bin/dns-propagation-tracker.pl?domain=www.apple.com&type=AAAA&serversmode=random&servers=&nsdomain=> e.com&type=AAAA&serversmode=random&servers=&nsdomain= Anyone else seeing the same? I emailed Akamai's tix address, but have not gotten anything back other than the auto-responder. Frank ; <<>> DiG 9.7.3 <<>> AAAA www.apple.com <http://www.apple.com> @10.20.0.10 <http://10.20.0.10> ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 9110 ;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0 ;; QUESTION SECTION: ;www.apple.com <http://www.apple.com> . IN AAAA ;; ANSWER SECTION: www.apple.com <http://www.apple.com> . 483 IN CNAME www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . 3193 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . 19 IN CNAME e6858.dsce9.akamaiedge.net <http://e6858.dsce9.akamaiedge.net> . ;; AUTHORITY SECTION: dsce9.akamaiedge.net <http://dsce9.akamaiedge.net> . 107 IN SOA n0dsce9.akamaiedge.net <http://n0dsce9.akamaiedge.net> . hostmaster.akamai.com <http://hostmaster.akamai.com> . 1485306230 1000 1000 1000 1800 ;; Query time: 0 msec ;; SERVER: 10.20.0.10#53(10.20.0.10) ;; WHEN: Tue Jan 24 19:18:43 2017 ;; MSG SIZE rcvd: 228 ; <<>> DiG 9.7.3 <<>> AAAA www.apple.com <http://www.apple.com> @96.31.0.32 <http://96.31.0.32> ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58259 ;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0 ;; QUESTION SECTION: ;www.apple.com <http://www.apple.com> . IN AAAA ;; ANSWER SECTION: www.apple.com <http://www.apple.com> . 1073 IN CNAME www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . 3584 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . 446 IN CNAME e6858.dsce9.akamaiedge.net <http://e6858.dsce9.akamaiedge.net> . ;; AUTHORITY SECTION: dsce9.akamaiedge.net <http://dsce9.akamaiedge.net> . 257 IN SOA n0dsce9.akamaiedge.net <http://n0dsce9.akamaiedge.net> . hostmaster.akamai.com. 1485306380 1000 1000 1000 1800 ;; Query time: 0 msec ;; SERVER: 96.31.0.32#53(96.31.0.32) ;; WHEN: Tue Jan 24 19:18:43 2017 ;; MSG SIZE rcvd: 228 =============================== https://www.digwebinterface.com/?hostnames=www.apple.com <https://www.digwebinterface.com/?hostnames=www.apple.com&type=AAAA&showcommand=on&colorize=on&useresolver=8.8.4.4&ns=all&nameservers=> &type=AAAA&showcomma nd=on&colorize=on&useresolver=8.8.4.4&ns=all&nameservers= www.apple.com@168.95.1.1 <mailto:www.apple.com@168.95.1.1> (HiNet (TW)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com <http://www.apple.com> . @168.95.1.1 <http://168.95.1.1> www.apple.com <http://www.apple.com> . 1494 IN CNAME www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . 6888 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . 3289 IN CNAME e6858.dsce9.akamaiedge.net <http://e6858.dsce9.akamaiedge.net> . dsce9.akamaiedge.net <http://dsce9.akamaiedge.net> . 191 IN SOA n0dsce9.akamaiedge.net <http://n0dsce9.akamaiedge.net> . hostmaster.akamai.com <http://hostmaster.akamai.com> . 1485306682 1000 1000 1000 1800 www.apple.com@195.129.12.122 <mailto:www.apple.com@195.129.12.122> (UUNET (CH)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com <http://www.apple.com> . @195.129.12.122 <http://195.129.12.122> www.apple.com <http://www.apple.com> . 387 IN CNAME www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . 12797 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . www.apple.com.edgekey.net.globalredir.akadns.net. 2145 IN CNAME e6858.dsce9.akamaiedge.net <http://e6858.dsce9.akamaiedge.net> . dsce9.akamaiedge.net <http://dsce9.akamaiedge.net> . 159 IN SOA n0dsce9.akamaiedge.net <http://n0dsce9.akamaiedge.net> . hostmaster.akamai.com <http://hostmaster.akamai.com> . 1485306650 1000 1000 1000 1800 www.apple.com@192.76.144.66 <mailto:www.apple.com@192.76.144.66> (UUNET (DE)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com <http://www.apple.com> . @192.76.144.66 <http://192.76.144.66> www.apple.com <http://www.apple.com> . 1599 IN CNAME www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . 11114 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . 588 IN CNAME e6858.dsce9.akamaiedge.net <http://e6858.dsce9.akamaiedge.net> . dsce9.akamaiedge.net <http://dsce9.akamaiedge.net> . 297 IN SOA n0dsce9.akamaiedge.net <http://n0dsce9.akamaiedge.net> . hostmaster.akamai.com <http://hostmaster.akamai.com> . 1485306788 1000 1000 1000 1800 www.apple.com@158.43.240.3 <mailto:www.apple.com@158.43.240.3> (UUNET (UK)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com <http://www.apple.com> . @158.43.240.3 <http://158.43.240.3> www.apple.com <http://www.apple.com> . 800 IN CNAME www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . 9769 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . 2596 IN CNAME e6858.dsce9.akamaiedge.net <http://e6858.dsce9.akamaiedge.net> . dsce9.akamaiedge.net <http://dsce9.akamaiedge.net> . 129 IN SOA n0dsce9.akamaiedge.net <http://n0dsce9.akamaiedge.net> . hostmaster.akamai.com <http://hostmaster.akamai.com> . 1485306620 1000 1000 1000 1800 www.apple.com@64.6.64.6 <mailto:www.apple.com@64.6.64.6> (Verisign (US)): dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats www.apple.com <http://www.apple.com> . @64.6.64.6 <http://64.6.64.6> www.apple.com <http://www.apple.com> . 1205 IN CNAME www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . www.apple.com.edgekey.net <http://www.apple.com.edgekey.net> . 21323 IN CNAME www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . www.apple.com.edgekey.net.globalredir.akadns.net <http://www.apple.com.edgekey.net.globalredir.akadns.net> . 995 IN CNAME e6858.dsce9.akamaiedge.net <http://e6858.dsce9.akamaiedge.net> . dsce9.akamaiedge.net <http://dsce9.akamaiedge.net> . 681 IN SOA n0dsce9.akamaiedge.net <http://n0dsce9.akamaiedge.net> . hostmaster.akamai.com <http://hostmaster.akamai.com> . 1485307172 1000 1000 1000 1800 _______________________________________________ Outages mailing list Outages@outages.org <mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

They seem to be back, but I’m curious as to what is going on. - Jared
On Jan 24, 2017, at 9:32 PM, frnkblk--- via Outages <outages@outages.org> wrote:
Thanks, now feeling relieved that I’m not going crazy. We saw the first event at 1:07 pm Pacific.
Just saw another wave again (www.java.com, www.oracle.com, wireless.att.com, www.comcast.net, www.apple.com, www.att.com, www.microsoft.com, etc).
Frank
From: Ca By [mailto:cb.list6@gmail.com] Sent: Tuesday, January 24, 2017 8:04 PM To: frnkblk@iname.com; outages@outages.org Subject: Re: [outages] Akamai DNS issues
Yes, i have also seen akamai removing AAAA records today
It started at 1:15 pacific and is still going on.
CB
On Tue, Jan 24, 2017 at 5:31 PM frnkblk--- via Outages <outages@outages.org> wrote:
Starting this afternoon our monitoring system recorded several 5 to 15
minute outages accessing some IPv6-enabled Akamai-delivered sites. In each
case, where I could catch the problem while it happened, I could not resolve
the AAAA to an IPv6 address.
We and our upstream provider have over 10 servers of different flavors, and
they are all exhibiting this issue, though not Google or OpenDNS' servers.
Just two examples are below, but in each case, I get a CNAME back, but it
doesn't show an IPv6 address. And also five from
https://www.digwebinterface.com/?type=SOA&colorize=on&useresolver=8.8.4.4&ns
=all&nameservers. And also here:
https://www.whatsmydns.net/#AAAA/www.apple.com and here
http://www.preshweb.co.uk/cgi-bin/dns-propagation-tracker.pl?domain=www.appl
e.com&type=AAAA&serversmode=random&servers=&nsdomain=
Anyone else seeing the same?
I emailed Akamai's tix address, but have not gotten anything back other than
the auto-responder.
Frank
; <<>> DiG 9.7.3 <<>> AAAA www.apple.com @10.20.0.10
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 9110
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0
;; QUESTION SECTION:
;www.apple.com. IN AAAA
;; ANSWER SECTION:
www.apple.com. 483 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 3193 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 19 IN CNAME
e6858.dsce9.akamaiedge.net.
;; AUTHORITY SECTION:
dsce9.akamaiedge.net. 107 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306230 1000 1000 1000 1800
;; Query time: 0 msec
;; SERVER: 10.20.0.10#53(10.20.0.10)
;; WHEN: Tue Jan 24 19:18:43 2017
;; MSG SIZE rcvd: 228
; <<>> DiG 9.7.3 <<>> AAAA www.apple.com @96.31.0.32
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58259
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0
;; QUESTION SECTION:
;www.apple.com. IN AAAA
;; ANSWER SECTION:
www.apple.com. 1073 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 3584 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 446 IN CNAME
e6858.dsce9.akamaiedge.net.
;; AUTHORITY SECTION:
dsce9.akamaiedge.net. 257 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306380 1000 1000 1000 1800
;; Query time: 0 msec
;; SERVER: 96.31.0.32#53(96.31.0.32)
;; WHEN: Tue Jan 24 19:18:43 2017
;; MSG SIZE rcvd: 228
===============================
https://www.digwebinterface.com/?hostnames=www.apple.com&type=AAAA&showcomma
nd=on&colorize=on&useresolver=8.8.4.4&ns=all&nameservers=
www.apple.com@168.95.1.1 (HiNet (TW)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @168.95.1.1
www.apple.com. 1494 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 6888 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 3289 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 191 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306682 1000 1000 1000 1800
www.apple.com@195.129.12.122 (UUNET (CH)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @195.129.12.122
www.apple.com. 387 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 12797 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 2145 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 159 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306650 1000 1000 1000 1800
www.apple.com@192.76.144.66 (UUNET (DE)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @192.76.144.66
www.apple.com. 1599 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 11114 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 588 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 297 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306788 1000 1000 1000 1800
www.apple.com@158.43.240.3 (UUNET (UK)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @158.43.240.3
www.apple.com. 800 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 9769 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 2596 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 129 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306620 1000 1000 1000 1800
www.apple.com@64.6.64.6 (Verisign (US)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @64.6.64.6
www.apple.com. 1205 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 21323 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 995 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 681 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485307172 1000 1000 1000 1800
_______________________________________________
Outages mailing list
Outages@outages.org
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Yes, it's in and out. Currently it's www.java.com (from our perspective). Note that we monitor probably just a very small fraction of Akamai's dual-stacked sites, so why some sites "lose" their AAAA is a mystery to me. They have a relatively short TTL, backend issues can get exposed pretty quickly. Due to HE, this is probably not visible to most end-users. Frank -----Original Message----- From: Jared Mauch [mailto:jared@puck.nether.net] Sent: Tuesday, January 24, 2017 9:52 PM To: Frank Bulk <frnkblk@iname.com> Cc: Ca By <cb.list6@gmail.com>; outages@outages.org Subject: Re: [outages] Akamai DNS issues They seem to be back, but I’m curious as to what is going on. - Jared
On Jan 24, 2017, at 9:32 PM, frnkblk--- via Outages <outages@outages.org> wrote:
Thanks, now feeling relieved that I’m not going crazy. We saw the first event at 1:07 pm Pacific.
Just saw another wave again (www.java.com, www.oracle.com, wireless.att.com, www.comcast.net, www.apple.com, www.att.com, www.microsoft.com, etc).
Frank
From: Ca By [mailto:cb.list6@gmail.com] Sent: Tuesday, January 24, 2017 8:04 PM To: frnkblk@iname.com; outages@outages.org Subject: Re: [outages] Akamai DNS issues
Yes, i have also seen akamai removing AAAA records today
It started at 1:15 pacific and is still going on.
CB
On Tue, Jan 24, 2017 at 5:31 PM frnkblk--- via Outages <outages@outages.org> wrote:
Starting this afternoon our monitoring system recorded several 5 to 15
minute outages accessing some IPv6-enabled Akamai-delivered sites. In each
case, where I could catch the problem while it happened, I could not resolve
the AAAA to an IPv6 address.
We and our upstream provider have over 10 servers of different flavors, and
they are all exhibiting this issue, though not Google or OpenDNS' servers.
Just two examples are below, but in each case, I get a CNAME back, but it
doesn't show an IPv6 address. And also five from
https://www.digwebinterface.com/?type=SOA&colorize=on&useresolver=8.8.4.4&ns
=all&nameservers. And also here:
https://www.whatsmydns.net/#AAAA/www.apple.com and here
http://www.preshweb.co.uk/cgi-bin/dns-propagation-tracker.pl?domain=www.appl
e.com&type=AAAA&serversmode=random&servers=&nsdomain=
Anyone else seeing the same?
I emailed Akamai's tix address, but have not gotten anything back other than
the auto-responder.
Frank
; <<>> DiG 9.7.3 <<>> AAAA www.apple.com @10.20.0.10
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 9110
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0
;; QUESTION SECTION:
;www.apple.com. IN AAAA
;; ANSWER SECTION:
www.apple.com. 483 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 3193 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 19 IN CNAME
e6858.dsce9.akamaiedge.net.
;; AUTHORITY SECTION:
dsce9.akamaiedge.net. 107 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306230 1000 1000 1000 1800
;; Query time: 0 msec
;; SERVER: 10.20.0.10#53(10.20.0.10)
;; WHEN: Tue Jan 24 19:18:43 2017
;; MSG SIZE rcvd: 228
; <<>> DiG 9.7.3 <<>> AAAA www.apple.com @96.31.0.32
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58259
;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 1, ADDITIONAL: 0
;; QUESTION SECTION:
;www.apple.com. IN AAAA
;; ANSWER SECTION:
www.apple.com. 1073 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 3584 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 446 IN CNAME
e6858.dsce9.akamaiedge.net.
;; AUTHORITY SECTION:
dsce9.akamaiedge.net. 257 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306380 1000 1000 1000 1800
;; Query time: 0 msec
;; SERVER: 96.31.0.32#53(96.31.0.32)
;; WHEN: Tue Jan 24 19:18:43 2017
;; MSG SIZE rcvd: 228
===============================
https://www.digwebinterface.com/?hostnames=www.apple.com&type=AAAA&showcomma
nd=on&colorize=on&useresolver=8.8.4.4&ns=all&nameservers=
www.apple.com@168.95.1.1 (HiNet (TW)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @168.95.1.1
www.apple.com. 1494 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 6888 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 3289 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 191 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306682 1000 1000 1000 1800
www.apple.com@195.129.12.122 (UUNET (CH)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @195.129.12.122
www.apple.com. 387 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 12797 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 2145 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 159 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306650 1000 1000 1000 1800
www.apple.com@192.76.144.66 (UUNET (DE)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @192.76.144.66
www.apple.com. 1599 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 11114 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 588 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 297 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306788 1000 1000 1000 1800
www.apple.com@158.43.240.3 (UUNET (UK)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @158.43.240.3
www.apple.com. 800 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 9769 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 2596 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 129 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485306620 1000 1000 1000 1800
www.apple.com@64.6.64.6 (Verisign (US)):
dig AAAA +noadditional +noquestion +nocomments +nocmd +nostats
www.apple.com. @64.6.64.6
www.apple.com. 1205 IN CNAME www.apple.com.edgekey.net.
www.apple.com.edgekey.net. 21323 IN CNAME
www.apple.com.edgekey.net.globalredir.akadns.net.
www.apple.com.edgekey.net.globalredir.akadns.net. 995 IN CNAME
e6858.dsce9.akamaiedge.net.
dsce9.akamaiedge.net. 681 IN SOA n0dsce9.akamaiedge.net.
hostmaster.akamai.com. 1485307172 1000 1000 1000 1800
_______________________________________________
Outages mailing list
Outages@outages.org
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Hi all, On Jan 24, 2017, at 11:03 PM, frnkblk--- via Outages <outages@outages.org> wrote:
Yes, it's in and out. Currently it's www.java.com (from our perspective). Note that we monitor probably just a very small fraction of Akamai's dual-stacked sites, so why some sites "lose" their AAAA is a mystery to me. They have a relatively short TTL, backend issues can get exposed pretty quickly.
We indeed just resolved an issue wherein we mistakenly answered noanswer/noerror for AAAA requests on some of our dual-stacked sites from some of our authorities starting yesterday the 24th at 21:00 UTC and ending today, the 25th, at 04:15 UTC. We did not have any issue returning A records during the timeframe and believe that recursives were able to resolve a corresponding A record for these dual-stacked sites throughout. Cheers, Matthew LeBourgeois Principal Performance Engineer Akamai Technologies, Inc.
participants (4)
-
Ca By
-
frnkblk@iname.com
-
Jared Mauch
-
LeBourgeois, Matthew