Google Public DNS is down in south-east asia

Google Public DNS just stopped working for me (and many others locally). xxx@xxx:~# dig google.com @8.8.8.8 ; <<>> DiG 9.8.4-rpz2+rl005.12-P1 <<>> google.com @8.8.8.8 ;; global options: +cmd ;; connection timed out; no servers could be reached xxx@xxx:~# Traces from few locations. True ADSL (Thailand) xxx@xxx:~# mtr --report 8.8.8.8 HOST: xxx Loss% Snt Last Avg Best Wrst StDev 1.|-- 192.168.1.1 0.0% 10 30.5 17.4 0.8 57.5 22.5 2.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 3.|-- 10.169.212.9 0.0% 10 23.3 24.0 23.3 25.0 0.6 4.|-- 10.100.50.67 0.0% 10 24.0 24.3 23.7 25.1 0.5 5.|-- 58.97.121.81 0.0% 10 25.4 25.1 24.5 25.6 0.4 6.|-- 61.91.213.177 0.0% 10 24.6 25.0 24.6 25.6 0.3 7.|-- 61.91.213.36 0.0% 10 26.1 25.9 25.4 26.4 0.3 8.|-- 61.91.213.130 0.0% 10 25.5 26.0 25.1 27.3 0.6 9.|-- 113.21.242.53 0.0% 10 27.0 26.5 25.1 28.2 1.0 10.|-- 72.14.210.155 0.0% 10 49.1 52.2 48.1 80.4 9.9 11.|-- 209.85.242.244 0.0% 10 54.6 53.6 50.0 60.9 4.1 12.|-- 72.14.239.201 0.0% 10 85.6 85.7 80.2 100.8 6.5 13.|-- 209.85.250.11 0.0% 10 107.2 107.7 106.7 109.7 0.9 * 14.|-- 209.85.243.21 0.0% 10 109.6 110.4 109.5 111.3 0.6* 15.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 xxx@xxx:~# Digital Ocean (Singapore) xxx@xxx:~# mtr --report 8.8.8.8 Start: Mon Oct 13 07:18:28 2014 HOST: xxx Loss% Snt Last Avg Best Wrst StDev 1.|-- a.b.c.d 0.0% 10 0.6 1.6 0.5 6.0 2.1 2.|-- 103.253.144.241 0.0% 10 0.4 0.5 0.4 0.6 0.0 3.|-- 103.16.102.64 0.0% 10 1.8 2.0 1.7 3.4 0.3 4.|-- 66.249.95.122 0.0% 10 2.1 2.1 2.0 2.3 0.0 5.|-- 209.85.241.149 0.0% 10 54.5 56.1 54.3 61.8 2.5 * 6.|-- 72.14.237.179 0.0% 10 58.0 58.1 57.9 59.2 0.0* 7.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 xxx@xxx:~# EC2 (Singapore) xxx@xxx:~$ mtr --report 8.8.8.8 HOST: xxx Loss% Snt Last Avg Best Wrst StDev 1.|-- ip-10-a-b-2.ap-southea 0.0% 10 0.6 0.6 0.3 1.5 0.4 2.|-- ip-10-1-16-0.ap-southeast 0.0% 10 6.1 1.6 0.5 6.1 1.8 3.|-- 100.64.12.131 0.0% 10 17.8 3.8 1.0 17.8 5.7 4.|-- ec2-175-41-128-232.ap-sou 0.0% 10 0.8 0.6 0.5 0.9 0.1 5.|-- 203.83.223.230 0.0% 10 0.6 1.0 0.4 2.3 0.7 6.|-- 203.83.223.14 0.0% 10 1.5 1.6 1.4 2.4 0.3 7.|-- 203.83.223.57 0.0% 10 1.7 1.8 1.5 2.4 0.2 8.|-- 198.32.141.140 0.0% 10 1.5 1.7 1.4 3.2 0.5 9.|-- 66.249.95.122 0.0% 10 2.9 5.4 2.2 14.7 4.8 10.|-- 209.85.241.149 0.0% 10 54.2 57.7 54.0 76.5 7.6 11.|-- 209.85.243.23 0.0% 10 57.9 60.1 57.7 79.4 6.8 12.|-- 72.14.238.8 0.0% 10 58.9 59.3 58.8 62.5 1.1 * 13.|-- 72.14.237.179 0.0% 10 63.0 65.3 62.8 79.2 5.4* 14.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 xxx@xxx:~$

Works fine now as of 11:29 UTC. The first i noticed any issues was at ~11:12 UTC (i was offline before then). Someone else indicated that the outage lasted ~33 minutes. On Mon, Oct 13, 2014 at 6:25 PM, Sajal Kayan <sajal83@gmail.com> wrote:
Google Public DNS just stopped working for me (and many others locally).
xxx@xxx:~# dig google.com @8.8.8.8
; <<>> DiG 9.8.4-rpz2+rl005.12-P1 <<>> google.com @8.8.8.8 ;; global options: +cmd ;; connection timed out; no servers could be reached xxx@xxx:~#
Traces from few locations.
True ADSL (Thailand)
xxx@xxx:~# mtr --report 8.8.8.8 HOST: xxx Loss% Snt Last Avg Best Wrst StDev 1.|-- 192.168.1.1 0.0% 10 30.5 17.4 0.8 57.5 22.5 2.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 3.|-- 10.169.212.9 0.0% 10 23.3 24.0 23.3 25.0 0.6 4.|-- 10.100.50.67 0.0% 10 24.0 24.3 23.7 25.1 0.5 5.|-- 58.97.121.81 0.0% 10 25.4 25.1 24.5 25.6 0.4 6.|-- 61.91.213.177 0.0% 10 24.6 25.0 24.6 25.6 0.3 7.|-- 61.91.213.36 0.0% 10 26.1 25.9 25.4 26.4 0.3 8.|-- 61.91.213.130 0.0% 10 25.5 26.0 25.1 27.3 0.6 9.|-- 113.21.242.53 0.0% 10 27.0 26.5 25.1 28.2 1.0 10.|-- 72.14.210.155 0.0% 10 49.1 52.2 48.1 80.4 9.9 11.|-- 209.85.242.244 0.0% 10 54.6 53.6 50.0 60.9 4.1 12.|-- 72.14.239.201 0.0% 10 85.6 85.7 80.2 100.8 6.5 13.|-- 209.85.250.11 0.0% 10 107.2 107.7 106.7 109.7 0.9 * 14.|-- 209.85.243.21 0.0% 10 109.6 110.4 109.5 111.3 0.6* 15.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 xxx@xxx:~#
Digital Ocean (Singapore)
xxx@xxx:~# mtr --report 8.8.8.8 Start: Mon Oct 13 07:18:28 2014 HOST: xxx Loss% Snt Last Avg Best Wrst StDev 1.|-- a.b.c.d 0.0% 10 0.6 1.6 0.5 6.0 2.1 2.|-- 103.253.144.241 0.0% 10 0.4 0.5 0.4 0.6 0.0 3.|-- 103.16.102.64 0.0% 10 1.8 2.0 1.7 3.4 0.3 4.|-- 66.249.95.122 0.0% 10 2.1 2.1 2.0 2.3 0.0 5.|-- 209.85.241.149 0.0% 10 54.5 56.1 54.3 61.8 2.5 * 6.|-- 72.14.237.179 0.0% 10 58.0 58.1 57.9 59.2 0.0* 7.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 xxx@xxx:~#
EC2 (Singapore)
xxx@xxx:~$ mtr --report 8.8.8.8 HOST: xxx Loss% Snt Last Avg Best Wrst StDev 1.|-- ip-10-a-b-2.ap-southea 0.0% 10 0.6 0.6 0.3 1.5 0.4 2.|-- ip-10-1-16-0.ap-southeast 0.0% 10 6.1 1.6 0.5 6.1 1.8 3.|-- 100.64.12.131 0.0% 10 17.8 3.8 1.0 17.8 5.7 4.|-- ec2-175-41-128-232.ap-sou 0.0% 10 0.8 0.6 0.5 0.9 0.1 5.|-- 203.83.223.230 0.0% 10 0.6 1.0 0.4 2.3 0.7 6.|-- 203.83.223.14 0.0% 10 1.5 1.6 1.4 2.4 0.3 7.|-- 203.83.223.57 0.0% 10 1.7 1.8 1.5 2.4 0.2 8.|-- 198.32.141.140 0.0% 10 1.5 1.7 1.4 3.2 0.5 9.|-- 66.249.95.122 0.0% 10 2.9 5.4 2.2 14.7 4.8 10.|-- 209.85.241.149 0.0% 10 54.2 57.7 54.0 76.5 7.6 11.|-- 209.85.243.23 0.0% 10 57.9 60.1 57.7 79.4 6.8 12.|-- 72.14.238.8 0.0% 10 58.9 59.3 58.8 62.5 1.1 * 13.|-- 72.14.237.179 0.0% 10 63.0 65.3 62.8 79.2 5.4* 14.|-- ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 xxx@xxx:~$

On Oct 13, 2014, at 6:34 PM, Sajal Kayan via Outages <outages@outages.org> wrote:
The first i noticed any issues was at ~11:12 UTC (i was offline before then). Someone else indicated that the outage lasted ~33 minutes.
This was seen in Australia, as well, same approximate times and duration. ---------------------------------------------------------------------- Roland Dobbins <rdobbins@arbor.net> // <http://www.arbornetworks.com> Equo ne credite, Teucri. -- Laocoön

Yep, I can confirm down from Indonesia. Thank you Budiwijaya -----Original Message----- From: Roland Dobbins via Outages <outages@outages.org> Sender: "Outages" <outages-bounces@outages.org>Date: Mon, 13 Oct 2014 18:45:19 To: OUTAGES Mailing List<outages@outages.org> Reply-To: Roland Dobbins <rdobbins@arbor.net> Subject: Re: [outages] Google Public DNS is down in south-east asia On Oct 13, 2014, at 6:34 PM, Sajal Kayan via Outages <outages@outages.org> wrote:
The first i noticed any issues was at ~11:12 UTC (i was offline before then). Someone else indicated that the outage lasted ~33 minutes.
This was seen in Australia, as well, same approximate times and duration. ---------------------------------------------------------------------- Roland Dobbins <rdobbins@arbor.net> // <http://www.arbornetworks.com> Equo ne credite, Teucri. -- Laocoön _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

I'm showing 35 minute outage in Australia 10:53 - 11:28. Prior to the outage I was seeing ~1 msec latency, now its ~160 msec. On Mon, Oct 13, 2014 at 7:45 AM, Roland Dobbins via Outages < outages@outages.org> wrote:
On Oct 13, 2014, at 6:34 PM, Sajal Kayan via Outages <outages@outages.org> wrote:
The first i noticed any issues was at ~11:12 UTC (i was offline before then). Someone else indicated that the outage lasted ~33 minutes.
This was seen in Australia, as well, same approximate times and duration.
---------------------------------------------------------------------- Roland Dobbins <rdobbins@arbor.net> // <http://www.arbornetworks.com>
Equo ne credite, Teucri.
-- Laocoön
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

On Mon, Oct 13, 2014 at 8:25 PM, Sajal Kayan via Outages <outages@outages.org> wrote:
Google Public DNS just stopped working for me (and many others locally).
1 hour ago, I could not but now I can. $ dig @8.8.8.8 ox.ac.uk ; <<>> DiG 9.8.3-P1 <<>> @8.8.8.8 ox.ac.uk ; (1 server found) ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 52315 ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;ox.ac.uk. IN A ;; ANSWER SECTION: ox.ac.uk. 299 IN A 129.67.242.155 ox.ac.uk. 299 IN A 129.67.242.154 ;; Query time: 301 msec ;; SERVER: 8.8.8.8#53(8.8.8.8) ;; WHEN: Mon Oct 13 21:00:29 2014 ;; MSG SIZE rcvd: 58 $ dig @8.8.4.4 ox.ac.uk ; <<>> DiG 9.8.3-P1 <<>> @8.8.4.4 ox.ac.uk ; (1 server found) ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 11820 ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 0 ;; QUESTION SECTION: ;ox.ac.uk. IN A ;; ANSWER SECTION: ox.ac.uk. 295 IN A 129.67.242.155 ox.ac.uk. 295 IN A 129.67.242.154 ;; Query time: 153 msec ;; SERVER: 8.8.4.4#53(8.8.4.4) ;; WHEN: Mon Oct 13 21:00:33 2014 ;; MSG SIZE rcvd: 58 traceroute -a 8.8.8.8 traceroute to 8.8.8.8 (8.8.8.8), 64 hops max, 52 byte packets 1 [AS0] web.setup (192.168.0.1) 0.996 ms 0.631 ms 0.895 ms 2 [AS2516] kd125053000065.ppp-bb.dion.ne.jp (125.53.0.65) 4.534 ms 2.726 ms 4.085 ms 3 [AS2516] sjk-tpcfujisawaml02.bb.kddi.ne.jp (125.48.118.22) 2.690 ms 2.900 ms 2.328 ms 4 [AS2516] knwbbml304.bb.kddi.ne.jp (118.152.208.130) 2.571 ms 3.320 ms 3.420 ms 5 [AS2516] sjkbbac08.bb.kddi.ne.jp (118.152.210.41) 4.696 ms 4.495 ms 3.820 ms 6 [AS2516] otejbb206.int-gw.kddi.ne.jp (106.162.175.165) 4.638 ms [AS2516] otejbb206.int-gw.kddi.ne.jp (106.162.175.157) 6.651 ms [AS2516] otejbb206.int-gw.kddi.ne.jp (106.162.175.61) 6.526 ms 7 [AS2516] ix-ote213.int-gw.kddi.ne.jp (59.128.5.98) 4.141 ms [AS2516] ix-ote213.int-gw.kddi.ne.jp (59.128.5.90) 4.131 ms [AS2516] ix-ote213.int-gw.kddi.ne.jp (59.128.5.190) 3.914 ms 8 [AS15169] 72.14.216.194 (72.14.216.194) 49.987 ms 61.402 ms 56.666 ms 9 [AS15169] 209.85.243.58 (209.85.243.58) 4.435 ms [AS15169] 209.85.243.56 (209.85.243.56) 4.961 ms 10.377 ms 10 [AS15169] 209.85.255.34 (209.85.255.34) 17.715 ms 7.366 ms [AS15169] 66.249.94.80 (66.249.94.80) 12.641 ms 11 [AS15169] 209.85.246.177 (209.85.246.177) 91.113 ms [AS15169] 209.85.246.233 (209.85.246.233) 92.895 ms [AS15169] 209.85.246.177 (209.85.246.177) 90.355 ms 12 [AS15169] 72.14.233.138 (72.14.233.138) 94.938 ms [AS15169] 72.14.233.202 (72.14.233.202) 96.500 ms [AS15169] 216.239.46.210 (216.239.46.210) 96.708 ms 13 [AS15169] 216.239.46.171 (216.239.46.171) 99.296 ms 99.273 ms [AS15169] 216.239.46.195 (216.239.46.195) 95.379 ms best regards, -dikshie-

Thanks for the report. Google Public DNS experienced an outage in Asia region for about 30 minutes around 11:00 UTC. The outage has been resolved. Yunhong (from Google Public DNS) On Mon, Oct 13, 2014 at 8:04 AM, dikshie via Outages <outages@outages.org> wrote:
On Mon, Oct 13, 2014 at 8:25 PM, Sajal Kayan via Outages <outages@outages.org> wrote:
Google Public DNS just stopped working for me (and many others locally).
1 hour ago, I could not but now I can.
$ dig @8.8.8.8 ox.ac.uk
; <<>> DiG 9.8.3-P1 <<>> @8.8.8.8 ox.ac.uk ; (1 server found) ;; global options: +cmd ;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 52315 ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;ox.ac.uk. IN A
;; ANSWER SECTION: ox.ac.uk. 299 IN A 129.67.242.155 ox.ac.uk. 299 IN A 129.67.242.154
;; Query time: 301 msec ;; SERVER: 8.8.8.8#53(8.8.8.8) ;; WHEN: Mon Oct 13 21:00:29 2014 ;; MSG SIZE rcvd: 58
$ dig @8.8.4.4 ox.ac.uk
; <<>> DiG 9.8.3-P1 <<>> @8.8.4.4 ox.ac.uk
; (1 server found) ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 11820 ;; flags: qr rd ra; QUERY: 1, ANSWER: 2, AUTHORITY: 0, ADDITIONAL: 0
;; QUESTION SECTION: ;ox.ac.uk. IN A
;; ANSWER SECTION: ox.ac.uk. 295 IN A 129.67.242.155 ox.ac.uk. 295 IN A 129.67.242.154
;; Query time: 153 msec ;; SERVER: 8.8.4.4#53(8.8.4.4) ;; WHEN: Mon Oct 13 21:00:33 2014 ;; MSG SIZE rcvd: 58
traceroute -a 8.8.8.8
traceroute to 8.8.8.8 (8.8.8.8), 64 hops max, 52 byte packets
1 [AS0] web.setup (192.168.0.1) 0.996 ms 0.631 ms 0.895 ms 2 [AS2516] kd125053000065.ppp-bb.dion.ne.jp (125.53.0.65) 4.534 ms 2.726 ms 4.085 ms 3 [AS2516] sjk-tpcfujisawaml02.bb.kddi.ne.jp (125.48.118.22) 2.690 ms 2.900 ms 2.328 ms 4 [AS2516] knwbbml304.bb.kddi.ne.jp (118.152.208.130) 2.571 ms 3.320 ms 3.420 ms 5 [AS2516] sjkbbac08.bb.kddi.ne.jp (118.152.210.41) 4.696 ms 4.495 ms 3.820 ms 6 [AS2516] otejbb206.int-gw.kddi.ne.jp (106.162.175.165) 4.638 ms [AS2516] otejbb206.int-gw.kddi.ne.jp (106.162.175.157) 6.651 ms [AS2516] otejbb206.int-gw.kddi.ne.jp (106.162.175.61) 6.526 ms 7 [AS2516] ix-ote213.int-gw.kddi.ne.jp (59.128.5.98) 4.141 ms [AS2516] ix-ote213.int-gw.kddi.ne.jp (59.128.5.90) 4.131 ms [AS2516] ix-ote213.int-gw.kddi.ne.jp (59.128.5.190) 3.914 ms 8 [AS15169] 72.14.216.194 (72.14.216.194) 49.987 ms 61.402 ms 56.666 ms 9 [AS15169] 209.85.243.58 (209.85.243.58) 4.435 ms [AS15169] 209.85.243.56 (209.85.243.56) 4.961 ms 10.377 ms 10 [AS15169] 209.85.255.34 (209.85.255.34) 17.715 ms 7.366 ms [AS15169] 66.249.94.80 (66.249.94.80) 12.641 ms 11 [AS15169] 209.85.246.177 (209.85.246.177) 91.113 ms [AS15169] 209.85.246.233 (209.85.246.233) 92.895 ms [AS15169] 209.85.246.177 (209.85.246.177) 90.355 ms 12 [AS15169] 72.14.233.138 (72.14.233.138) 94.938 ms [AS15169] 72.14.233.202 (72.14.233.202) 96.500 ms [AS15169] 216.239.46.210 (216.239.46.210) 96.708 ms 13 [AS15169] 216.239.46.171 (216.239.46.171) 99.296 ms 99.273 ms [AS15169] 216.239.46.195 (216.239.46.195) 95.379 ms
best regards,
-dikshie- _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (6)
-
bbuuddiiww@gmail.com
-
dikshie
-
Justin
-
Roland Dobbins
-
Sajal Kayan
-
Yunhong Gu