Cisco is reporting WebEx isn't just down for us, it's down for everyone. Anyone know what is going on?
Their DNS is broken - www.webex.com and other hosts in that domain are not resolving for me. Webex'es in progress appear to still be working, but with severe performance problems for about the past ~15-20 minutes. $ nslookup www.webex.com 8.8.8.8 Server: 8.8.8.8 Address: 8.8.8.8#53 ** server can't find www.webex.com: NXDOMAIN Scott On Thu, Feb 13, 2014 at 10:58 AM, Crist Clark <cjc+outages@pumpky.net>wrote:
Cisco is reporting WebEx isn't just down for us, it's down for everyone. Anyone know what is going on?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Looks to be back now, pending DNS caches caching the NXDOMAIN longer than the 2 minutes in the SOA. Scott On Thu, Feb 13, 2014 at 11:02 AM, Scott Howard <scott@doc.net.au> wrote:
Their DNS is broken - www.webex.com and other hosts in that domain are not resolving for me.
Webex'es in progress appear to still be working, but with severe performance problems for about the past ~15-20 minutes.
$ nslookup www.webex.com 8.8.8.8 Server: 8.8.8.8 Address: 8.8.8.8#53
** server can't find www.webex.com: NXDOMAIN
Scott
On Thu, Feb 13, 2014 at 10:58 AM, Crist Clark <cjc+outages@pumpky.net>wrote:
Cisco is reporting WebEx isn't just down for us, it's down for everyone. Anyone know what is going on?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Looks like the’ve got it back up and running now. I can confirm it was down for a good bit there. ; <<>> DiG 9.8.3-P1 <<>> NX www.webex.com ;; global options: +cmd ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NXDOMAIN, id: 57811 ;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 1, ADDITIONAL: 0 ;; QUESTION SECTION: ;NX. IN A ;; AUTHORITY SECTION: . 10792 IN SOA a.root-servers.net. nstld.verisign-grs.com. 2014021301 1800 900 604800 86400 ;; Query time: 1 msec ;; SERVER: 10.0.1.28#53(10.0.1.28) ;; WHEN: Thu Feb 13 13:07:14 2014 ;; MSG SIZE rcvd: 95 ;; Got answer: ;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 17023 ;; flags: qr rd ra; QUERY: 1, ANSWER: 3, AUTHORITY: 2, ADDITIONAL: 2 ;; QUESTION SECTION: ;www.webex.com. IN A ;; ANSWER SECTION: www.webex.com. 60 IN CNAME wwwprodvm.webex.com. wwwprodvm.webex.com. 600 IN CNAME global-wwwprodvm.webex.com. global-wwwprodvm.webex.com. 10 IN A 173.243.5.18 ;; AUTHORITY SECTION: global-wwwprodvm.webex.com. 60 IN NS sjc02-wxif-gss02.webex.com. global-wwwprodvm.webex.com. 60 IN NS iad02-wxif-gss02.webex.com. ;; ADDITIONAL SECTION: iad02-wxif-gss02.webex.com. 600 IN A 64.68.114.40 sjc02-wxif-gss02.webex.com. 600 IN A 64.68.114.9 ;; Query time: 198 msec ;; SERVER: 10.0.1.28#53(10.0.1.28) ;; WHEN: Thu Feb 13 13:07:14 2014 ;; MSG SIZE rcvd: 196 On Feb 13, 2014, at 1:02 PM, Scott Howard <scott@doc.net.au> wrote:
Their DNS is broken - www.webex.com and other hosts in that domain are not resolving for me.
Webex'es in progress appear to still be working, but with severe performance problems for about the past ~15-20 minutes.
$ nslookup www.webex.com 8.8.8.8 Server: 8.8.8.8 Address: 8.8.8.8#53
** server can't find www.webex.com: NXDOMAIN
Scott
On Thu, Feb 13, 2014 at 10:58 AM, Crist Clark <cjc+outages@pumpky.net> wrote: Cisco is reporting WebEx isn't just down for us, it's down for everyone. Anyone know what is going on?
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
On Thu, Feb 13, 2014 at 11:02:17AM -0800, Scott Howard wrote:
Their DNS is broken - www.webex.com and other hosts in that domain are not resolving for me.
I think that may be a problem at your end, since resolution works just fine for me here on at least some of their authoritative name servers. (There seemed to be timeout problems on some of them, which makes me think they mighta had a problem earlier.) At the same time, given that www.webex.com turns out to be a three-layer CNAME chain, just about anything could be the problem here (and I didn't chase all the alternatives). [OT for outages, and FWIW, I will note that using nslookup for troubleshooting the DNS is as likely as not to lead you astray. I stronly suggest you find a new tool. Dig and drill are both free and considerably better. (Also, testing a recursive nameserver's responses is useful, especially when it's 6% of the Internet. But that means that _someone's_ DNS is broken, not necessarily the authoritative's.)] A -- Andrew Sullivan Dyn, Inc. asullivan@dyn.com v: +1 603 663 0448
On Thu, Feb 13, 2014 at 11:16 AM, Andrew Sullivan <asullivan@dyn.com> wrote:
I think that may be a problem at your end, since resolution works just fine for me here on at least some of their authoritative name servers.
The fact that the original poster in the thread stated that Webex had confirmed that their service was "down for everyone" probably means that it was a little more than just my DNS that was broken. The reason it's working for you know is that the problem appears to have been resolved >10 minutes before your response. FWIW (all commands run during the outage) : $ dig +trace www.webex.com ; <<>> DiG 9.8.4-rpz2+rl005.12-P1 <<>> +trace www.webex.com ;; global options: +cmd . 5620 IN NS g.root-servers.net. . 5620 IN NS h.root-servers.net. . 5620 IN NS i.root-servers.net. . 5620 IN NS j.root-servers.net. . 5620 IN NS k.root-servers.net. . 5620 IN NS l.root-servers.net. . 5620 IN NS m.root-servers.net. . 5620 IN NS a.root-servers.net. . 5620 IN NS b.root-servers.net. . 5620 IN NS c.root-servers.net. . 5620 IN NS d.root-servers.net. . 5620 IN NS e.root-servers.net. . 5620 IN NS f.root-servers.net. ;; Received 512 bytes from 208.94.242.3#53(208.94.242.3) in 21 ms com. 172800 IN NS h.gtld-servers.net. com. 172800 IN NS a.gtld-servers.net. com. 172800 IN NS l.gtld-servers.net. com. 172800 IN NS i.gtld-servers.net. com. 172800 IN NS k.gtld-servers.net. com. 172800 IN NS b.gtld-servers.net. com. 172800 IN NS f.gtld-servers.net. com. 172800 IN NS g.gtld-servers.net. com. 172800 IN NS d.gtld-servers.net. com. 172800 IN NS c.gtld-servers.net. com. 172800 IN NS m.gtld-servers.net. com. 172800 IN NS e.gtld-servers.net. com. 172800 IN NS j.gtld-servers.net. ;; Received 503 bytes from 2001:7fe::53#53(2001:7fe::53) in 49 ms webex.com. 172800 IN NS ns01.webex.com. webex.com. 172800 IN NS ns03.webex.com. webex.com. 172800 IN NS ns05.webex.com. webex.com. 172800 IN NS ns06.webex.com. webex.com. 172800 IN NS ns07.webex.com. webex.com. 172800 IN NS ns08.webex.com. ;; Received 241 bytes from 192.55.83.30#53(192.55.83.30) in 353 ms webex.com. 120 IN SOA ns01.webex.com. csg-dnsadmin.cisco.com. 2013098439 300 3600 604800 120 ;; Received 91 bytes from 114.29.195.73#53(114.29.195.73) in 263 ms $ dig +trace a www.webex.com ; <<>> DiG 9.8.4-rpz2+rl005.12-P1 <<>> +trace a www.webex.com ;; global options: +cmd . 5615 IN NS f.root-servers.net. . 5615 IN NS g.root-servers.net. . 5615 IN NS h.root-servers.net. . 5615 IN NS i.root-servers.net. . 5615 IN NS j.root-servers.net. . 5615 IN NS k.root-servers.net. . 5615 IN NS l.root-servers.net. . 5615 IN NS m.root-servers.net. . 5615 IN NS a.root-servers.net. . 5615 IN NS b.root-servers.net. . 5615 IN NS c.root-servers.net. . 5615 IN NS d.root-servers.net. . 5615 IN NS e.root-servers.net. ;; Received 512 bytes from 208.94.242.3#53(208.94.242.3) in 20 ms com. 172800 IN NS b.gtld-servers.net. com. 172800 IN NS k.gtld-servers.net. com. 172800 IN NS g.gtld-servers.net. com. 172800 IN NS f.gtld-servers.net. com. 172800 IN NS a.gtld-servers.net. com. 172800 IN NS h.gtld-servers.net. com. 172800 IN NS m.gtld-servers.net. com. 172800 IN NS c.gtld-servers.net. com. 172800 IN NS l.gtld-servers.net. com. 172800 IN NS j.gtld-servers.net. com. 172800 IN NS e.gtld-servers.net. com. 172800 IN NS i.gtld-servers.net. com. 172800 IN NS d.gtld-servers.net. ;; Received 503 bytes from 2001:7fe::53#53(2001:7fe::53) in 50 ms webex.com. 172800 IN NS ns01.webex.com. webex.com. 172800 IN NS ns03.webex.com. webex.com. 172800 IN NS ns05.webex.com. webex.com. 172800 IN NS ns06.webex.com. webex.com. 172800 IN NS ns07.webex.com. webex.com. 172800 IN NS ns08.webex.com. dig: couldn't get address for 'ns01.webex.com': no more Scott
participants (4)
-
Andrew Sullivan -
Crist Clark -
Michael Schuler -
Scott Howard