- Outages - Outages Lists

4.2.2.x DNS?
by ChrisSerafin 12 May '09

12 May '09

I have multiple clients and problems internally using 4.2.2.2 and 4.2.2.1 for DNS. My Nagios server was using these as well and has been throwing false postives since 5-8-2009..... Anyone else having problems?.... --chris

10 14

Re: [outages] Wireshark dor org
by Jeremy Chadwick 07 May '09

07 May '09

Down for me as well. Unrelated, but annoying: please do not start a new thread by replying to an existing one and changing the Subject line. Many mail clients (mutt, for example) use some extra mail headers to track a thread. What I'm talking about: 102 05/05 Chris Adams (0.6K) [outages] inet-access mailing list? 103 05/05 Charles Wyble (0.5K) `-> 104 05/05 Patrick W. Gilmore (0.6K) `-> 105 05/05 Larry Sheldon (1.0K) `-> 106 05/05 Jared Mauch (1.4K) `-> 107 05/05 Seth Mattinen (1.1K) `-> 108 05/05 John Osmon (0.5K) `-> 109 05/05 Chris Adams (0.7K) `-> 110 05/05 Patrick W. Gilmore (0.8K) `-> 111 05/07 Robert D. Scott (0.6K) `->[outages] Wireshark dor org Thanks! -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | On Thu, May 07, 2009 at 08:45:01AM -0400, Robert D. Scott wrote: > Anybody know where Wireshark.org went? A trace run to seattle-datacenter.com > [67.228.118.134] and dies. > > http://downforeveryoneorjustme.com shows it down too! > > Robert D. Scott Robert(a)ufl.edu > Senior Network Engineer 352-273-0113 Phone > CNS - Network Services 352-392-2061 CNS Phone Tree > University of Florida 352-392-9440 FAX > Florida Lambda Rail 352-294-3571 FLR NOC > Gainesville, FL 32611 321-663-0421 Cell > > _______________________________________________ > outages mailing list > outages(a)outages.org > https://puck.nether.net/mailman/listinfo/outages

2 1

inet-access mailing list?
by Chris Adams 07 May '09

07 May '09

I tried to send something to the good old inet-access mailing list (@inet-acces.net) and the server (duct.tape.net) has been rejecting SMTP connections for at least a day and a half. Does anybody know if this is a temporary thing, or has another old useful resource disappeared? -- Chris Adams <cmadams(a)hiwaay.net> Systems and Network Administrator - HiWAAY Internet Services I don't speak for anybody but myself - that's enough trouble.

8 9

Equifax Outage: Root Cause Analysis.
by virendra rode 01 May '09

01 May '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Outage start time: 4/26/2009 - 3:28pm EST Outage end time: 4/29/2009 - 2:45am EST It appears this outage was a result of a transformer failure within their power distribution panel at their Alpharetta data center. Root Cause: Failure of a defective transformer in a UPS system B distribution panel which resulted in a loss of power to certain critical system components in the data center. Apparently the system did not automatically failover to the redundant system A power as designed because system A power distribution panel breaker was left in a non-redundant state for some unknown reason. Consequently it took down their core network down including their mainframe / midrange systems. regards, /virendra -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJ+xpepbZvCIJx1bcRAiJxAJ0f6XuiihlaPTCqLRONDURCfmB/JwCg4zZ+ Nx/K+C2/r581ToekWIo0Dj8= =A8Lb -----END PGP SIGNATURE-----

1 0

[Fwd: [Outages-discussion] Anyone aware of problems around Chicago (I believe)?]
by virendra rode 30 Apr '09

30 Apr '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 forwarding to outages@, outages-discussion@ is for post outages related discussion. outages - Outages (planned & unplanned) Reporting. outages-discussion - Post outages meta-discussion (troubleshooting,analysis, post-mortem, etc). regards, /virendra - -------- Original Message -------- Subject: [Outages-discussion] Anyone aware of problems around Chicago (I believe)? Date: Thu, 30 Apr 2009 10:05:40 -0400 From: Robert MacDonald <Robert.MacDonald(a)haworth.com> To: outages-discussion(a)outages.org <outages-discussion(a)outages.org> References: <304393FA-E0E1-4457-BBFB-44BFDD56FE35@mimectl> We have Qwest & ATT DS3's from West Michigan(208.46.60.0/24) and both appear to have issues at/beyond 64.94.32.18(border1.te7-1-bbnet1.chg004.pnap.net). I've done a couple of traceroutes and they stop here and at 64.94.32.82(border1.te8-1-bbnet2.chg004.pnap.net) AT&T: Tracing the route to 74.217.5.149 1 12.87.238.5 [AS 7018] 8 msec 4 msec 8 msec 2 12.122.102.26 [AS 7018] 12 msec 12 msec 16 msec 3 12.123.139.157 [AS 7018] 12 msec 16 msec 12 msec 4 12.122.133.141 [AS 7018] 12 msec 12 msec 16 msec 5 192.205.35.154 [AS 7018] 20 msec 12 msec 12 msec 6 207.88.84.214 [AS 2828] 12 msec 12 msec 12 msec 7 207.88.184.146 [AS 2828] 12 msec 16 msec 12 msec 8 64.94.32.18 [AS 19024] 16 msec 12 msec 32 msec 9 * * * 10 * * * 11 * * * 12 * * * 13 * * * 14 * * * 15 * * * and Qwest: Tracing the route to 74.217.5.149 1 65.113.250.121 [AS 209] 96 msec 88 msec 76 msec 2 205.171.139.5 [AS 209] 40 msec 24 msec 12 msec 3 205.171.139.150 [AS 209] 8 msec 8 msec 12 msec 4 144.232.18.245 [AS 1239] 12 msec 12 msec 8 msec 5 144.232.8.103 [AS 1239] 12 msec 20 msec 20 msec 6 144.223.241.6 [AS 1239] 12 msec 12 msec 8 msec 7 64.94.32.18 [AS 19024] 12 msec 16 msec 12 msec 8 * * * 9 * * * 10 * * * 11 * * * 12 * * * 13 * * * 14 * * * 15 * * * -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJ+cbrpbZvCIJx1bcRAqRKAJ90LXn/yLcHQma9IHUN7peVAvDq6QCgib+B IgG0xe8hShT+asJ7SjimXwM= =aAQB -----END PGP SIGNATURE-----

1 0

ADMIN: Reminder on cross-posting.
by virendra rode 28 Apr '09

28 Apr '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Please everyone, kindly do not crosspost the same thread to multiple forums. Thank you for your understanding in this matter. regards, /virendra (moderator) -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJ96gxpbZvCIJx1bcRApO+AJ97GdHXrTBRg2lSiM7yd5lHg1FbmgCfeRLO 3d51JCNFgAcJhmtO6Wz6kpU= =H4QQ -----END PGP SIGNATURE-----

1 0

Re: [outages] Phoenix Area Network Issues?
by Ray Sanders 27 Apr '09

27 Apr '09

There's a ton of chatter about it on the NANOG list now. Apparently there were some issues with a major AT&T route. SBC Issues were also reported, this was all about an hour ago. On Mon, 2009-04-27 at 14:40 -0700, Chris.Lauretano(a)mcmurry.com wrote: > In Phoenix here and our XO T1s, Sprint mpls and Internet connection, > and XO microwave connection are working fine. Cox cable Internet here > and in Tempe seems fine as well. Where are you experiencing outages? > > _____ > > C. Lauretano > > On Apr 27, 2009, at 14:27, "Ray Sanders" <Ray.Sanders(a)villagevoicemedia.com > > wrote: > > > Are there any fiber cuts or other routing issues anyone in the Phoenix > > area is aware of? > > > > > > Thanks. > > > > -- > > "Prediction is very difficult, especially about the future." Niels > > Bohr > > -- > > Ray Sanders > > Linux Administrator > > Village Voice Media > > Office: 602-744-6547 > > Cell: 602-300-4344 > > > > _______________________________________________ > > outages mailing list > > outages(a)outages.org > > https://puck.nether.net/mailman/listinfo/outages -- "Prediction is very difficult, especially about the future." Niels Bohr -- Ray Sanders Linux Administrator Village Voice Media Office: 602-744-6547 Cell: 602-300-4344

1 0

Please Don't Cross-post Re: Phoenix Area Network Issues?
by Scott Weeks 27 Apr '09

27 Apr '09

Please don't cross post. scott

1 0

Phoenix Area Network Issues?
by Ray Sanders 27 Apr '09

27 Apr '09

Are there any fiber cuts or other routing issues anyone in the Phoenix area is aware of? Thanks. -- "Prediction is very difficult, especially about the future." Niels Bohr -- Ray Sanders Linux Administrator Village Voice Media Office: 602-744-6547 Cell: 602-300-4344

4 4

Equifax is experiencing a system wide outage tix #8015791
by John Martinez 26 Apr '09

26 Apr '09

Ben wrote: > Try this address or you could try calling: > > Administrative,Technical Contact: > Equifax J42M > Domain Admin > P.O. Box 740006 > Atlanta, GA 30374-0006 > US > Phone: +1.4048858000 > Email: hostmaster(a)equifax.com > > HTH > --bc > > On Apr 26, 2009, at 4:37 PM, John Martinez wrote: > >> Their site is down. >> Thanks. >> >

1 0

Equifax is experiencing a system wide outage tix #8015791
by John Martinez 26 Apr '09

26 Apr '09

Ben wrote: > Try this address or you could try calling: > > Administrative,Technical Contact: > Equifax J42M > Domain Admin > P.O. Box 740006 > Atlanta, GA 30374-0006 > US > Phone: +1.4048858000 > Email: hostmaster(a)equifax.com > > HTH > --bc > > On Apr 26, 2009, at 4:37 PM, John Martinez wrote: > >> Their site is down. >> Thanks. >> >

1 0

twc/roadrunner - NY/NE
by Wes Young 26 Apr '09

26 Apr '09

http://search.twitter.com/search?q=%23twc+OR+%23roadrunner Appears to be hitting New England / NY. Confirmed at least Buffalo to Albany. -- Wes http://claimid.com/wesyoung

1 0

Re: [outages] XO trouble in LA?
by Aryeh Goretsky (home) 22 Apr '09

22 Apr '09

Hello, I am able to reach the site from Southern California (*.res.rr.com). Likewise, http://downforeveryoneorjustme.com/usaepay.com does not indicate a problem. Regards, Aryeh Goretsky At 07:29 PM 4/15/2009, Dave Stewart wrote: >We're unable to reach usaepay.com and traces die on XO at LA... > >More trouble on the west coast? >_______________________________________________ >outages mailing list >outages(a)outages.org >https://puck.nether.net/mailman/listinfo/outages

2 1

L.A Area Outages Earlier this week?
by Ray Sanders 22 Apr '09

22 Apr '09

Anyone notice any fiber or backbone issues earlier this week in the l.a area? We had some content delivery issues that appear to be network outage related. Thanks -- "Prediction is very difficult, especially about the future." Niels Bohr -- Ray Sanders Linux Administrator Village Voice Media Office: 602-744-6547 Cell: 602-300-4344

1 0

Facebook slower past few days
by a. rahman isnaini r.sutan 21 Apr '09

21 Apr '09

Hi, Any outage towarding Facebook network ? Accessing this application, much slower for past few days. Thanks in advance. rgs a. r. isnaini rangkayo sutan.

1 0

XO trouble in LA?
by Dave Stewart 15 Apr '09

15 Apr '09

We're unable to reach usaepay.com and traces die on XO at LA... More trouble on the west coast?

1 0

Fw: BB outage
by Bill Wichers 13 Apr '09

13 Apr '09

[Sent using Blackberry Messaging] ----- Original Message ----- From: Bill Wichers To: 'itdirector(a)gmail.com' <itdirector(a)gmail.com> Sent: Mon Apr 13 16:31:39 2009 Subject: Re: [outages] BB outage I'm not so sure about that, at least for email since I just received this message... -Bill [Sent using Blackberry Messaging] ----- Original Message ----- From: outages-bounces(a)outages.org <outages-bounces(a)outages.org> To: outages(a)outages.org <outages(a)outages.org> Sent: Mon Apr 13 16:27:02 2009 Subject: [outages] BB outage via twitter BreakingNews: A nationwide BlackBerry outage is affecting users in the United States, according to reports. Officials had no immediate comment. _______________________________________________ outages mailing list outages(a)outages.org https://puck.nether.net/mailman/listinfo/outages

9 8

BB outage
by Lori Barfield 13 Apr '09

13 Apr '09

via twitter BreakingNews: A nationwide BlackBerry outage is affecting users in the United States, according to reports. Officials had no immediate comment.

2 1

Qwest Outage in Colorado
by Blake Pfankuch 13 Apr '09

13 Apr '09

Anyone have any details on this "miss-configuration" that caused a 5 hour outage from Qwest in northern Colorado? I've heard 3 stories now, one says fiber cut, one says a miss-configuration and the final person said it was a hardware failure.

2 1

Visualizing and confirming network anomalies - Newsight
by Dave Choffnes 13 Apr '09

13 Apr '09

[Apologies to those on NANOG who already saw this. Given the recent discussion on this mailing list, it seemed appropriate to cross-post it here.] Hi folks, We've just released a new tool that allows you to see network problems from end-user machines, currently BitTorrent users. (Think of this as putting P2P traffic to good use.) The interface that we've provided is still very beta, but we'd appreciate any (constructive) feedback. A little more detail: we've deployed software called NEWS (network early warning system) that uses P2P users' natural traffic to detect sudden, unexpected drops in network performance -- this allows our 25k BitTorrent users to corroborate network problems with each other. Our tool, called Newsight, lets you see summaries of their reported network anomalies. You can browse a timeline of anomalies grouped by country, AS or prefix. You can also confirm known network problems, helping to create a public database of outages and their explanations. You can play with Newsight here: http://aqualab.cs.northwestern.edu/projects/news/newsight.html Cheers, Dave (on behalf of the Aqualab research group) -- David Choffnes PhD Candidate, Computer Science Northwestern University

1 0

outage tracking
by Shane Hampton 11 Apr '09

11 Apr '09

Is there a notification board somewhere that tracks outages and restoration complete? Shane Hampton Sent via BlackBerry from T-Mobile

2 1

Re: [outages] fibre cut near 200 Paul, San Francisco
by Jim McBurnett 10 Apr '09

10 Apr '09

/lurk mode off I agree! A determined person will get the information and wreck havoc regardless of how well it is hidden! /lurk mode on Thanks, Jim Please excuse the typos. Sent from my wireless handheld device. ----- Original Message ----- From: outages-bounces(a)outages.org <outages-bounces(a)outages.org> To: outages(a)outages.org <outages(a)outages.org> Sent: Thu Apr 09 17:20:56 2009 Subject: Re: [outages] fibre cut near 200 Paul, San Francisco On Thu, Apr 9, 2009 at 1:51 PM, Bill Wichers <billw(a)waveform.net> wrote: > Yeah, I read that and my first thought was "just what we need, people > *explaining* how to cause problems". > > I've never been a big fan of publicizing detailed fiber route maps > though, I guess this just gives me more reasons to make that argument... who needs detailed fiber maps when you can have the 1-800-DIG people come out and spray paint the important routes for you? people who want to destroy things will figure out how to destroy them. hack saw, gasoline, or otherwise. maybe we should lay so much fiber it wont matter what they firebomb (-: _______________________________________________ outages mailing list outages(a)outages.org https://puck.nether.net/mailman/listinfo/outages

3 2

Re: [outages] fibre cut near 200 Paul, San Francisco
by Skywing 09 Apr '09

09 Apr '09

Consider the ratio of accidental land-based cuts to intentional land-based cuts. Then consider how hiding this data away exacerbates the already orders of magnitude more common and realistically troublesome problem. Don't neglect the ordinary (and just as damaging) for the infrequent and exraordinary. - S -----Original Message----- From: Bill Wichers <billw(a)waveform.net> Sent: Thursday, April 09, 2009 13:56 To: Jim Popovitch <jimpop(a)gmail.com>; Gadi Evron <ge(a)linuxbox.org> Cc: outages(a)outages.org <outages(a)outages.org> Subject: Re: [outages] fibre cut near 200 Paul, San Francisco Yeah, I read that and my first thought was "just what we need, people *explaining* how to cause problems". I've never been a big fan of publicizing detailed fiber route maps though, I guess this just gives me more reasons to make that argument... -Bill > > http://sandbox.bitgravity.com/blog/2009/04/09/destroy-the-internet-with- > a-hacksaw/ > > "rather than going down into the manhole....." > > Great... give the kids some new ideas. geeze. > > -Jim P. > _______________________________________________ > outages mailing list > outages(a)outages.org > https://puck.nether.net/mailman/listinfo/outages _______________________________________________ outages mailing list outages(a)outages.org https://puck.nether.net/mailman/listinfo/outages

1 0

fibre cut near 200 Paul, San Francisco
by Joe Abley 09 Apr '09

09 Apr '09

Hey, I am hearing from multiple people about connectivity problems in the bay area, and they all seem to have 200 Paul in common. ISC is reporting a fibre cut between 529 Bryant, Palo Alto and 200 Paul, SF. At least one Unitedlayer customer in 200 Paul seems to be off the air. Anybody know any specifics? Joe

16 22

Re: [outages] Fiber cut in SF area
by George William Herbert 09 Apr '09

09 Apr '09

I had written in a NANOG reply: >Mike Lyon writes: >Anyone know where the actual cut is? > >According to SF Chronicle: >http://www.sfgate.com/cgi-bin/article.cgi?f=/c/a/2009/04/09/BAP816VTE6.DTL&… > >"The fiber-optic cables were severed shortly before 1:30 a.m. along Monterey >Highway north of Blossom Hill Road in south San Jose, police Sgt. Ronnie Lopez >said." > >Vicintity of 121.81 W 37.26 N, but I have no idea specifically where in that >general area. There are train tracks through there, could well be >a vault along the train tracks alongside Monterey Highway. But I don't >know specifically where the AT&T fiber runs down there. Additional news stories reporting second fiber cut on Sprint fiber in San Carlos, between San Francisco and San Jose, the SF Gate article above was updated at 12:20pm with that information. San Jose cut at around 1:30am, San Carlos around 3:30am. -george

2 1

Possible undersea cable cut in Asia
by Eric Spagna (US) 03 Apr '09

03 Apr '09

Have a client with a main link down in Asia. Their update from Verizon Singapore claims there is an undersea cable link down (maybe a cable cut? Not sure) between Taiwan and Hong Kong, and does not have an ETA at this time. -Spags- ----------------------------------------- Disclaimer: This e-mail communication and any attachments may contain confidential and privileged information and is for use by the designated addressee(s) named above only. If you are not the intended addressee, you are hereby notified that you have received this communication in error and that any use or reproduction of this email or its contents is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by replying to this message and deleting it from your computer. Thank you.

1 1

SAIX DNS outage?
by Aryeh Goretsky (home) 02 Apr '09

02 Apr '09

Hello, Does anyone have any information about an outage at the South African Internet Exchange, possibly DNS related? Thank you. Regards, Aryeh Goretsky

3 2

KY Outage
by Gary E. Miller 31 Mar '09

31 Mar '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Yo All! New to the list. Traffic to Grand Cayman has been down for some routes The problem seems to be near C&W in Miami. Some traces fail: # mtr -r candw.ky Loss% Snt Last Avg Best Wrst StDev 10. cr1-pos-0-11-1-0.Seattle.sav 0.0% 10 13.9 13.8 11.8 19.4 2.2 11. cr2-tengig-0-7-0-0.Washingto 10.0% 10 87.8 87.7 87.4 88.1 0.3 12. cable-and-wireless-americas- 0.0% 10 91.2 91.5 90.7 94.8 1.2 13. so-0-0-0-dcr1.ash.cw.net 0.0% 10 90.8 91.4 90.6 92.7 0.6 14. so-7-0-0-0-ecr2.mia.cw.net 0.0% 10 154.7 124.2 118.2 154.7 11.2 15. cablewirelessca1.mia.cw.net 0.0% 10 141.6 145.5 141.3 180.2 12.2 16. ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 # mtr -r sussexdirectories.COM Loss% Snt Last Avg Best Wrst StDev 8. POS5-0.BR2.SEA1.ALTER.NET 0.0% 10 10.3 10.2 9.7 11.6 0.6 9. so6-1-0-2488M.ar4.SEA1.gblx. 0.0% 10 32.3 32.8 32.1 33.9 0.6 10. te2-1-10G.ar1.MIA2.gblx.net 0.0% 10 102.4 280.2 100.7 713.5 253.5 11. TELEBERMUDA-USA-INTERNATIONA 0.0% 10 136.9 140.2 135.4 154.3 5.6 12. ??? 100.0 10 0.0 0.0 0.0 0.0 0.0 Some work: # mtr -r cw.ky Loss% Snt Last Avg Best Wrst StDev 10. cr1-pos-0-3-0-1.Seattle.savv 0.0% 10 13.1 15.3 11.8 26.2 4.0 11. cr2-tengig-0-7-0-0.Washingto 0.0% 10 87.7 87.6 87.1 88.0 0.3 12. cable-and-wireless-americas- 0.0% 10 90.8 97.6 90.7 155.6 20.4 13. so-4-0-0-dcr1.ash.cw.net 0.0% 10 91.2 91.1 90.7 91.4 0.2 14. so-7-0-0-0-ecr2.mia.cw.net 0.0% 10 118.1 122.9 118.1 156.2 11.9 15. cablewirelessca1.mia.cw.net 10.0% 10 142.0 141.8 141.4 142.5 0.4 16. Chakotay.CandW.ky 10.0% 10 141.7 142.5 141.7 143.6 0.6 I have heard the problem might be somewhere in Miami. Anyone else seeing problems? RGDS GARY - --------------------------------------------------------------------------- Gary E. Miller Rellim 109 NW Wilmington Ave., Suite E, Bend, OR 97701 gem(a)rellim.com Tel:+1(541)382-8588 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (GNU/Linux) iD8DBQFJ0p9zBmnRqz71OvMRAujxAKDS/qmJqU2BHHUdmcZomneeIAjAXwCgiZwk AkjlWliMKRCe5PNoR43ojkA= =jAP5 -----END PGP SIGNATURE-----

2 2

TWC outage
by Adam Greene 31 Mar '09

31 Mar '09

Seems to be an outage with Time Warner Cable in the upstate New York area ... As far as I can tell, it's on AS7843. I'm awaiting callback from an engineer for details .... Adam -- Webjogger (845) 757-4000 ASN 20208 ====== C:\>tracert www.authorize.net Tracing route to www.authorize.net [64.94.118.77] over a maximum of 30 hops: 1 38 ms 1 ms 2 ms 10049.webjogger.net [204.8.80.49] 2 6 ms 6 ms 7 ms cpe-24-29-112-25.nyc.res.rr.com [24.29.112.25] 3 8 ms 7 ms 6 ms gig-12-2-nycmnyrdc-rtr1.nyc.rr.com [24.29.104.97] 4 7 ms 7 ms 8 ms gig1-0-0-nwrknjmd-rtr1.nyc.rr.com [24.29.130.182] 5 7 ms 7 ms 6 ms ae-4-0.cr0.nyc30.tbone.rr.com [66.109.6.78] 6 9 ms 8 ms 8 ms ae-1-0.pr0.nyc20.tbone.rr.com [66.109.6.163] 7 8 ms 9 ms 8 ms 66.109.9.210 8 * * * Request timed out. 9 * * * Request timed out. 10 * * * Request timed out. 11 * * * Request timed out. 12 * * * Request timed out. 13 * * * Request timed out. 14 * * * Request timed out. 15 * * * Request timed out. 16 * * * Request timed out. 17 * * * Request timed out. 18 * * * Request timed out. 19 * * * Request timed out. 20 * * * Request timed out. 21 * * * Request timed out. 22 * * * Request timed out. 23 * * * Request timed out. 24 * * * Request timed out. 25 * * * Request timed out. 26 * * * Request timed out. 27 * * * Request timed out. 28 * * * Request timed out. 29 * * * Request timed out. 30 * * * Request timed out. Trace complete.

1 1

XO in Atlanta metro area
by Glenn Borowski 30 Mar '09

30 Mar '09

Is anyone having trouble with XO? Our systems are fine and all circuits green but have no access past their cpe. Glenn Borowski --- Sent from my mobile device

2 1

Re: [outages] Level3 Packet Loss
by Bryan Campbell 28 Mar '09

28 Mar '09

Level3 to AT&T by way of Chicago was very poor this afternoon (3:00-5:00 Central). By 6:00 Central the problems were resolved. bbc(a)misn.com On Fri, 2009-03-27 at 16:36 -0700, Darryl Dunkin wrote: > Traceroutes? City? > > Zero here in Seattle. > > -----Original Message----- > From: outages-bounces(a)outages.org [mailto:outages-bounces@outages.org] > On Behalf Of Bryan Campbell > Sent: Friday, March 27, 2009 16:24 > To: outages(a)outages.org > Subject: [outages] Level3 Packet Loss > > Anyone have any information on the Level3 troubles today? > > It seems to have gotten better but is still on-going. > > bbc(a)misn.com > > _______________________________________________ > outages mailing list > outages(a)outages.org > https://puck.nether.net/mailman/listinfo/outages

2 2

Re: [outages] Level3 Packet Loss
by Bryan Campbell 27 Mar '09

27 Mar '09

UPDATE http://www.internetpulse.net/ is showing that the problem has been resolved in the last hour. bbc(a)misn.com Clayton Zekelman wrote: > Yes, I've got a ticket open for packet loss beteen AT&T & Level3 at > Chicago. Started around 5pm, then cleared up around 6pm. > > Sent from my iPhone > > On Mar 27, 2009, at 7:23 PM, Bryan Campbell <bbc(a)misn.com> wrote: > >> Anyone have any information on the Level3 troubles today? >> >> It seems to have gotten better but is still on-going. >> >> bbc(a)misn.com >> >> _______________________________________________ >> outages mailing list >> outages(a)outages.org >> https://puck.nether.net/mailman/listinfo/outages >

1 0

EveryDNS down
by Donovan 27 Mar '09

27 Mar '09

All my domains using EveryDNS seems to be down. Anybody have some inside info? -- Donovan Niesen

4 3

Internet is slow today?
by Franck Martin 21 Mar '09

21 Mar '09

Did anyone notice any changes in email traffic?

2 1

AUTO: Kamal Mehta is on vacation (returning 03/16/2009)
by Kamal Mehta 15 Mar '09

15 Mar '09

I am out of the office until 03/16/2009. I am on vacation and will not have access to e-mail. I will try to reply to your message on my return. If you need immediate assistance, please call the IBM AOD Service Center at 877-737-3700. Note: This is an automated response to your message "outages Digest, Vol 10, Issue 1" sent on 3/15/09 10:00:02. This is the only notification you will receive while this person is away.

1 0

MySpace/CDN outage/problems/DDoS?
by Jay R. Ashworth 14 Mar '09

14 Mar '09

Since about 1030EDT this morning, I've been noticing problems with MySpace, which have also been reported to me by others in other areas and on other eyeball networks. Each of my correspondents reports having gotten spam from me via MySpace, and I've gotten (the same) spam from them; something about signing up for a trial account, and a url with the last m in .com replaced by %6d (which, interestingly, FireFox 3 un-URLescapes, but does not actually parse correctly afterwards. Additionally, my view of a friend's friends list showed it empty, while his view of his own friends list was populated as expected, and some of my friends I cannot load the profile pages of at all. Finally, most pages do not load completely; generally, FireFox appears to hang while loading media files from MySpace's CDN. I infer a targeted attack, but have no proof. Anyone else see anything? Cheers, -- jra -- Jay R. Ashworth Baylink jra(a)baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://baylink.pitas.com '87 e24 St Petersburg FL USA http://photo.imageinc.us +1 727 647 1274 I wondered "Why is that Frisbee getting bigger?" And then it hit me.

1 0

NTT
by Blake Pfankuch 27 Feb '09

27 Feb '09

Anyone know whats going on with NTT? Had 2 datacenters drop for a short period of time, and transit between 2 others drop as well. Also still experiencing some warning messages on timeouts. Blake Pfankuch Connecting Point of Greeley Network Engineer 970-356-7224 [cid:image001.gif@01C998C0.1A9BF120]

1 0

[Fwd: Road Runner DNS servers]
by virendra rode 27 Feb '09

27 Feb '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Does anyone have any insight into this? I gave up trying last night by switching to non-tw dns servers. regards, /virendra - -------- Original Message -------- Subject: Road Runner DNS servers Date: Thu, 26 Feb 2009 20:47:35 -0800 From: Ricardo Oliveira <rveloso(a)cs.ucla.edu> To: nanog(a)nanog.org Is there anyone clueful in this list from Road Runner(Time Warner Cable) that can explain what's going on with their DNS servers - just contacted their tech support and heard their DNS servers have been under attack over the last 3 days.. thanks, - --Ricardo -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJp3WZpbZvCIJx1bcRAuR8AKDLNIqOmZMWXUkhmaAK+9j9yv3NfQCePZ6S aepRlQ5PGSihSlieHERJCqI= =Gv6n -----END PGP SIGNATURE-----

2 2

Sprint east coast US fiber cut
by John Kinsella 25 Feb '09

25 Feb '09

Anybody know anything about this? Supposedly a fiber cut near Elkridge, MD has taken one of my clients offline... John

1 0

Google Mail (Gmail) Outage
by Dwight A. Ernest 24 Feb '09

24 Feb '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 See http://www.outages.org/index.php/Wiki:Community_Portal -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (MingW32) iD8DBQFJo+YnkGL83WkVEIoRAj3sAJ9aF+SztCs7YbBcqmlO4FdWBWscngCgrJpa mDdsAjqJYtL7G2yZAixfifI= =KHbP -----END PGP SIGNATURE-----

1 0

Charleston SC DSL Outage?
by Jon Kibler 23 Feb '09

23 Feb '09

Hi, As Murphy would have it, I am out of town and it appears that all 3 of my DSL connections in the Charleston, SC area are out. My ISP said that AT&T admits to a major DSL outage in coastal SC, and that it will be tomorrow morning before it is fixed. I had one line fail about 14:00 UTC, and the other two fail about 19:00 UTC. Anyone know what is going on and why it is taking them the better part of a day to get everything back on-line? Needless to say, I am having to send this from my gmail account, rather than my normal company account. Any info appreciated. Jon K -- Jon R. Kibler Chief Technical Officer A.S.E.T., Inc. Charleston, SC USA o: 843-849-8214

1 0

Embarq issues in the SE?
by chuck goolsbee 16 Feb '09

16 Feb '09

I'm getting reports from some of our customers in the opposite corner of the country losing connectivity. All seems to be (pardon the pun) connected to Embarq (ex Sprint?) Anyone have a clue what might be going on? --chuck in Seattle

1 0

Verizon Cellular Outage in Atlanta
by Glenn Borowski 05 Feb '09

05 Feb '09

Just got off the phone with Verizon. They are having an outage in the Atlanta area for the past 2 hours. Master ticket 2754783. Regards Glenn Borowski IT Leader gborowski(a)industriaplex.com Mobile: (404) 542-4615 Office: (678) 990-7868 x-515 Fax: (678) 990-7887 Industriaplex, Inc. 11810 Wills Road #100 Alpharetta, GA 30009 www.industriaplex.com

1 0

AT&T mobile data problem in central TX
by Chris Boyd 02 Feb '09

02 Feb '09

3G and Edge services appear to be failing to authenticate. Confirmed in Austin and Bastrop. Sent from my iPhone via wifi.

4 3

att (iphone) outage ?
by Chaim Rieger 02 Feb '09

02 Feb '09

have users in CO and CA reporting no connection, anybody seeing anything similar ?

4 4

enom
by Blake Pfankuch 31 Jan '09

31 Jan '09

Anyone seeing anything interesting? I have a domain with them that I just by chance noticed is not resolving. I cant even pull up their webpage consistently from 4 locations on 4 different carriers. Blake Pfankuch Connecting Point of Greeley Network Engineer 970-356-7224 [cid:image001.jpg@01C983B4.69E9C610][cid:image002.gif@01C983B4.69E9C610]

2 2

Time Warner outage
by Paul Norton 30 Jan '09

30 Jan '09

A Time Warner ISP technical rep. has confirmed an issue in the Time Warner network for some customers getting to some sites. It is a "gray area" in their network that they're waiting for it to be "cleared up". I do not have a ticket open with them, a customer does. Just giving a heads up. If anyone here does have a ticket open regarding this or knows more, please share. Thanks, -- Paul Norton Systems Administrator Neoverve - www.neoverve.com Neoverve Blog - http://blog.neoverve.com/

2 2

level3 - blackberry
by Tan, William 30 Jan '09

30 Jan '09

Our traffic from the northeast to Blackberry SRP servers was being lost in the level3 network. Rerouting over a different isp solved the issue. Unreachable SRP servers are completely disruptive to a blackberry organization. Tracing route to srp.na.blackberry.net [206.51.26.33] over a maximum of 30 hops: . . . 6 <1 ms <1 ms <1 ms bstnma1wcx011-pos6-0-oc48.wcg.net [65.77.95.182] 7 5 ms 5 ms 5 ms nycmny2wcx3-pos9-0-oc48.wcg.net [64.200.249.49] 8 27 ms 27 ms 27 ms brvwil1wcx3-pos0-0-oc192.wcg.net [64.200.240.253] 9 27 ms 27 ms 27 ms brvwil1wcx2-pos1-0-oc192.wcg.net [64.200.236.77] 10 47 ms 47 ms 47 ms dllstx1wcx2-pos12-0-oc192.wcg.net [64.200.210.42] 11 136 ms 160 ms 225 ms 64.200.249.126 12 53 ms 47 ms 47 ms te-4-1-71.car2.Dallas1.Level3.net [4.68.110.9] 13 * * * Request timed out. NOTICE: The information contained in this transmission is privileged, confidential, and intended only for the use of the individual or entity named above. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, or the taking of any action in reliance on the contents of this transmission is strictly prohibited. If you have received this transmission in error, please notify Eze Castle Integration, Inc. by e-mail and destroy the original message and all copies. Thank you.

1 0

QWEST - fiber cut in galt, california (between sacramento and stockton)
by virendra rode 29 Jan '09

29 Jan '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 This outage is affecting dnvr, lsan, nyccm, sttl and phx areas. Not sure the scale of this outage but our gigman link between denver and los angeles is down. regards, /virendra -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJgm4YpbZvCIJx1bcRArtgAJ9jAt7CoyGYcKaeMz5Fd6qYtVgDhgCgq23+ Q5IpFsJ3uS3tl+dXB1ROgeE= =3lgM -----END PGP SIGNATURE-----

1 0

RR Florida / Bell South issues?
by Darrell Hyde 29 Jan '09

29 Jan '09

Getting reports from customers in Florida mostly on RR, some on Bell South that they're unable to reach our network (AS 20021). Traceroutes we've received so far don't show any particular problem. Anybody experiencing anything similar? - Darrell

1 0