Anyone seeing major IP problems right now?

Geoff MINA --------------------------------- CTO/Co-Founder Connect First Inc. CCI * VB * 911 P: 720.335.5924 T: 888.410.3071 F: 678.265.1158 E: <mailto:gmina@connectfirst.com> gmina@connectfirst.com --------------------------------- <http://www.connectfirst.com/> www.connectfirst.com Description: cf-logo

I've held back for a while now... Please define IP problems? How about a mtr or some sort, diag or examples. East coast? Central? Mountain? West-Side? Level3? TWTC? Quest? ATT? XO? I think Frank can pipe up with more questions and what not... Michael T. Voity On Fri, Nov 11, 2011 at 10:17 AM, Geoffrey Mina <gmina@connectfirst.com>wrote:
** **
** **
*Geoff MINA*
---------------------------------****
CTO/Co-Founder****
Connect First Inc. ****
CCI * VB * 911****
P: 720.335.5924****
T: 888.410.3071****
F: 678.265.1158****
E: gmina@connectfirst.com****
---------------------------------****
www.connectfirst.com****
** **
[image: Description: cf-logo]****
** **
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Yup; Intellectual Property was a *really* bad idea, and patents, copyrights and trademarks should all be abolished immediately. But that's not important now. If you tell us what kind of problem you're seeing, down whose link to where, we might have some more information for you... Cheers, -- jra ----- Original Message -----
From: "Geoffrey Mina" <gmina@connectfirst.com> To: outages@outages.org Sent: Friday, November 11, 2011 10:17:01 AM Subject: [outages] Anyone seeing major IP problems right now? Geoff MINA
---------------------------------
CTO/Co-Founder
Connect First Inc.
CCI * VB * 911
P: 720.335.5924
T: 888.410.3071
F: 678.265.1158
E: <mailto:gmina@connectfirst.com> gmina@connectfirst.com
---------------------------------
<http://www.connectfirst.com/> www.connectfirst.com
Description: cf-logo
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://baylink.pitas.com 2000 Land Rover DII St Petersburg FL USA http://photo.imageinc.us +1 727 647 1274

Any more details? We're having some IP issues as well, with customers reporting slowness and timeouts. We're in Chicago, connected to Cogent and XO. Tim Huffman Director of Engineering Business Only Broadband 777 Oakmont Lane, Suite 2000, Westmont, IL 60559 Direct: 630.590.6012 | Main: 630.590.6000 | Fax: 630.986.2496 thuffman@bobbroadband.com<mailto:thuffman@bobbroadband.com> | http://www.bobbroadband.com/ Cell: 630.340.1925 | Toll-Free Customer Support: 877.262.4553 P please consider the environment prior to printing From: outages-bounces@outages.org [mailto:outages-bounces@outages.org] On Behalf Of Geoffrey Mina Sent: Friday, November 11, 2011 9:17 AM To: outages@outages.org Subject: [outages] Anyone seeing major IP problems right now? Geoff MINA --------------------------------- CTO/Co-Founder Connect First Inc. CCI * VB * 911 P: 720.335.5924 T: 888.410.3071 F: 678.265.1158 E: gmina@connectfirst.com<mailto:gmina@connectfirst.com> --------------------------------- www.connectfirst.com<http://www.connectfirst.com/> [cid:image001.jpg@01CCA056.269C4970]

I don't have any details. Still trying to figure out what the problem is. We aren't getting complaints of not being able to connect to our network by our customers, but we are seeing a lot of problems between us and our upstream ITSP vendors. Our ITSP vendors also seem to be having a lot of problems with call setups. Geoff MINA --------------------------------- CTO/Co-Founder Connect First Inc. CCI * VB * 911 P: 720.335.5924 T: 888.410.3071 F: 678.265.1158 E: gmina@connectfirst.com --------------------------------- www.connectfirst.com <http://www.connectfirst.com/> Description: cf-logo From: Tim Huffman [mailto:Tim@bobbroadband.com] Sent: Friday, November 11, 2011 8:42 AM To: Geoffrey Mina; outages@outages.org Subject: RE: [outages] Anyone seeing major IP problems right now? Any more details? We're having some IP issues as well, with customers reporting slowness and timeouts. We're in Chicago, connected to Cogent and XO. Tim Huffman Director of Engineering Business Only Broadband 777 Oakmont Lane, Suite 2000, Westmont, IL 60559 Direct: 630.590.6012 | Main: 630.590.6000 | Fax: 630.986.2496 thuffman@bobbroadband.com | <http://www.bobbroadband.com/> http://www.bobbroadband.com/ Cell: 630.340.1925 | Toll-Free Customer Support: 877.262.4553 P please consider the environment prior to printing From: outages-bounces@outages.org [mailto:outages-bounces@outages.org] On Behalf Of Geoffrey Mina Sent: Friday, November 11, 2011 9:17 AM To: outages@outages.org Subject: [outages] Anyone seeing major IP problems right now? Geoff MINA --------------------------------- CTO/Co-Founder Connect First Inc. CCI * VB * 911 P: 720.335.5924 T: 888.410.3071 F: 678.265.1158 E: gmina@connectfirst.com --------------------------------- www.connectfirst.com <http://www.connectfirst.com/> Description: cf-logo

----- Original Message -----
From: "Geoffrey Mina" <gmina@connectfirst.com>
I don't have any details. Still trying to figure out what the problem is. We aren't getting complaints of not being able to connect to our network by our customers, but we are seeing a lot of problems between us and our upstream ITSP vendors. Our ITSP vendors also seem to be having a lot of problems with call setups.
First, be careful about forwarding internal mail out to mailing lists; you can leak things that way which people might prefer you didn't. Second, if XO is involved, you should see this week's NANOG archive, wherein we discuss the fact that XO has been known to put in blocks down to the IP/port level without notice; it's possible that might have some bearing on your problems. This was specifically mentioned in the context of SIP. Cheers, -- jra -- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://baylink.pitas.com 2000 Land Rover DII St Petersburg FL USA http://photo.imageinc.us +1 727 647 1274

Depletion of IPv4 addresses with a lack of ubiquitous IPv6 support in consumer grade CPE and a major problem right now. Regards From: outages-bounces@outages.org [mailto:outages-bounces@outages.org] On Behalf Of Geoffrey Mina Sent: 11 November 2011 15:17 To: outages@outages.org Subject: [outages] Anyone seeing major IP problems right now? Geoff MINA --------------------------------- CTO/Co-Founder Connect First Inc. CCI * VB * 911 P: 720.335.5924 T: 888.410.3071 F: 678.265.1158 E: gmina@connectfirst.com<mailto:gmina@connectfirst.com> --------------------------------- www.connectfirst.com<http://www.connectfirst.com/> [Description: cf-logo] Fulnett Limited, trading as Strencom is licensed by the Commission for Communication Regulation, ComReg, which is responsible for the regulation of the electronic communications sector in Ireland. Fulnett Limited is Registered in Ireland as a Private Limited Company, with its registered address at Heron House, Blackpool Retail Park, Blackpool, Cork. Co. Registration No: 326681. Directors: T.Murphy (Managing) & L.Murphy This e-mail may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply e-mail and delete all copies of this message.

Haha. That is a major problem, but I was talking more along the lines of Level(3) edge routers having issues. Lasted about 10 minutes. Geoff MINA --------------------------------- CTO/Co-Founder Connect First Inc. CCI * VB * 911 P: 720.335.5924 T: 888.410.3071 F: 678.265.1158 E: gmina@connectfirst.com --------------------------------- www.connectfirst.com <http://www.connectfirst.com/> Description: cf-logo From: Ed Ronayne [mailto:edmund.ronayne@strencom.net] Sent: Friday, November 11, 2011 8:45 AM To: Geoffrey Mina; outages@outages.org Subject: RE: [outages] Anyone seeing major IP problems right now? Depletion of IPv4 addresses with a lack of ubiquitous IPv6 support in consumer grade CPE and a major problem right now. Regards From: outages-bounces@outages.org [mailto:outages-bounces@outages.org] On Behalf Of Geoffrey Mina Sent: 11 November 2011 15:17 To: outages@outages.org Subject: [outages] Anyone seeing major IP problems right now? Geoff MINA --------------------------------- CTO/Co-Founder Connect First Inc. CCI * VB * 911 P: 720.335.5924 T: 888.410.3071 F: 678.265.1158 E: gmina@connectfirst.com --------------------------------- www.connectfirst.com <http://www.connectfirst.com/> Description: cf-logo Fulnett Limited, trading as Strencom is licensed by the Commission for Communication Regulation, ComReg, which is responsible for the regulation of the electronic communications sector in Ireland. Fulnett Limited is Registered in Ireland as a Private Limited Company, with its registered address at Heron House, Blackpool Retail Park, Blackpool, Cork. Co. Registration No: 326681. Directors: T.Murphy (Managing) & L.Murphy This e-mail may contain confidential and privileged material for the sole use of the intended recipient. Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender by reply e-mail and delete all copies of this message.

As of Nov 18 14:30 EST - We are currently seeing downed connections from multiple ISPs in different geographical locations. Is anyone aware of a current back bone issue? Thanks, Zeek Bower Medco Work @ Home Solutions Center ********************************************************************** This e-mail message and any attachments contain confidential information from Medco. If you are not the intended recipient, you are hereby notified that disclosure, printing, copying, distribution, or the taking of any action in reliance on the contents of this electronic information is strictly prohibited. If you have received this e-mail message in error, please immediately notify the sender by reply message and then delete the electronic message and any attachments.

I've been seeing heavy loss from the US to London for the past few hours (IAD and Orlando sources and destinations). tinet.net and telia are where we're seeing it drop, but ymmv of course. On Fri, 18 Nov 2011, Bower, Zeek wrote:
As of Nov 18 14:30 EST - We are currently seeing downed connections from multiple ISPs in different geographical locations. Is anyone aware of a current back bone issue?
Thanks,
Zeek Bower
Medco Work @ Home Solutions Center
____________________________________________________________________________ This e-mail message and any attachments contain confidential information from Medco. If you are not the intended recipient, you are hereby notified that disclosure, printing, copying, distribution, or the taking of any action in reliance on the contents of this electronic information is strictly prohibited. If you have received this e-mail message in error, please immediately notify the sender by reply message and then delete the electronic message and any attachments.
-- david raistrick http://www.netmeister.org/news/learn2quote.html drais@icantclick.org http://www.expita.com/nomime.html

What ISPs? Any traceroutes? I'm not seeing any issues on POPs in DFW, NYC and LA on level3 and verizon. On 11/18/2011 02:40 PM, Bower, Zeek wrote:
As of Nov 18 14:30 EST - We are currently seeing downed connections from multiple ISPs in different geographical locations. Is anyone aware of a current back bone issue?
Thanks,
*Zeek Bower***
Medco Work @ Home Solutions Center
------------------------------------------------------------------------ This e-mail message and any attachments contain confidential information from Medco. If you are not the intended recipient, you are hereby notified that disclosure, printing, copying, distribution, or the taking of any action in reliance on the contents of this electronic information is strictly prohibited. If you have received this e-mail message in error, please immediately notify the sender by reply message and then delete the electronic message and any attachments.

On 11/18/2011 01:40 PM, Bower, Zeek wrote:
As of Nov 18 14:30 EST - We are currently seeing downed connections from multiple ISPs in different geographical locations. Is anyone aware of a current back bone issue?
Not seeing any problems (Denver, CO with Cogent and L3) - and checking http://www.internetpulse.net/ and http://www.internettrafficreport.com/, nothing looks out of the ordinary.... Chris

On Fri, Nov 18, 2011 at 20:40, Bower, Zeek <Zeek_Bower@medco.com> wrote:
As of Nov 18 14:30 EST - We are currently seeing downed connections from multiple ISPs in different geographical locations. Is anyone aware of a current back bone issue?
Without saying which ISPs, which locations, and which destinations you're having trouble with, your message is useless. Your question seems to suggest you think these multiple ISPs are each connecting you to one big backbone in the sky, and you think this unified backbone might have a backache today. There is no unified backbone. There are many different national and global networks that can credibly talk about their backbones, and they interconnect in wildly varied ways at locations around the world. Please, save your breath if you can't or won't provide a traceroute, mtr, etc showing the path and evidence of a problem, or at least a very specific description like "we're getting complaints from Comcast customers in Maryland trying to reach our services in Houston hosted on Level3 and customer traceroutes seem to point to a problem at the handoff from XO to Level3 in Dallas." "Downed connections from multiple ISPs in different locations" without specifying your location, your ISP(s) and the specific remote ISP/location pairs is just barely more information than "the internets is bork!" Thanks, Dave Hart

I think this might have just been a quick question due to an issue they were addressing. Probably busy t-shooting and just wanted to get it out there, just in case others were having a problem. -----Original Message----- From: outages-bounces@outages.org [mailto:outages-bounces@outages.org] On Behalf Of Dave Hart Sent: Saturday, November 19, 2011 6:23 AM To: Bower, Zeek Cc: outages@outages.org Subject: Re: [outages] Anyone seeing major IP problems right now? On Fri, Nov 18, 2011 at 20:40, Bower, Zeek <Zeek_Bower@medco.com> wrote:
As of Nov 18 14:30 EST - We are currently seeing downed connections from multiple ISPs in different geographical locations. Is anyone aware of a current back bone issue?
Without saying which ISPs, which locations, and which destinations you're having trouble with, your message is useless. Your question seems to suggest you think these multiple ISPs are each connecting you to one big backbone in the sky, and you think this unified backbone might have a backache today. There is no unified backbone. There are many different national and global networks that can credibly talk about their backbones, and they interconnect in wildly varied ways at locations around the world. Please, save your breath if you can't or won't provide a traceroute, mtr, etc showing the path and evidence of a problem, or at least a very specific description like "we're getting complaints from Comcast customers in Maryland trying to reach our services in Houston hosted on Level3 and customer traceroutes seem to point to a problem at the handoff from XO to Level3 in Dallas." "Downed connections from multiple ISPs in different locations" without specifying your location, your ISP(s) and the specific remote ISP/location pairs is just barely more information than "the internets is bork!" Thanks, Dave Hart _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages ********************************************************************** This e-mail message and any attachments contain confidential information from Medco. If you are not the intended recipient, you are hereby notified that disclosure, printing, copying, distribution, or the taking of any action in reliance on the contents of this electronic information is strictly prohibited. If you have received this e-mail message in error, please immediately notify the sender by reply message and then delete the electronic message and any attachments.

On Sat, Nov 19, 2011 at 11:48, Johnson, Robert P. <Robert_Johnson2@medco.com> wrote:
I think this might have just been a quick question due to an issue they were addressing. Probably busy t-shooting and just wanted to get it out there, just in case others were having a problem.
At any given moment, I guarantee you someone somewhere is seeing internet connectivity problems. If they all posted to outages with similarly vague reports, the signal/noise ratio would be so low, no one would read it. I'm asking medco.com and everyone else who is tempted to ask, in effect, "is anyone else seeing any problems anywhere on any carriers?" to provide enough detail to localize the problem to specific carrier(s) and specific locations (endpoints or apparent trouble spots from traces), or just keep quiet respecting the need for signal amongst the noise. I'm willing to hear I'm asking too much, from the list owner, or others sufficiently clued to have provided useful details when they post here about new issues. Not so much from coworkers of people reporting problems here lacking key details and soliciting responses likely to be similarly devoid of useful details, as they're the ones dragging down the signal:noise ratio here, which is already low and seems to be getting worse. Thanks for your understanding, Dave Hart

On 11/19/2011 06:19 AM, Dave Hart wrote:
On Sat, Nov 19, 2011 at 11:48, Johnson, Robert P. <Robert_Johnson2@medco.com> wrote:
I think this might have just been a quick question due to an issue they were addressing. Probably busy t-shooting and just wanted to get it out there, just in case others were having a problem. At any given moment, I guarantee you someone somewhere is seeing internet connectivity problems. If they all posted to outages with similarly vague reports, the signal/noise ratio would be so low, no one would read it. I'm asking medco.com and everyone else who is tempted to ask, in effect, "is anyone else seeing any problems anywhere on any carriers?" to provide enough detail to localize the problem to specific carrier(s) and specific locations (endpoints or apparent trouble spots from traces), or just keep quiet respecting the need for signal amongst the noise.
I'm willing to hear I'm asking too much, from the list owner, or others sufficiently clued to have provided useful details when they post here about new issues. Not so much from coworkers of people reporting problems here lacking key details and soliciting responses likely to be similarly devoid of useful details, as they're the ones dragging down the signal:noise ratio here, which is already low and seems to be getting worse.
Thanks for your understanding, Dave Hart
Agreed. If you have time to post a message you have time to do a quick mtr/traceroute or at least give some further information on what issues are being seen. "The Internet is broken!" is for my mom using her cable modem not people posting on this list. Joseph

Kindly move this discussion. Thank you. Jason Sent from my iPhone On Nov 19, 2011, at 8:08, Joseph Jackson <jjackson@aninetworks.net> wrote:
On 11/19/2011 06:19 AM, Dave Hart wrote:
On Sat, Nov 19, 2011 at 11:48, Johnson, Robert P. <Robert_Johnson2@medco.com> wrote:
I think this might have just been a quick question due to an issue they were addressing. Probably busy t-shooting and just wanted to get it out there, just in case others were having a problem. At any given moment, I guarantee you someone somewhere is seeing internet connectivity problems. If they all posted to outages with similarly vague reports, the signal/noise ratio would be so low, no one would read it. I'm asking medco.com and everyone else who is tempted to ask, in effect, "is anyone else seeing any problems anywhere on any carriers?" to provide enough detail to localize the problem to specific carrier(s) and specific locations (endpoints or apparent trouble spots from traces), or just keep quiet respecting the need for signal amongst the noise.
I'm willing to hear I'm asking too much, from the list owner, or others sufficiently clued to have provided useful details when they post here about new issues. Not so much from coworkers of people reporting problems here lacking key details and soliciting responses likely to be similarly devoid of useful details, as they're the ones dragging down the signal:noise ratio here, which is already low and seems to be getting worse.
Thanks for your understanding, Dave Hart
Agreed. If you have time to post a message you have time to do a quick mtr/traceroute or at least give some further information on what issues are being seen.
"The Internet is broken!" is for my mom using her cable modem not people posting on this list.
Joseph
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

I'm willing to hear I'm asking too much, from the list owner, or others sufficiently clued to have provided useful details when they post here about new issues. Not so much from coworkers of people reporting problems here lacking key details and soliciting responses likely to be similarly devoid of useful details, as they're the ones dragging down the signal:noise ratio here, which is already low and seems to be getting worse.
Nope; you're right on the money. Cheers, -- jra -- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://baylink.pitas.com 2000 Land Rover DII St Petersburg FL USA http://photo.imageinc.us +1 727 647 1274
participants (13)
-
Bower, Zeek
-
Chris Stone
-
Colin Johnston
-
Dave Hart
-
david raistrick
-
Ed Ronayne
-
Geoffrey Mina
-
Jason L. Sparks
-
Jay Ashworth
-
Johnson, Robert P.
-
Joseph Jackson
-
Tim Huffman
-
Voity, Michael T.