Re: [outages] Cogent /ATT and Verizon Peering alternatives

Hi, On Tue, Feb 11, 2014 at 08:34:08AM -0600, Blake Dunlap wrote:
I don't expect you'll get the answer you want. They're pretty consistent on their policies. Why is this Cogent's fault and not Verizon's? From outside perspective, Verizon's customers requested the traffic, shouldn't they try to obtain it instead of hold their users hostage as a bargaining chip against their feeds?
If someone is singlehomed to Cogent, and their connectivity sucks, it's their provider's (= Cogent's) job to fix the issue. Not use that as a lever to extort money from other ISPs. The point is that Cogent is doing a fairly aggressive "we de-peer you, and then we try to sell you transit traffic" strategy. Some people follow suit, some people refused to be blackmailed that way, and send the traffic to their upstreams. Next thing, the interconnect between those upstreams and Cogent fills up (surprise), and Cogent refuses to upgrade (because they want to sell bandwidth, no matter how much collateral damage they do to get there). At least *we* are not going to support this business model, and we encourage everyone else to also vote with their money. We happily pay large gobs of money to our upstream providers who do not try to play silly peering power games to the disadvantage of their customers (positive counterexample that we're very happy to give money to: NTT). gert -- USENET is *not* the non-clickable part of WWW! //www.muc.de/~gert/ Gert Doering - Munich, Germany gert@greenie.muc.de fax: +49-89-35655025 gert@net.informatik.tu-muenchen.de

FYI- This is the form letter that Cogent is sending to anyone who opens a ticket about the issues with Verizon. I'm starting to get a collection of them. Dear Cogent Customer, The latency and/or packet loss that you are experiencing to this destination is due to high traffic from one of our peers with Verizon. We have reached out to Verizon to request assistance resolving the amount of traffic they are sending on this peer and are awaiting their response. We will continue to reach out to them until they respond. If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368). Thank You, Cogent Communications T 877.726.4368, option 2 F 202.295.9061 E support@cogentco.com

On , Rusty Hodge wrote:
FYI- This is the form letter that Cogent is sending to anyone who opens a ticket about the issues with Verizon. I'm starting to get a collection of them.
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to high traffic from one of our peers with Verizon. We have reached out to Verizon to request assistance resolving the amount of traffic they are sending on this peer and are awaiting their response. We will continue to reach out to them until they respond.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061 E support@cogentco.com
This is what they are sending when you open a ticket about att: Dear Cogent Customer, The latency and/or packet loss that you are experiencing to this destination is due to occasional high traffic with ATT. We have repeatedly requested augments to these congestion points and hope ATT will comply soon. While this has been escalated internally to the CEO level, we encourage you to also contact ATT customer support with your concerns and complaints. Their delay is a major impediment to internet traffic overall and contrary to net neutrality requirements. Our peering engineers will continue to address this on a daily basis until resolved. If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368). Thank You, Cogent Communications T 877.726.4368, option 2 F 202.295.9061 Also there were issues between level3 and att, we managed to get Level3 to shuffle around the traffic a bit, as the peering connections were running at 100%+ as well, this made things better, but supposedly things are still pretty much full though. geoff

On 2/11/2014 1:59 PM, Geoff Brozny wrote:
On , Rusty Hodge wrote:
FYI- This is the form letter that Cogent is sending to anyone who opens a ticket about the issues with Verizon. I'm starting to get a collection of them.
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to high traffic from one of our peers with Verizon. We have reached out to Verizon to request assistance resolving the amount of traffic they are sending on this peer and are awaiting their response. We will continue to reach out to them until they respond.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061 E support@cogentco.com
This is what they are sending when you open a ticket about att:
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to occasional high traffic with ATT. We have repeatedly requested augments to these congestion points and hope ATT will comply soon. While this has been escalated internally to the CEO level, we encourage you to also contact ATT customer support with your concerns and complaints. Their delay is a major impediment to internet traffic overall and contrary to net neutrality requirements. Our peering engineers will continue to address this on a daily basis until resolved.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061
Also there were issues between level3 and att, we managed to get Level3 to shuffle around the traffic a bit, as the peering connections were running at 100%+ as well, this made things better, but supposedly things are still pretty much full though.
geoff _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Here's another response re: Verizon: The issue on this peer involves a high amount of traffic being sent to Cogent from the Verizon network. In order to resolve the congestion on that peer, Verizon needs to engineer thier routing to another peering point with Cogent that has more available space for the traffic. We have reached out to Verizon for assistance and are still awaiting a response from their peering engineers. We will continue to reach out to them until they respond.

And here's what they say about Qwest/CenturyLink - note this is verbatim from a response received today - missing words and all: Dear Cogent Customer, The latency and/or packet loss that you are experiencing to this destination is due to high traffic with Qwest. The peering connection between Cogent and has been escalated within our Senior Management. Our Peering department is actively working with to add more capacity as quickly as possible. While Cogent is prepared to commit additional capacity, we are still pending to complete their planning and provisioning process under the free peering agreement. Due to the nature of this process, we cannot determine an estimated time for this to be completed. On 02/11/2014 03:45 PM, Robert Glover wrote:
On 2/11/2014 1:59 PM, Geoff Brozny wrote:
On , Rusty Hodge wrote:
FYI- This is the form letter that Cogent is sending to anyone who opens a ticket about the issues with Verizon. I'm starting to get a collection of them.
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to high traffic from one of our peers with Verizon. We have reached out to Verizon to request assistance resolving the amount of traffic they are sending on this peer and are awaiting their response. We will continue to reach out to them until they respond.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061 E support@cogentco.com
This is what they are sending when you open a ticket about att:
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to occasional high traffic with ATT. We have repeatedly requested augments to these congestion points and hope ATT will comply soon. While this has been escalated internally to the CEO level, we encourage you to also contact ATT customer support with your concerns and complaints. Their delay is a major impediment to internet traffic overall and contrary to net neutrality requirements. Our peering engineers will continue to address this on a daily basis until resolved.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061
Also there were issues between level3 and att, we managed to get Level3 to shuffle around the traffic a bit, as the peering connections were running at 100%+ as well, this made things better, but supposedly things are still pretty much full though.
geoff _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Here's another response re: Verizon:
The issue on this peer involves a high amount of traffic being sent to Cogent from the Verizon network. In order to resolve the congestion on that peer, Verizon needs to engineer thier routing to another peering point with Cogent that has more available space for the traffic. We have reached out to Verizon for assistance and are still awaiting a response from their peering engineers. We will continue to reach out to them until they respond.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

This is why we don't buy from cogent. -----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Chris Stone Sent: Tuesday, February 11, 2014 4:51 PM To: outages@outages.org Subject: Re: [outages] Cogent /ATT and Verizon Peering alternatives And here's what they say about Qwest/CenturyLink - note this is verbatim from a response received today - missing words and all: Dear Cogent Customer, The latency and/or packet loss that you are experiencing to this destination is due to high traffic with Qwest. The peering connection between Cogent and has been escalated within our Senior Management. Our Peering department is actively working with to add more capacity as quickly as possible. While Cogent is prepared to commit additional capacity, we are still pending to complete their planning and provisioning process under the free peering agreement. Due to the nature of this process, we cannot determine an estimated time for this to be completed. On 02/11/2014 03:45 PM, Robert Glover wrote:
On 2/11/2014 1:59 PM, Geoff Brozny wrote:
On , Rusty Hodge wrote:
FYI- This is the form letter that Cogent is sending to anyone who opens a ticket about the issues with Verizon. I'm starting to get a collection of them.
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to high traffic from one of our peers with Verizon. We have reached out to Verizon to request assistance resolving the amount of traffic they are sending on this peer and are awaiting their response. We will continue to reach out to them until they respond.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061 E support@cogentco.com
This is what they are sending when you open a ticket about att:
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to occasional high traffic with ATT. We have repeatedly requested augments to these congestion points and hope ATT will comply soon. While this has been escalated internally to the CEO level, we encourage you to also contact ATT customer support with your concerns and complaints. Their delay is a major impediment to internet traffic overall and contrary to net neutrality requirements. Our peering engineers will continue to address this on a daily basis until resolved.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061
Also there were issues between level3 and att, we managed to get Level3 to shuffle around the traffic a bit, as the peering connections were running at 100%+ as well, this made things better, but supposedly things are still pretty much full though.
geoff _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Here's another response re: Verizon:
The issue on this peer involves a high amount of traffic being sent to Cogent from the Verizon network. In order to resolve the congestion on that peer, Verizon needs to engineer thier routing to another peering point with Cogent that has more available space for the traffic. We have reached out to Verizon for assistance and are still awaiting a response from their peering engineers. We will continue to reach out to them until they respond.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

We¹ve gotten a similar response as well. Dear Cogent Customer, The latency and/or packet loss that you are experiencing to this destination is due to occasional high traffic with Verizon. We have repeatedly requested augments to these congestion points and hope Verizon will comply soon. While this has been escalated internally to the CEO level, we encourage you to also contact Verizon customer support with your concerns and complaints. Their delay is a major impediment to internet traffic overall and contrary to net neutrality requirements. Our peering engineers will continue to address this on a daily basis until resolved. Shane Ronan, Vice President Technology Architect State Street Global Exchange | 1230 Avenue of the Americas, 18th Fl | New York, NY 10020 P (212) 259-3023 | M (347) 413-4503 sronan@eexchange.com On 2/11/14, 5:56 PM, "Joseph Jackson" <jjackson@aninetworks.net> wrote:
This is why we don't buy from cogent.
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Chris Stone Sent: Tuesday, February 11, 2014 4:51 PM To: outages@outages.org Subject: Re: [outages] Cogent /ATT and Verizon Peering alternatives
And here's what they say about Qwest/CenturyLink - note this is verbatim from a response received today - missing words and all:
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to high traffic with Qwest.
The peering connection between Cogent and has been escalated within our Senior Management. Our Peering department is actively working with to add more capacity as quickly as possible. While Cogent is prepared to commit additional capacity, we are still pending to complete their planning and provisioning process under the free peering agreement. Due to the nature of this process, we cannot determine an estimated time for this to be completed.
On 02/11/2014 03:45 PM, Robert Glover wrote:
On 2/11/2014 1:59 PM, Geoff Brozny wrote:
On , Rusty Hodge wrote:
FYI- This is the form letter that Cogent is sending to anyone who opens a ticket about the issues with Verizon. I'm starting to get a collection of them.
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to high traffic from one of our peers with Verizon. We have reached out to Verizon to request assistance resolving the amount of traffic they are sending on this peer and are awaiting their response. We will continue to reach out to them until they respond.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061 E support@cogentco.com
This is what they are sending when you open a ticket about att:
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to occasional high traffic with ATT. We have repeatedly requested augments to these congestion points and hope ATT will comply soon. While this has been escalated internally to the CEO level, we encourage you to also contact ATT customer support with your concerns and complaints. Their delay is a major impediment to internet traffic overall and contrary to net neutrality requirements. Our peering engineers will continue to address this on a daily basis until resolved.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061
Also there were issues between level3 and att, we managed to get Level3 to shuffle around the traffic a bit, as the peering connections were running at 100%+ as well, this made things better, but supposedly things are still pretty much full though.
geoff _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Here's another response re: Verizon:
The issue on this peer involves a high amount of traffic being sent to Cogent from the Verizon network. In order to resolve the congestion on that peer, Verizon needs to engineer thier routing to another peering point with Cogent that has more available space for the traffic. We have reached out to Verizon for assistance and are still awaiting a response from their peering engineers. We will continue to reach out to them until they respond.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
________________________________ http://www.statestreet.com/emaildisclaimer/

I have been told from people within Cogent that they keep hounding upper management, but they are doing nothing about the problems. I can see how dealing with Verizon or ATT could be difficult, but if you are in the business of providing a service, fixing the problem is your responsibility. Hence why we have moved away from Cogent. Erich AirLogic On Tue, Feb 11, 2014 at 7:44 PM, <SRonan@eexchange.com> wrote:
We¹ve gotten a similar response as well.
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to occasional high traffic with Verizon. We have repeatedly requested augments to these congestion points and hope Verizon will comply soon. While this has been escalated internally to the CEO level, we encourage you to also contact Verizon customer support with your concerns and complaints. Their delay is a major impediment to internet traffic overall and contrary to net neutrality requirements. Our peering engineers will continue to address this on a daily basis until resolved.
Shane Ronan, Vice President Technology Architect State Street Global Exchange | 1230 Avenue of the Americas, 18th Fl | New York, NY 10020 P (212) 259-3023 | M (347) 413-4503 sronan@eexchange.com
On 2/11/14, 5:56 PM, "Joseph Jackson" <jjackson@aninetworks.net> wrote:
This is why we don't buy from cogent.
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Chris Stone Sent: Tuesday, February 11, 2014 4:51 PM To: outages@outages.org Subject: Re: [outages] Cogent /ATT and Verizon Peering alternatives
And here's what they say about Qwest/CenturyLink - note this is verbatim from a response received today - missing words and all:
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to high traffic with Qwest.
The peering connection between Cogent and has been escalated within our Senior Management. Our Peering department is actively working with to add more capacity as quickly as possible. While Cogent is prepared to commit additional capacity, we are still pending to complete their planning and provisioning process under the free peering agreement. Due to the nature of this process, we cannot determine an estimated time for this to be completed.
On 02/11/2014 03:45 PM, Robert Glover wrote:
On 2/11/2014 1:59 PM, Geoff Brozny wrote:
On , Rusty Hodge wrote:
FYI- This is the form letter that Cogent is sending to anyone who opens a ticket about the issues with Verizon. I'm starting to get a collection of them.
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to high traffic from one of our peers with Verizon. We have reached out to Verizon to request assistance resolving the amount of traffic they are sending on this peer and are awaiting their response. We will continue to reach out to them until they respond.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061 E support@cogentco.com
This is what they are sending when you open a ticket about att:
Dear Cogent Customer,
The latency and/or packet loss that you are experiencing to this destination is due to occasional high traffic with ATT. We have repeatedly requested augments to these congestion points and hope ATT will comply soon. While this has been escalated internally to the CEO level, we encourage you to also contact ATT customer support with your concerns and complaints. Their delay is a major impediment to internet traffic overall and contrary to net neutrality requirements. Our peering engineers will continue to address this on a daily basis until resolved.
If you have any further questions please feel free to contact us by e-mail at support@cogentco.com or by phone at 877-7COGENT (877-726-4368).
Thank You,
Cogent Communications T 877.726.4368, option 2 F 202.295.9061
Also there were issues between level3 and att, we managed to get Level3 to shuffle around the traffic a bit, as the peering connections were running at 100%+ as well, this made things better, but supposedly things are still pretty much full though.
geoff _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Here's another response re: Verizon:
The issue on this peer involves a high amount of traffic being sent to Cogent from the Verizon network. In order to resolve the congestion on that peer, Verizon needs to engineer thier routing to another peering point with Cogent that has more available space for the traffic. We have reached out to Verizon for assistance and are still awaiting a response from their peering engineers. We will continue to reach out to them until they respond.
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
________________________________
http://www.statestreet.com/emaildisclaimer/
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (8)
-
Chris Stone
-
Erich Kaiser
-
Geoff Brozny
-
Gert Doering
-
Joseph Jackson
-
Robert Glover
-
Rusty Hodge
-
SRonan@eexchange.com