David Silvey kindly forwarded me a message. Looks like a maintenance on their end. Thanks David. [cid:6AF2749A-F20F-4108-8BED-02255F212033] Thanks, Bobin Joseph From: Wally Hass [mailto:whass@networkthinking.com] Sent: Sunday, September 18, 2016 8:59 AM To: Bobin Joseph; outages@outages.org Subject: RE: Cogent routing issues, possibly SoCal? We also saw issues this AM but seems resolved now. Wally Hass Consultant, Network Thinking Solutions, Inc [Image removed by sender.]818-707-7705 <tel:818-707-7705> [Image removed by sender.]whass@networkthinking.com <mailto:whass@networkthinking.com> | [Image removed by sender.] Skype: networkthinking<https://webapp.wisestamp.com/sig_iframe?origin=outlook&signature_id=5215201074348032&t=0.09465256404943023> [Image removed by sender.]http://www.networkthinking.com/ [Image removed by sender.]5655 Lindero Canyon Suite 705, Westlake Village, CA 91362 [Image removed by sender.]<http://www.facebook.com/NetworkThinkingSolutions/?ref=aymt_homepage_panel> [Image removed by sender.] <http://twitter.com/networkthinking> ________________________________ From: Outages [outages-bounces@outages.org] on behalf of Bobin Joseph via Outages [outages@outages.org] Sent: Sunday, September 18, 2016 08:54 To: outages@outages.org Subject: [outages] Cogent routing issues, possibly SoCal? Anybody seeing issues over their Cogent internet ckts? This is an mtr of traffic from our Dallas to San Diego site. Looks like traffic is going over to Asia before making it back. Also noticed this from my home in SD to our site in SD. Is it an issue in and out of the LAX/SoCal region? Packets Pings Host Loss% Drop Rcv Wrst Last Avg Best StDev Wrst 4. te0-0-0-2.rcr21.dfw04.atlas.cogentco.com 0.0% 0 637 2.6 1.7 1.6 1.5 0.1 2.6 5. be2938.ccr21.dfw01.atlas.cogentco.com 0.0% 0 637 4.2 2.2 2.1 1.9 0.2 4.2 6. be2432.ccr21.mci01.atlas.cogentco.com 0.2% 1 636 16.3 11.9 11.9 11.8 0.2 16.3 7. be3035.ccr21.den01.atlas.cogentco.com 0.0% 0 637 23.9 23.8 23.3 23.2 0.2 23.9 8. be3037.ccr21.slc01.atlas.cogentco.com 0.0% 0 637 34.2 33.6 33.6 33.5 0.2 34.2 9. be2085.ccr21.sea02.atlas.cogentco.com 0.8% 5 632 681.5 54.3 69.0 54.1 80.5 681.5 10. te0-0-2-0.ccr11.tyo01.atlas.cogentco.com 29.6% 188 448 165.0 150.5 157.6 148.7 3.6 165.0 11. te0-4-0-3.ccr21.hkg02.atlas.cogentco.com 29.7% 189 447 227.4 217.3 222.3 213.8 3.6 227.4 12. te0-4-0-0.ccr21.sin01.atlas.cogentco.com 32.5% 207 429 262.6 253.0 257.2 248.8 3.6 262.6 13. te0-0-0-8.ccr21.lax01.atlas.cogentco.com 47.5% 302 334 4943. 449.9 467.9 445.9 245.7 4943. 14. be2540.rcr22.lax04.atlas.cogentco.com 33.4% 212 423 452.1 422.9 428.3 414.0 8.7 452.1 Thanks, Bobin Joseph ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________

Dear Cogent Customer, The outage in Los Angeles, CA is now resolved. If you are still experiencing problems with your service, please contact our support team at 877-726-4368<tel:877-726-4368> so that we can investigate. We apologize for the inconvenience this outage caused. Thank You, Cogent Customer Support Cogent Communications support@cogentco.com<mailto:support@cogentco.com> 877-726-4368<tel:877-726-4368> David Silvey dsilvey@kelleydrye.com<mailto:dsilvey@kelleydrye.com> 212-808-5124 On Sep 18, 2016, at 12:03 PM, Darren Schreiber via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We've seen this since early AM. We called and they said it was scheduled mainteance in LAX. Which makes no sense that the next closest hop is Hong Kong... It's also on their status page. http://status.cogentco.com/<http://status.cogentco.com/> Eta 11am PT seems like a really long maintenance window... -------- Original message -------- From: Wally Hass via Outages <outages@outages.org<mailto:outages@outages.org>> Date: 9/18/16 9:00 AM (GMT-08:00) To: Bobin Joseph <Bobin.Joseph@mitchell.com<mailto:Bobin.Joseph@mitchell.com>>, outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Cogent routing issues, possibly SoCal? We also saw issues this AM but seems resolved now. Wally Hass Consultant, Network Thinking Solutions, Inc [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/phone2.png] 818-707-7705 <tel:818-707-7705> [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/email1.png] whass@networkthinking.com <mailto:whass@networkthinking.com> | [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/social.png] Skype: networkthinking<https://webapp.wisestamp.com/sig_iframe?origin=outlook&signature_id=5215201074348032&t=0.09465256404943023#> [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/website.png] http://www.networkthinking.com/ <http://www.networkthinking.com/> [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/address1.pn...] 5655 Lindero Canyon Suite 705, Westlake Village, CA 91362 [https://s3.amazonaws.com/images.wisestamp.com/icons_32/facebook.png]<http://www.facebook.com/NetworkThinkingSolutions/?ref=aymt_homepage_panel> [https://s3.amazonaws.com/images.wisestamp.com/icons_32/twitter.png] <http://twitter.com/networkthinking> ________________________________ From: Outages [outages-bounces@outages.org<mailto:outages-bounces@outages.org>] on behalf of Bobin Joseph via Outages [outages@outages.org<mailto:outages@outages.org>] Sent: Sunday, September 18, 2016 08:54 To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Cogent routing issues, possibly SoCal? Anybody seeing issues over their Cogent internet ckts? This is an mtr of traffic from our Dallas to San Diego site. Looks like traffic is going over to Asia before making it back. Also noticed this from my home in SD to our site in SD. Is it an issue in and out of the LAX/SoCal region? Packets Pings Host Loss% Drop Rcv Wrst Last Avg Best StDev Wrst 4. te0-0-0-2.rcr21.dfw04.atlas.cogentco.com<http://rcr21.dfw04.atlas.cogentco.com> 0.0% 0 637 2.6 1.7 1.6 1.5 0.1 2.6 5. be2938.ccr21.dfw01.atlas.cogentco.com<http://ccr21.dfw01.atlas.cogentco.com> 0.0% 0 637 4.2 2.2 2.1 1.9 0.2 4.2 6. be2432.ccr21.mci01.atlas.cogentco.com<http://ccr21.mci01.atlas.cogentco.com> 0.2% 1 636 16.3 11.9 11.9 11.8 0.2 16.3 7. be3035.ccr21.den01.atlas.cogentco.com<http://ccr21.den01.atlas.cogentco.com> 0.0% 0 637 23.9 23.8 23.3 23.2 0.2 23.9 8. be3037.ccr21.slc01.atlas.cogentco.com<http://ccr21.slc01.atlas.cogentco.com> 0.0% 0 637 34.2 33.6 33.6 33.5 0.2 34.2 9. be2085.ccr21.sea02.atlas.cogentco.com<http://ccr21.sea02.atlas.cogentco.com> 0.8% 5 632 681.5 54.3 69.0 54.1 80.5 681.5 10. te0-0-2-0.ccr11.tyo01.atlas.cogentco.com<http://ccr11.tyo01.atlas.cogentco.com> 29.6% 188 448 165.0 150.5 157.6 148.7 3.6 165.0 11. te0-4-0-3.ccr21.hkg02.atlas.cogentco.com<http://ccr21.hkg02.atlas.cogentco.com> 29.7% 189 447 227.4 217.3 222.3 213.8 3.6 227.4 12. te0-4-0-0.ccr21.sin01.atlas.cogentco.com<http://ccr21.sin01.atlas.cogentco.com> 32.5% 207 429 262.6 253.0 257.2 248.8 3.6 262.6 13. te0-0-0-8.ccr21.lax01.atlas.cogentco.com<http://ccr21.lax01.atlas.cogentco.com> 47.5% 302 334 4943. 449.9 467.9 445.9 245.7 4943. 14. be2540.rcr22.lax04.atlas.cogentco.com<http://rcr22.lax04.atlas.cogentco.com> 33.4% 212 423 452.1 422.9 428.3 414.0 8.7 452.1 Thanks, Bobin Joseph ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com<http://www.symanteccloud.com> ______________________________________________________________________ _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender. This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use.

We are also having problems in LA. From: Nick W [mailto:nickdwhite@gmail.com] Sent: Monday, September 19, 2016 2:46 PM To: Silvey, David <DSilvey@KelleyDrye.com> Cc: outages@outages.org Subject: Re: [outages] Cogent routing issues, possibly SoCal? Anyone else seeing issues again? I see them from TX to NV/CA. Had to shut down our Cogent peer. Started at 11:35AM Pacific/1:35PM Central... about 10 minutes ago. Don't see anything on the Cogent status page. On Sun, Sep 18, 2016 at 4:48 PM, Silvey, David via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Dear Cogent Customer, The outage in Los Angeles, CA is now resolved. If you are still experiencing problems with your service, please contact our support team at 877-726-4368<tel:877-726-4368> so that we can investigate. We apologize for the inconvenience this outage caused. Thank You, Cogent Customer Support Cogent Communications support@cogentco.com<mailto:support@cogentco.com> 877-726-4368<tel:877-726-4368> David Silvey dsilvey@kelleydrye.com<mailto:dsilvey@kelleydrye.com> 212-808-5124<tel:212-808-5124> On Sep 18, 2016, at 12:03 PM, Darren Schreiber via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We've seen this since early AM. We called and they said it was scheduled mainteance in LAX. Which makes no sense that the next closest hop is Hong Kong... It's also on their status page. http://status.cogentco.com/<http://status.cogentco.com/> Eta 11am PT seems like a really long maintenance window... -------- Original message -------- From: Wally Hass via Outages <outages@outages.org<mailto:outages@outages.org>> Date: 9/18/16 9:00 AM (GMT-08:00) To: Bobin Joseph <Bobin.Joseph@mitchell.com<mailto:Bobin.Joseph@mitchell.com>>, outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Cogent routing issues, possibly SoCal? We also saw issues this AM but seems resolved now. Wally Hass Consultant, Network Thinking Solutions, Inc [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/phone2.png]818-707-7705 <tel:818-707-7705> [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/email1.png]whass@networkthinking.com <mailto:whass@networkthinking.com> | [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/social.png] Skype: networkthinking<https://webapp.wisestamp.com/sig_iframe?origin=outlook&signature_id=5215201074348032&t=0.09465256404943023#> [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/website.png]http://www.networkthinking.com/ <http://www.networkthinking.com/> [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/address1.png]5655 Lindero Canyon Suite 705, Westlake Village, CA 91362 [https://s3.amazonaws.com/images.wisestamp.com/icons_32/facebook.png]<http://www.facebook.com/NetworkThinkingSolutions/?ref=aymt_homepage_panel> [https://s3.amazonaws.com/images.wisestamp.com/icons_32/twitter.png] <http://twitter.com/networkthinking> ________________________________ From: Outages [outages-bounces@outages.org<mailto:outages-bounces@outages.org>] on behalf of Bobin Joseph via Outages [outages@outages.org<mailto:outages@outages.org>] Sent: Sunday, September 18, 2016 08:54 To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Cogent routing issues, possibly SoCal? Anybody seeing issues over their Cogent internet ckts? This is an mtr of traffic from our Dallas to San Diego site. Looks like traffic is going over to Asia before making it back. Also noticed this from my home in SD to our site in SD. Is it an issue in and out of the LAX/SoCal region? Packets Pings Host Loss% Drop Rcv Wrst Last Avg Best StDev Wrst 4. te0-0-0-2.rcr21.dfw04.atlas.cogentco.com<http://rcr21.dfw04.atlas.cogentco.com> 0.0% 0 637 2.6 1.7 1.6 1.5 0.1 2.6 5. be2938.ccr21.dfw01.atlas.cogentco.com<http://ccr21.dfw01.atlas.cogentco.com> 0.0% 0 637 4.2 2.2 2.1 1.9 0.2 4.2 6. be2432.ccr21.mci01.atlas.cogentco.com<http://ccr21.mci01.atlas.cogentco.com> 0.2% 1 636 16.3 11.9 11.9 11.8 0.2 16.3 7. be3035.ccr21.den01.atlas.cogentco.com<http://ccr21.den01.atlas.cogentco.com> 0.0% 0 637 23.9 23.8 23.3 23.2 0.2 23.9 8. be3037.ccr21.slc01.atlas.cogentco.com<http://ccr21.slc01.atlas.cogentco.com> 0.0% 0 637 34.2 33.6 33.6 33.5 0.2 34.2 9. be2085.ccr21.sea02.atlas.cogentco.com<http://ccr21.sea02.atlas.cogentco.com> 0.8% 5 632 681.5 54.3 69.0 54.1 80.5 681.5 10. te0-0-2-0.ccr11.tyo01.atlas.cogentco.com<http://ccr11.tyo01.atlas.cogentco.com> 29.6% 188 448 165.0 150.5 157.6 148.7 3.6 165.0 11. te0-4-0-3.ccr21.hkg02.atlas.cogentco.com<http://ccr21.hkg02.atlas.cogentco.com> 29.7% 189 447 227.4 217.3 222.3 213.8 3.6 227.4 12. te0-4-0-0.ccr21.sin01.atlas.cogentco.com<http://ccr21.sin01.atlas.cogentco.com> 32.5% 207 429 262.6 253.0 257.2 248.8 3.6 262.6 13. te0-0-0-8.ccr21.lax01.atlas.cogentco.com<http://ccr21.lax01.atlas.cogentco.com> 47.5% 302 334 4943<tel:302%C2%A0%C2%A0%20334%204943>. 449.9 467.9 445.9 245.7 4943. 14. be2540.rcr22.lax04.atlas.cogentco.com<http://rcr22.lax04.atlas.cogentco.com> 33.4% 212 423 452.1 422.9 428.3 414.0 8.7 452.1 Thanks, Bobin Joseph ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com<http://www.symanteccloud.com> ______________________________________________________________________ _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://puck.nether.net/mailman/listinfo/outages> The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender. This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages<https://puck.nether.net/mailman/listinfo/outages> The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender. This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use.

Yes, seeing issues between IAD and LAX on the Cogent network. On Mon, Sep 19, 2016 at 2:49 PM, Randall (Randy) Raitz via Outages < outages@outages.org> wrote:

We just observed similar issues with Cogent in the path as well. We’re in the El Segundo / LAX area.

*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Silvey, David via Outages *Sent:* Monday, September 19, 2016 12:47 PM *To:* 'Nick W'

*Cc:* outages@outages.org *Subject:* Re: [outages] Cogent routing issues, possibly SoCal?

We are also having problems in LA.

*From:* Nick W [mailto:nickdwhite@gmail.com <nickdwhite@gmail.com>] *Sent:* Monday, September 19, 2016 2:46 PM *To:* Silvey, David <DSilvey@KelleyDrye.com> *Cc:* outages@outages.org *Subject:* Re: [outages] Cogent routing issues, possibly SoCal?

Anyone else seeing issues again? I see them from TX to NV/CA. Had to shut down our Cogent peer.

Started at 11:35AM Pacific/1:35PM Central... about 10 minutes ago. Don't see anything on the Cogent status page.

On Sun, Sep 18, 2016 at 4:48 PM, Silvey, David via Outages < outages@outages.org> wrote:

Dear Cogent Customer,

The outage in Los Angeles, CA is now resolved.

If you are still experiencing problems with your service, please contact our support team at 877-726-4368 so that we can investigate.

We apologize for the inconvenience this outage caused.

Thank You,

Cogent Customer Support Cogent Communications support@cogentco.com 877-726-4368

David Silvey

dsilvey@kelleydrye.com

212-808-5124

On Sep 18, 2016, at 12:03 PM, Darren Schreiber via Outages < outages@outages.org> wrote:

We've seen this since early AM. We called and they said it was scheduled mainteance in LAX. Which makes no sense that the next closest hop is Hong Kong...

It's also on their status page. http://status.cogentco.com/

Eta 11am PT seems like a really long maintenance window...

-------- Original message --------

From: Wally Hass via Outages <outages@outages.org>

Date: 9/18/16 9:00 AM (GMT-08:00)

To: Bobin Joseph <Bobin.Joseph@mitchell.com>, outages@outages.org

Subject: Re: [outages] Cogent routing issues, possibly SoCal?

We also saw issues this AM but seems resolved now.

Wally Hass Consultant, Network Thinking Solutions, Inc

818-707-7705

whass@networkthinking.com | Skype: networkthinking <https://webapp.wisestamp.com/sig_iframe?origin=outlook&signature_id=5215201074348032&t=0.09465256404943023>

http://www.networkthinking.com/

5655 Lindero Canyon Suite 705, Westlake Village, CA 91362

<http://www.facebook.com/NetworkThinkingSolutions/?ref=aymt_homepage_panel> <http://twitter.com/networkthinking> ------------------------------

*From:* Outages [outages-bounces@outages.org] on behalf of Bobin Joseph via Outages [outages@outages.org] *Sent:* Sunday, September 18, 2016 08:54 *To:* outages@outages.org *Subject:* [outages] Cogent routing issues, possibly SoCal?

Anybody seeing issues over their Cogent internet ckts? This is an mtr of traffic from our Dallas to San Diego site. Looks like traffic is going over to Asia before making it back.

Also noticed this from my home in SD to our site in SD.

Is it an issue in and out of the LAX/SoCal region?

Packets Pings

Host Loss% Drop Rcv Wrst Last Avg Best StDev Wrst

4. te0-0-0-2.rcr21.dfw04.atlas.cogentco.com 0.0% 0 637 2.6 1.7 1.6 1.5 0.1 2.6

5. be2938.ccr21.dfw01.atlas.cogentco.com 0.0% 0 637 4.2 2.2 2.1 1.9 0.2 4.2

6. be2432.ccr21.mci01.atlas.cogentco.com 0.2% 1 636 16.3 11.9 11.9 11.8 0.2 16.3

7. be3035.ccr21.den01.atlas.cogentco.com 0.0% 0 637 23.9 23.8 23.3 23.2 0.2 23.9

8. be3037.ccr21.slc01.atlas.cogentco.com 0.0% 0 637 34.2 33.6 33.6 33.5 0.2 34.2

9. be2085.ccr21.sea02.atlas.cogentco.com 0.8% 5 632 681.5 54.3 69.0 54.1 80.5 681.5

10. te0-0-2-0.ccr11.tyo01.atlas.cogentco.com 29.6% 188 448 165.0 150.5 157.6 148.7 3.6 165.0

11. te0-4-0-3.ccr21.hkg02.atlas.cogentco.com 29.7% 189 447 227.4 217.3 222.3 213.8 3.6 227.4

12. te0-4-0-0.ccr21.sin01.atlas.cogentco.com 32.5% 207 429 262.6 253.0 257.2 248.8 3.6 262.6

13. te0-0-0-8.ccr21.lax01.atlas.cogentco.com 47.5% 302 334 4943. 449.9 467.9 445.9 245.7 4943.

14. be2540.rcr22.lax04.atlas.cogentco.com 33.4% 212 423 452.1 422.9 428.3 414.0 8.7 452.1

Thanks,

Bobin Joseph

______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________

_______________________________________________ Outages mailing list Outages@outages.org https://protect-us.mimecast.com/s/27lzBWcng0roTE <https://puck.nether.net/mailman/listinfo/outages>

The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender.

This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use.

_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender.

This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use.

*Disclaimer*

The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived.

_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

-- *James Cornman* *Chief Technology Officer*jcornman@atlanticmetro.net 212.792.9950 - ext 101 *Atlantic Metro Communications* *4 Century Drive, Parsippany NJ 07054* *Colocation • Cloud Hosting • Network Connectivity • Managed Services* Follow us on Twitter: @atlanticmetro <https://twitter.com/atlanticmetro> *• Like us on Facebook <https://www.facebook.com/atlanticmetro>* www.atlanticmetro.net

I just checked a url that one of our customers reported yesterday and it looks fine right now from their looking glass, no crazy routing like yesterday(Chicago->Kanas City->Denver->Salt Lake->Seattle->Tokyo->Hong Kong->SIN->LAX->las vegas for data center.). So if they are having an issue it may be on a different router than yesterday. Yesterday cogent told me the issue was on LAX4. On Mon, Sep 19, 2016 at 2:49 PM, Randall (Randy) Raitz via Outages < outages@outages.org> wrote:

We just observed similar issues with Cogent in the path as well. We’re in the El Segundo / LAX area.

*From:* Outages [mailto:outages-bounces@outages.org] *On Behalf Of *Silvey, David via Outages *Sent:* Monday, September 19, 2016 12:47 PM *To:* 'Nick W'

*Cc:* outages@outages.org *Subject:* Re: [outages] Cogent routing issues, possibly SoCal?

We are also having problems in LA.

*From:* Nick W [mailto:nickdwhite@gmail.com <nickdwhite@gmail.com>] *Sent:* Monday, September 19, 2016 2:46 PM *To:* Silvey, David <DSilvey@KelleyDrye.com> *Cc:* outages@outages.org *Subject:* Re: [outages] Cogent routing issues, possibly SoCal?

Anyone else seeing issues again? I see them from TX to NV/CA. Had to shut down our Cogent peer.

Started at 11:35AM Pacific/1:35PM Central... about 10 minutes ago. Don't see anything on the Cogent status page.

On Sun, Sep 18, 2016 at 4:48 PM, Silvey, David via Outages < outages@outages.org> wrote:

Dear Cogent Customer,

The outage in Los Angeles, CA is now resolved.

If you are still experiencing problems with your service, please contact our support team at 877-726-4368 so that we can investigate.

We apologize for the inconvenience this outage caused.

Thank You,

Cogent Customer Support Cogent Communications support@cogentco.com 877-726-4368

David Silvey

dsilvey@kelleydrye.com

212-808-5124

On Sep 18, 2016, at 12:03 PM, Darren Schreiber via Outages < outages@outages.org> wrote:

We've seen this since early AM. We called and they said it was scheduled mainteance in LAX. Which makes no sense that the next closest hop is Hong Kong...

It's also on their status page. http://status.cogentco.com/

Eta 11am PT seems like a really long maintenance window...

-------- Original message --------

From: Wally Hass via Outages <outages@outages.org>

Date: 9/18/16 9:00 AM (GMT-08:00)

To: Bobin Joseph <Bobin.Joseph@mitchell.com>, outages@outages.org

Subject: Re: [outages] Cogent routing issues, possibly SoCal?

We also saw issues this AM but seems resolved now.

Wally Hass Consultant, Network Thinking Solutions, Inc

818-707-7705

whass@networkthinking.com | Skype: networkthinking <https://webapp.wisestamp.com/sig_iframe?origin=outlook&signature_id=5215201074348032&t=0.09465256404943023>

http://www.networkthinking.com/

5655 Lindero Canyon Suite 705, Westlake Village, CA 91362

<http://www.facebook.com/NetworkThinkingSolutions/?ref=aymt_homepage_panel> <http://twitter.com/networkthinking> ------------------------------

*From:* Outages [outages-bounces@outages.org] on behalf of Bobin Joseph via Outages [outages@outages.org] *Sent:* Sunday, September 18, 2016 08:54 *To:* outages@outages.org *Subject:* [outages] Cogent routing issues, possibly SoCal?

Anybody seeing issues over their Cogent internet ckts? This is an mtr of traffic from our Dallas to San Diego site. Looks like traffic is going over to Asia before making it back.

Also noticed this from my home in SD to our site in SD.

Is it an issue in and out of the LAX/SoCal region?

Packets Pings

Host Loss% Drop Rcv Wrst Last Avg Best StDev Wrst

4. te0-0-0-2.rcr21.dfw04.atlas.cogentco.com 0.0% 0 637 2.6 1.7 1.6 1.5 0.1 2.6

5. be2938.ccr21.dfw01.atlas.cogentco.com 0.0% 0 637 4.2 2.2 2.1 1.9 0.2 4.2

6. be2432.ccr21.mci01.atlas.cogentco.com 0.2% 1 636 16.3 11.9 11.9 11.8 0.2 16.3

7. be3035.ccr21.den01.atlas.cogentco.com 0.0% 0 637 23.9 23.8 23.3 23.2 0.2 23.9

8. be3037.ccr21.slc01.atlas.cogentco.com 0.0% 0 637 34.2 33.6 33.6 33.5 0.2 34.2

9. be2085.ccr21.sea02.atlas.cogentco.com 0.8% 5 632 681.5 54.3 69.0 54.1 80.5 681.5

10. te0-0-2-0.ccr11.tyo01.atlas.cogentco.com 29.6% 188 448 165.0 150.5 157.6 148.7 3.6 165.0

11. te0-4-0-3.ccr21.hkg02.atlas.cogentco.com 29.7% 189 447 227.4 217.3 222.3 213.8 3.6 227.4

12. te0-4-0-0.ccr21.sin01.atlas.cogentco.com 32.5% 207 429 262.6 253.0 257.2 248.8 3.6 262.6

13. te0-0-0-8.ccr21.lax01.atlas.cogentco.com 47.5% 302 334 4943. 449.9 467.9 445.9 245.7 4943.

14. be2540.rcr22.lax04.atlas.cogentco.com 33.4% 212 423 452.1 422.9 428.3 414.0 8.7 452.1

Thanks,

Bobin Joseph

______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________

_______________________________________________ Outages mailing list Outages@outages.org https://protect-us.mimecast.com/s/27lzBWcng0roTE <https://puck.nether.net/mailman/listinfo/outages>

The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender.

This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use.

_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender.

This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use.

*Disclaimer*

The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful.

This email has been scanned for viruses and malware, and may have been automatically archived.

_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Same here. We have a connection out of Coresite LA2 and it looks like the next hop is Hong Kong.... We have dropped our BGP session with them for the time being… 5 12 ms 11 ms 9 ms be2880.ccr21.lax01.atlas.cogentco.com [154.54.29.229] 6 * * * Request timed out. 7 * 248 ms 248 ms te0-3-0-0.ccr21.hkg02.atlas.cogentco.com [154.54.84.121] 8 310 ms 308 ms * te0-0-1-3.ccr11.tyo01.atlas.cogentco.com [154.54.84.65] 9 * 397 ms * te0-1-0-34.ccr21.sea02.atlas.cogentco.com [154.54.84.154] Harley From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Silvey, David via Outages Sent: Monday, September 19, 2016 11:47 AM To: 'Nick W' <nickdwhite@gmail.com> Cc: outages@outages.org Subject: SPAM: Re: [outages] Cogent routing issues, possibly SoCal? We are also having problems in LA. From: Nick W [mailto:nickdwhite@gmail.com] Sent: Monday, September 19, 2016 2:46 PM To: Silvey, David <DSilvey@KelleyDrye.com<mailto:DSilvey@KelleyDrye.com>> Cc: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Cogent routing issues, possibly SoCal? Anyone else seeing issues again? I see them from TX to NV/CA. Had to shut down our Cogent peer. Started at 11:35AM Pacific/1:35PM Central... about 10 minutes ago. Don't see anything on the Cogent status page. On Sun, Sep 18, 2016 at 4:48 PM, Silvey, David via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Dear Cogent Customer, The outage in Los Angeles, CA is now resolved. If you are still experiencing problems with your service, please contact our support team at 877-726-4368<tel:877-726-4368> so that we can investigate. We apologize for the inconvenience this outage caused. Thank You, Cogent Customer Support Cogent Communications support@cogentco.com<mailto:support@cogentco.com> 877-726-4368<tel:877-726-4368> David Silvey dsilvey@kelleydrye.com<mailto:dsilvey@kelleydrye.com> 212-808-5124<tel:212-808-5124> On Sep 18, 2016, at 12:03 PM, Darren Schreiber via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: We've seen this since early AM. We called and they said it was scheduled mainteance in LAX. Which makes no sense that the next closest hop is Hong Kong... It's also on their status page. http://status.cogentco.com/ Eta 11am PT seems like a really long maintenance window... -------- Original message -------- From: Wally Hass via Outages <outages@outages.org<mailto:outages@outages.org>> Date: 9/18/16 9:00 AM (GMT-08:00) To: Bobin Joseph <Bobin.Joseph@mitchell.com<mailto:Bobin.Joseph@mitchell.com>>, outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Cogent routing issues, possibly SoCal? We also saw issues this AM but seems resolved now. Wally Hass Consultant, Network Thinking Solutions, Inc [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/phone2.png]818-707-7705 <tel:818-707-7705> [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/email1.png]whass@networkthinking.com <mailto:whass@networkthinking.com> | [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/social.png] Skype: networkthinking<https://webapp.wisestamp.com/sig_iframe?origin=outlook&signature_id=5215201074348032&t=0.09465256404943023> [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/website.png]http://www.networkthinking.com/ [https://s3.amazonaws.com/images.wisestamp.com/symbols/grey/small/address1.png]5655 Lindero Canyon Suite 705, Westlake Village, CA 91362 [https://s3.amazonaws.com/images.wisestamp.com/icons_32/facebook.png]<http://www.facebook.com/NetworkThinkingSolutions/?ref=aymt_homepage_panel> [https://s3.amazonaws.com/images.wisestamp.com/icons_32/twitter.png] <http://twitter.com/networkthinking> ________________________________ From: Outages [outages-bounces@outages.org<mailto:outages-bounces@outages.org>] on behalf of Bobin Joseph via Outages [outages@outages.org<mailto:outages@outages.org>] Sent: Sunday, September 18, 2016 08:54 To: outages@outages.org<mailto:outages@outages.org> Subject: [outages] Cogent routing issues, possibly SoCal? Anybody seeing issues over their Cogent internet ckts? This is an mtr of traffic from our Dallas to San Diego site. Looks like traffic is going over to Asia before making it back. Also noticed this from my home in SD to our site in SD. Is it an issue in and out of the LAX/SoCal region? Packets Pings Host Loss% Drop Rcv Wrst Last Avg Best StDev Wrst 4. te0-0-0-2.rcr21.dfw04.atlas.cogentco.com<http://rcr21.dfw04.atlas.cogentco.com> 0.0% 0 637 2.6 1.7 1.6 1.5 0.1 2.6 5. be2938.ccr21.dfw01.atlas.cogentco.com<http://ccr21.dfw01.atlas.cogentco.com> 0.0% 0 637 4.2 2.2 2.1 1.9 0.2 4.2 6. be2432.ccr21.mci01.atlas.cogentco.com<http://ccr21.mci01.atlas.cogentco.com> 0.2% 1 636 16.3 11.9 11.9 11.8 0.2 16.3 7. be3035.ccr21.den01.atlas.cogentco.com<http://ccr21.den01.atlas.cogentco.com> 0.0% 0 637 23.9 23.8 23.3 23.2 0.2 23.9 8. be3037.ccr21.slc01.atlas.cogentco.com<http://ccr21.slc01.atlas.cogentco.com> 0.0% 0 637 34.2 33.6 33.6 33.5 0.2 34.2 9. be2085.ccr21.sea02.atlas.cogentco.com<http://ccr21.sea02.atlas.cogentco.com> 0.8% 5 632 681.5 54.3 69.0 54.1 80.5 681.5 10. te0-0-2-0.ccr11.tyo01.atlas.cogentco.com<http://ccr11.tyo01.atlas.cogentco.com> 29.6% 188 448 165.0 150.5 157.6 148.7 3.6 165.0 11. te0-4-0-3.ccr21.hkg02.atlas.cogentco.com<http://ccr21.hkg02.atlas.cogentco.com> 29.7% 189 447 227.4 217.3 222.3 213.8 3.6 227.4 12. te0-4-0-0.ccr21.sin01.atlas.cogentco.com<http://ccr21.sin01.atlas.cogentco.com> 32.5% 207 429 262.6 253.0 257.2 248.8 3.6 262.6 13. te0-0-0-8.ccr21.lax01.atlas.cogentco.com<http://ccr21.lax01.atlas.cogentco.com> 47.5% 302 334 4943<tel:302%C2%A0%C2%A0%20334%204943>. 449.9 467.9 445.9 245.7 4943. 14. be2540.rcr22.lax04.atlas.cogentco.com<http://rcr22.lax04.atlas.cogentco.com> 33.4% 212 423 452.1 422.9 428.3 414.0 8.7 452.1 Thanks, Bobin Joseph ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://protect-us.mimecast.com/s/27lzBWcng0roTE<https://puck.nether.net/mailman/listinfo/outages> The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender. This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use. _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender. This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use.

http://status.cogentco.com/ Cogent Network Status Report Last Updated Mon Sep 19 18:52:09 2016 GMT The Cogent Network Operations Center is currently investigating an outage in the Los Angeles area. The master case is HD6655601. There is no estimated time to repair. Some customers in the Raleigh North Carolina area may be experiencing a loss of connectivity. Engineers are currently investigating but there is no estimated time to repair at this time. The master case is HD6655487 From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Justin via Outages Sent: Monday, September 19, 2016 13:51 To: Silvey, David <DSilvey@kelleydrye.com> Cc: outages@outages.org Subject: Re: [outages] Cogent routing issues, possibly SoCal? Yes I see issues in LA too. Time frame: https://i.imgur.com/UrNtaxs.png Map: https://i.imgur.com/qI3v1yR.png On Mon, Sep 19, 2016 at 2:47 PM, Silvey, David via Outages <mailto:outages@outages.org> wrote: We are also having problems in LA.   From: Nick W [mailto:mailto:nickdwhite@gmail.com] Sent: Monday, September 19, 2016 2:46 PM To: Silvey, David <DSilvey@KelleyDrye.com> Cc: mailto:outages@outages.org Subject: Re: [outages] Cogent routing issues, possibly SoCal?   Anyone else seeing issues again? I see them from TX to NV/CA. Had to shut down our Cogent peer.   Started at 11:35AM Pacific/1:35PM Central... about 10 minutes ago. Don't see anything on the Cogent status page.    On Sun, Sep 18, 2016 at 4:48 PM, Silvey, David via Outages <mailto:outages@outages.org> wrote:   Dear Cogent Customer, The outage in Los Angeles, CA  is now resolved. If you are still experiencing problems with your service, please contact our support team at tel:877-726-4368 so that we can investigate.  We apologize for the inconvenience this outage caused. Thank You, Cogent Customer Support  Cogent Communications  mailto:support@cogentco.com tel:877-726-4368 David Silvey mailto:dsilvey@kelleydrye.com tel:212-808-5124   On Sep 18, 2016, at 12:03 PM, Darren Schreiber via Outages <mailto:outages@outages.org> wrote: We've seen this since early AM. We called and they said it was scheduled mainteance in LAX. Which makes no sense that the next closest hop is Hong Kong...   It's also on their status page. http://status.cogentco.com/   Eta 11am PT seems like a really long maintenance window...     -------- Original message -------- From: Wally Hass via Outages <mailto:outages@outages.org> Date: 9/18/16 9:00 AM (GMT-08:00) To: Bobin Joseph <mailto:Bobin.Joseph@mitchell.com>, mailto:outages@outages.org Subject: Re: [outages] Cogent routing issues, possibly SoCal?   We also saw issues this AM but seems resolved now.   Wally Hass Consultant, Network Thinking Solutions, Inc tel:818-707-7705 mailto:whass@networkthinking.com| Skype: https://webapp.wisestamp.com/sig_iframe?origin=outlook&signature_id=52152010... http://www.networkthinking.com/ 5655 Lindero Canyon Suite 705, Westlake Village, CA 91362 http://www.facebook.com/NetworkThinkingSolutions/?ref=aymt_homepage_panel http://twitter.com/networkthinking ________________________________________ From: Outages [mailto:outages-bounces@outages.org] on behalf of Bobin Joseph via Outages [mailto:outages@outages.org] Sent: Sunday, September 18, 2016 08:54 To: mailto:outages@outages.org Subject: [outages] Cogent routing issues, possibly SoCal? Anybody seeing issues over their Cogent internet ckts? This is an mtr of traffic from our Dallas to San Diego site. Looks like traffic is going over to Asia before making it back. Also noticed this from my home in SD to our site in SD.   Is it an issue in and out of the LAX/SoCal region?                                                                           Packets               Pings               Host                                                                 Loss% Drop   Rcv  Wrst   Last   Avg  Best StDev  Wrst   4. te0-0-0-2.http://rcr21.dfw04.atlas.cogentco.com                           0.0%    0   637   2.6    1.7   1.6   1.5   0.1   2.6  5. be2938.http://ccr21.dfw01.atlas.cogentco.com                              0.0%    0   637   4.2    2.2   2.1   1.9   0.2   4.2  6. be2432.http://ccr21.mci01.atlas.cogentco.com                              0.2%    1   636  16.3   11.9  11.9  11.8   0.2  16.3  7. be3035.http://ccr21.den01.atlas.cogentco.com                              0.0%    0   637  23.9   23.8  23.3  23.2   0.2  23.9  8. be3037.http://ccr21.slc01.atlas.cogentco.com                              0.0%    0   637  34.2   33.6  33.6  33.5   0.2  34.2  9. be2085.http://ccr21.sea02.atlas.cogentco.com                              0.8%    5   632 681.5   54.3  69.0  54.1  80.5 681.5 10. te0-0-2-0.http://ccr11.tyo01.atlas.cogentco.com                          29.6%  188   448 165.0  150.5 157.6 148.7   3.6 165.0 11. te0-4-0-3.http://ccr21.hkg02.atlas.cogentco.com                          29.7%  189   447 227.4  217.3 222.3 213.8   3.6 227.4 12. te0-4-0-0.http://ccr21.sin01.atlas.cogentco.com                          32.5%  207   429 262.6  253.0 257.2 248.8   3.6 262.6 13. te0-0-0-8.http://ccr21.lax01.atlas.cogentco.com                          47.5%  tel:302%C2%A0%C2%A0%20334%204943.  449.9 467.9 445.9 245.7 4943. 14. be2540.http://rcr22.lax04.atlas.cogentco.com                             33.4%  212   423 452.1  422.9 428.3 414.0   8.7 452.1     Thanks, Bobin Joseph   ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit http://www.symanteccloud.com ______________________________________________________________________ _______________________________________________ Outages mailing list mailto:Outages@outages.org https://puck.nether.net/mailman/listinfo/outages The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender. This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use. _______________________________________________ Outages mailing list mailto:Outages@outages.org https://puck.nether.net/mailman/listinfo/outages   The information contained in this E-mail message is privileged, confidential, and may be protected from disclosure; please be aware that any other use, printing, copying, disclosure or dissemination of this communication may be subject to legal restriction or sanction. If you think that you have received this E-mail message in error, please reply to the sender. This E-mail message and any attachments have been scanned for viruses and are believed to be free of any virus or other defect that might affect any computer system into which it is received and opened. However, it is the responsibility of the recipient to ensure that it is virus free and no responsibility is accepted by Kelley Drye & Warren LLP for any loss or damage arising in any way from its use. _______________________________________________ Outages mailing list mailto:Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

On 9/19/16 12:08, Mason Moody via Outages wrote:

I wonder if the issues around Los Angeles are having knock-on effects further out. I am seeing traffic from San Francisco going spotty:

Could be causing overloading on links that were already running hot and are now trying to take on additional traffic. ~Seth

From our status board: [cid:image001.png@01D21289.9BBA67F0] [cid:image002.png@01D21289.9BBA67F0] Richard Walz | INDATA Director of IT rwalz@indataipm.com<mailto:rwalz@indataipm.com> | (203) 302-7114<tel:12033027114> From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Mason Moody via Outages Sent: Monday, September 19, 2016 3:08 PM To: outages@outages.org Subject: Re: [outages] Cogent routing issues, possibly SoCal? I wonder if the issues around Los Angeles are having knock-on effects further out. I am seeing traffic from San Francisco going spotty: HOST: bespin Loss% Snt Last Avg Best Wrst StDev 3.|-- te0-0-1-3.agr12.sjc01.atlas.cogentco.com 0.0% 50 1.2 1.3 1.1 3.6 0.4 4.|-- te0-7-0-21.ccr21.sjc01.atlas.cogentco.com 0.0% 50 1.0 1.2 0.9 2.6 0.3 5.|-- be2164.ccr21.sfo01.atlas.cogentco.com 58.0% 50 372.3 374.1 363.2 389.1 7.0 6.|-- be2086.ccr21.slc01.atlas.cogentco.com 32.0% 50 424.3 430.0 413.2 473.4 16.3 7.|-- be3038.ccr22.den01.atlas.cogentco.com 94.0% 50 28.2 28.3 28.2 28.4 0.0 8.|-- be3036.ccr22.mci01.atlas.cogentco.com 88.0% 50 40.1 40.0 39.7 40.1 0.0 9.|-- be2832.ccr42.ord01.atlas.cogentco.com 92.0% 50 51.9 52.0 51.9 52.1 0.0 10.|-- be2736.ccr42.atl01.atlas.cogentco.com 98.0% 50 73.2 73.2 73.2 73.2 0.0 11.|-- be2785.rcr12.jax01.atlas.cogentco.com 18.0% 50 77.5 79.7 77.5 83.0 1.2 12.|-- te0-0-2-0.rcr12.mco01.atlas.cogentco.com 26.0% 50 81.0 83.0 80.8 84.3 1.0 13.|-- te0-0-1-3.nr11.b006655-1.mco01.atlas.cogentco.com 24.0% 50 81.9 83.8 81.7 85.5 1.1 14.|-- 38.104.89.122 16.0% 50 80.5 83.4 80.4 98.6 2.9 15.|-- 209.208.7.42 24.0% 50 80.6 95.4 80.6 545.4 75.0 16.|-- 209.208.27.233 30.0% 50 81.4 84.5 81.4 86.0 1.3 On 2016-09-19 14:55, Joe Klein via Outages wrote: http://status.cogentco.com/ Cogent Network Status Report Last Updated Mon Sep 19 18:52:09 2016 GMT The Cogent Network Operations Center is currently investigating an outage in the Los Angeles area. The master case is HD6655601. There is no estimated time to repair. Some customers in the Raleigh North Carolina area may be experiencing a loss of connectivity. Engineers are currently investigating but there is no estimated time to repair at this time. The master case is HD6655487 -- ____________ Mason Moody Network Security Engineer Atlantic.Net Phone: 800-422-2936 x4431 Int'l: +1-321-206-3731 [cid:image003.gif@01D21289.9BBA67F0] This e-mail, including any attachments, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified any dissemination, distribution or copying of any part of this e-mail is strictly prohibited; please contact the sender and permanently delete the original and any copies of it.

On 9/19/16 12:42, Jason LeBlanc via Outages wrote:

We have had Cogent outages for 3 straight days. Links are currently flapping again in Las Vegas. Here is the RFO from 2 days ago…

I've had to turn off AS20115 for transit to avoid AS174. ~Seth

+1 from Dallas toward west coast Cogent paths. Currently seeing DFW->MCI->DEN->SLC->SEA->TYO->HKG->SIN->LAX for a path toward Charter from DFW->LAX. Even turning off the Cogent peer did not help as the path simply goes from Zayo->Cogent->this mess. 2016-09-19 15:32 GMT-05:00 Jake Zack via Outages <outages@outages.org>:

6. be3036.ccr41.lax04.atlas.cogentco.com 0.0% 187 1.6 1.3 1.1 2.8 0.4

7. be2965.ccr22.lax01.atlas.cogentco.com 0.0% 187 2.2 1.4 1.2 3.0 0.3

8. te0-3-1-0.ccr21.sin01.atlas.cogentco.com 37.1% 187 203.0 203.0 201.5 204.4 0.5

9. te0-4-0-0.ccr21.hkg02.atlas.cogentco.com 38.0% 187 216.9 218.0 216.6 220.3 1.0

10. te0-0-2-3.ccr11.tyo01.atlas.cogentco.com 41.2% 187 228.7 230.0 228.4 233.5 1.2

11. te0-4-0-34.ccr21.sea02.atlas.cogentco.com 31.6% 187 228.9 266.0 228.4 811.3 129.4

12. be2085.ccr21.slc01.atlas.cogentco.com 48.7% 187 239.5 292.0 239.1 729.6 132.3

13. be3038.ccr22.den01.atlas.cogentco.com 68.3% 187 256.2 257.4 256.0 259.8 1.0

14. be3036.ccr22.mci01.atlas.cogentco.com 35.5% 187 256.5 257.1 255.4 259.4 1.0

15. be2832.ccr42.ord01.atlas.cogentco.com 41.9% 187 271.3 272.0 270.0 274.2 1.0

16. be2766.ccr41.ord03.atlas.cogentco.com

Los Angeles -> Chicago via Singapore, Hong Kong, and Tokyo.

Classic.

_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages

Was there any further information on this? Specifics? From: Outages [mailto:outages-bounces@outages.org] On Behalf Of Luke Rockwell via Outages Sent: Monday, September 19, 2016 5:07 PM To: outages@outages.org Subject: Re: [outages] Cogent routing issues, possibly SoCal? Cogent has confirmed that there is a fiber cut affecting services in the Los Angeles area, and is working with field engineers and vendor to restore service. No ETTR is available at this time. More information will be provided as it becomes available. On Mon, Sep 19, 2016 at 2:57 PM, Logan V. via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: +1 from Dallas toward west coast Cogent paths. Currently seeing DFW->MCI->DEN->SLC->SEA->TYO->HKG->SIN->LAX for a path toward Charter from DFW->LAX. Even turning off the Cogent peer did not help as the path simply goes from Zayo->Cogent->this mess. 2016-09-19 15:32 GMT-05:00 Jake Zack via Outages <outages@outages.org<mailto:outages@outages.org>>:

6. be3036.ccr41.lax04.atlas.cogentco.com<http://be3036.ccr41.lax04.atlas.cogentco.com> 0.0% 187 1.6 1.3 1.1 2.8 0.4

7. be2965.ccr22.lax01.atlas.cogentco.com<http://be2965.ccr22.lax01.atlas.cogentco.com> 0.0% 187 2.2 1.4 1.2 3.0 0.3

8. te0-3-1-0.ccr21.sin01.atlas.cogentco.com<http://te0-3-1-0.ccr21.sin01.atlas.cogentco.com> 37.1% 187 203.0 203.0 201.5 204.4 0.5

9. te0-4-0-0.ccr21.hkg02.atlas.cogentco.com<http://te0-4-0-0.ccr21.hkg02.atlas.cogentco.com> 38.0% 187 216.9 218.0 216.6 220.3 1.0

10. te0-0-2-3.ccr11.tyo01.atlas.cogentco.com<http://te0-0-2-3.ccr11.tyo01.atlas.cogentco.com> 41.2% 187 228.7 230.0 228.4 233.5 1.2

11. te0-4-0-34.ccr21.sea02.atlas.cogentco.com<http://te0-4-0-34.ccr21.sea02.atlas.cogentco.com> 31.6% 187 228.9 266.0 228.4 811.3 129.4

12. be2085.ccr21.slc01.atlas.cogentco.com<http://be2085.ccr21.slc01.atlas.cogentco.com> 48.7% 187 239.5 292.0 239.1 729.6 132.3

13. be3038.ccr22.den01.atlas.cogentco.com<http://be3038.ccr22.den01.atlas.cogentco.com> 68.3% 187 256.2 257.4 256.0 259.8 1.0

14. be3036.ccr22.mci01.atlas.cogentco.com<http://be3036.ccr22.mci01.atlas.cogentco.com> 35.5% 187 256.5 257.1 255.4 259.4 1.0

15. be2832.ccr42.ord01.atlas.cogentco.com<http://be2832.ccr42.ord01.atlas.cogentco.com> 41.9% 187 271.3 272.0 270.0 274.2 1.0

16. be2766.ccr41.ord03.atlas.cogentco.com<http://be2766.ccr41.ord03.atlas.cogentco.com>

Los Angeles -> Chicago via Singapore, Hong Kong, and Tokyo.

Classic.

_______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

_______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

Cogent says it's a fiber cut: Customers located in or transiting the Los Angeles area may be experiencing packet loss or latency due to a fiber cut. The Cogent Network Operations Center is working with our field engineers and with our vendor to restore service. There is no estimated time to repair. The master case is HD6655601. Must be one heluva cut because I had to drop my peer to keep traffic on another provider. We weren't getting beyond Los Angeles via AS 174. ________________________________ From: Outages <outages-bounces@outages.org<mailto:outages-bounces@outages.org>> on behalf of Logan V. via Outages <outages@outages.org<mailto:outages@outages.org>> Sent: Monday, September 19, 2016 2:57:52 PM To: outages@outages.org<mailto:outages@outages.org> Subject: Re: [outages] Cogent routing issues, possibly SoCal? +1 from Dallas toward west coast Cogent paths. Currently seeing DFW->MCI->DEN->SLC->SEA->TYO->HKG->SIN->LAX for a path toward Charter from DFW->LAX. Even turning off the Cogent peer did not help as the path simply goes from Zayo->Cogent->this mess. 2016-09-19 15:32 GMT-05:00 Jake Zack via Outages <outages@outages.org<mailto:outages@outages.org>>:

6. be3036.ccr41.lax04.atlas.cogentco.com 0.0% 187 1.6 1.3 1.1 2.8 0.4

7. be2965.ccr22.lax01.atlas.cogentco.com 0.0% 187 2.2 1.4 1.2 3.0 0.3

8. te0-3-1-0.ccr21.sin01.atlas.cogentco.com 37.1% 187 203.0 203.0 201.5 204.4 0.5

9. te0-4-0-0.ccr21.hkg02.atlas.cogentco.com 38.0% 187 216.9 218.0 216.6 220.3 1.0

10. te0-0-2-3.ccr11.tyo01.atlas.cogentco.com 41.2% 187 228.7 230.0 228.4 233.5 1.2

11. te0-4-0-34.ccr21.sea02.atlas.cogentco.com 31.6% 187 228.9 266.0 228.4 811.3 129.4

12. be2085.ccr21.slc01.atlas.cogentco.com 48.7% 187 239.5 292.0 239.1 729.6 132.3

13. be3038.ccr22.den01.atlas.cogentco.com 68.3% 187 256.2 257.4 256.0 259.8 1.0

14. be3036.ccr22.mci01.atlas.cogentco.com 35.5% 187 256.5 257.1 255.4 259.4 1.0

15. be2832.ccr42.ord01.atlas.cogentco.com 41.9% 187 271.3 272.0 270.0 274.2 1.0

16. be2766.ccr41.ord03.atlas.cogentco.com

Los Angeles -> Chicago via Singapore, Hong Kong, and Tokyo.

Classic.

_______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

_______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages

Our Internap facility reported that Cogent was undergoing maint. this morning and that it has extended until 2pm PDT. You might have observed some routing reconvergence as links went down. Sent from my iPhone On Sep 18, 2016, at 10:00 AM, Sahil Ganguly via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: I see the same thing.

From their status page (http://status.cogentco.com/): "Welcome to the Cogent Communications status page. There is known fiber maintenance occurring in the Los Angeles market. Window of the event to last until 11am Pacific Time. Services may restore sooner than expected depending on the work occurring. CST master case for the event is HD6653969."

On Sun, Sep 18, 2016 at 8:54 AM, Bobin Joseph via Outages <outages@outages.org<mailto:outages@outages.org>> wrote: Anybody seeing issues over their Cogent internet ckts? This is an mtr of traffic from our Dallas to San Diego site. Looks like traffic is going over to Asia before making it back. Also noticed this from my home in SD to our site in SD. Is it an issue in and out of the LAX/SoCal region? Packets Pings Host Loss% Drop Rcv Wrst Last Avg Best StDev Wrst 4. te0-0-0-2.rcr21.dfw04.atlas.cogentco.com<http://te0-0-0-2.rcr21.dfw04.atlas.cogentco.com> 0.0% 0 637 2.6 1.7 1.6 1.5 0.1 2.6 5. be2938.ccr21.dfw01.atlas.cogentco.com<http://be2938.ccr21.dfw01.atlas.cogentco.com> 0.0% 0 637 4.2 2.2 2.1 1.9 0.2 4.2 6. be2432.ccr21.mci01.atlas.cogentco.com<http://be2432.ccr21.mci01.atlas.cogentco.com> 0.2% 1 636 16.3 11.9 11.9 11.8 0.2 16.3 7. be3035.ccr21.den01.atlas.cogentco.com<http://be3035.ccr21.den01.atlas.cogentco.com> 0.0% 0 637 23.9 23.8 23.3 23.2 0.2 23.9 8. be3037.ccr21.slc01.atlas.cogentco.com<http://be3037.ccr21.slc01.atlas.cogentco.com> 0.0% 0 637 34.2 33.6 33.6 33.5 0.2 34.2 9. be2085.ccr21.sea02.atlas.cogentco.com<http://be2085.ccr21.sea02.atlas.cogentco.com> 0.8% 5 632 681.5 54.3 69.0 54.1 80.5 681.5 10. te0-0-2-0.ccr11.tyo01.atlas.cogentco.com<http://te0-0-2-0.ccr11.tyo01.atlas.cogentco.com> 29.6% 188 448 165.0 150.5 157.6 148.7 3.6 165.0 11. te0-4-0-3.ccr21.hkg02.atlas.cogentco.com<http://te0-4-0-3.ccr21.hkg02.atlas.cogentco.com> 29.7% 189 447 227.4 217.3 222.3 213.8 3.6 227.4 12. te0-4-0-0.ccr21.sin01.atlas.cogentco.com<http://te0-4-0-0.ccr21.sin01.atlas.cogentco.com> 32.5% 207 429 262.6 253.0 257.2 248.8 3.6 262.6 13. te0-0-0-8.ccr21.lax01.atlas.cogentco.com<http://te0-0-0-8.ccr21.lax01.atlas.cogentco.com> 47.5% 302 334 4943<tel:302%C2%A0%C2%A0%20334%204943>. 449.9 467.9 445.9 245.7 4943. 14. be2540.rcr22.lax04.atlas.cogentco.com<http://be2540.rcr22.lax04.atlas.cogentco.com> 33.4% 212 423 452.1 422.9 428.3 414.0 8.7 452.1 Thanks, Bobin Joseph _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages -- Sahil Ganguly Network Operations Engineer [https://cloud.box.com/shared/static/mzi9hhrgwi1orbxkcaif.png] M: 303.250.8893<tel:303.250.8893> 900 Jefferson Ave Redwood City, CA 94063 _______________________________________________ Outages mailing list Outages@outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more visit the Mimecast website.