Verizon and Telia daytime issue for several weeks now
Does anyone know what's going on between Verizon and TeliaSonera? There appears to be a daytime only (10am to 6pm daily) issue impacting the Asbhurn, VA peering points between Verizon AS701 and TeliaSonera AS1299. I've not been able to get confirmation of the issue from either party. Latency spikes and throughput drops like a rock off and on throughout the entire day. This has been going on for approximately three weeks now. |------------------------------------------------------------------------------------------| | WinMTR statistics | | Host - % | Sent | Recv | Best | Avrg | Wrst | Last | |------------------------------------------------|------|------|------|------|------|------| |lo0-100.PITBPA-VFTTP-303.verizon-gni.net - 0 | 6 | 6 | 3 | 7 | 26 | 4 | | T0-5-0-6.PITBPA-LCR-21.verizon-gni.net - 0 | 6 | 6 | 3 | 5 | 7 | 5 | | No response from host - 100 | 1 | 0 | 0 | 0 | 0 | 0 | | No response from host - 100 | 1 | 0 | 0 | 0 | 0 | 0 | | 0.ae1.GW11.IAD8.ALTER.NET - 0 | 6 | 6 | 14 | 15 | 17 | 14 | | teliasonera-gw.customer.alter.net - 0 | 6 | 6 | 81 | 87 | 94 | 81 | | ash-bb4-link.telia.net - 0 | 6 | 6 | 84 | 90 | 96 | 84 | | nyk-bb2-link.telia.net - 0 | 6 | 6 | 88 | 97 | 123 | 123 | | nyk-b3-link.telia.net - 0 | 6 | 6 | 84 | 91 | 99 | 84 | |digitalocean-ic-306498-nyk-b3.c.telia.net - 0 | 6 | 6 | 86 | 92 | 99 | 86 | | 162.243.188.222 - 0 | 6 | 6 | 83 | 91 | 99 | 83 | | 104.131.177.000 - 0 | 6 | 6 | 85 | 91 | 98 | 85 | |________________________________________________|______|______|______|______|______|______| WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider My traceroute [v0.85] fafnir (0.0.0.0) Fri Nov 27 12:53:10 2015 Packets Pings Host Loss% Snt Last Avg Best Wrst StDev 1. 104.131.0.253 0.0% 8 1.5 1.6 0.3 4.0 1.5 2. 162.243.188.241 0.0% 8 0.3 0.6 0.2 2.5 0.5 3. nyk-b3-link.telia.net 0.0% 8 1.0 2.0 0.9 9.1 2.8 4. nyk-bb1-link.telia.net 0.0% 7 1.0 3.8 1.0 20.4 7.3 5. nyk-b2-link.telia.net 0.0% 7 1.4 1.4 1.4 1.5 0.0 6. xe-3-3-3.GW10.EWR6.ALTER.NET 0.0% 7 1.6 1.7 1.4 2.4 0.0 7. ??? 8. xe-7-1-2-0.PITBPA-VFTTP-303.veri 0.0% 7 99.7 84.9 74.7 99.7 9.0 9. pool-173-75-56-000.pitbpa.fios.ve 0.0% 7 81.4 87.5 73.8 112.2 15.4
Yup. Telia sucks, VZN sucks. Verizon is one of the shittiest providers when it comes to peering, as is Telia. I pay > 130$ for business class FiOS, and have the same issues after about 4PM US/Eastern. Connectivity to Level(3) has improved over the last 6 months, but not to other providers. My backup COX cable modem never has problems (with the exception of routes that traverse 701). I will say that in the mtr's provided, I don't see any packet loss. Please post your results when you're seeing some. I see latency spikes, but providers will just tell you that the traffic is de-prioritized. You might want to reach out to Digital Ocean as well - they are good folks, and will probably tell you what they know from their side. On 2015-11-27 13:10, Norman Brown via Outages wrote:
Does anyone know what's going on between Verizon and TeliaSonera? There appears to be a daytime only (10am to 6pm daily) issue impacting the Asbhurn, VA peering points between Verizon AS701 and TeliaSonera AS1299. I've not been able to get confirmation of the issue from either party. Latency spikes and throughput drops like a rock off and on throughout the entire day. This has been going on for approximately three weeks now.
|------------------------------------------------------------------------------------------| | WinMTR statistics | | Host - % | Sent | Recv | Best | Avrg | Wrst | Last | |------------------------------------------------|------|------|------|------|------|------| |lo0-100.PITBPA-VFTTP-303.verizon-gni.net [2] - 0 | 6 | 6 | 3 | 7 | 26 | 4 | | T0-5-0-6.PITBPA-LCR-21.verizon-gni.net [3] - 0 | 6 | 6 | 3 | 5 | 7 | 5 | | No response from host - 100 | 1 | 0 | 0 | 0 | 0 | 0 | | No response from host - 100 | 1 | 0 | 0 | 0 | 0 | 0 | | 0.ae1.GW11.IAD8.ALTER.NET [4] - 0 | 6 | 6 | 14 | 15 | 17 | 14 | | teliasonera-gw.customer.alter.net [5] - 0 | 6 | 6 | 81 | 87 | 94 | 81 | | ash-bb4-link.telia.net [6] - 0 | 6 | 6 | 84 | 90 | 96 | 84 | | nyk-bb2-link.telia.net [7] - 0 | 6 | 6 | 88 | 97 | 123 | 123 | | nyk-b3-link.telia.net [8] - 0 | 6 | 6 | 84 | 91 | 99 | 84 | |digitalocean-ic-306498-nyk-b3.c.telia.net [9] - 0 | 6 | 6 | 86 | 92 | 99 | 86 | | 162.243.188.222 - 0 | 6 | 6 | 83 | 91 | 99 | 83 | | 104.131.177.000 - 0 | 6 | 6 | 85 | 91 | 98 | 85 | |________________________________________________|______|______|______|______|______|______| WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider
My traceroute [v0.85] fafnir (0.0.0.0) Fri Nov 27 12:53:10 2015 Packets Pings Host Loss% Snt Last Avg Best Wrst StDev 1. 104.131.0.253 0.0% 8 1.5 1.6 0.3 4.0 1.5 2. 162.243.188.241 0.0% 8 0.3 0.6 0.2 2.5 0.5 3. nyk-b3-link.telia.net [8] 0.0% 8 1.0 2.0 0.9 9.1 2.8 4. nyk-bb1-link.telia.net [10] 0.0% 7 1.0 3.8 1.0 20.4 7.3 5. nyk-b2-link.telia.net [11] 0.0% 7 1.4 1.4 1.4 1.5 0.0 6. xe-3-3-3.GW10.EWR6.ALTER.NET [12] 0.0% 7 1.6 1.7 1.4 2.4 0.0 7. ??? 8. xe-7-1-2-0.PITBPA-VFTTP-303.veri 0.0% 7 99.7 84.9 74.7 99.7 9.0 9. pool-173-75-56-000.pitbpa.fios.ve [13] 0.0% 7 81.4 87.5 73.8 112.2 15.4
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages [1]
Links: ------ [1] https://puck.nether.net/mailman/listinfo/outages [2] http://lo0-100.PITBPA-VFTTP-303.verizon-gni.net [3] http://T0-5-0-6.PITBPA-LCR-21.verizon-gni.net [4] http://0.ae1.GW11.IAD8.ALTER.NET [5] http://teliasonera-gw.customer.alter.net [6] http://ash-bb4-link.telia.net [7] http://nyk-bb2-link.telia.net [8] http://nyk-b3-link.telia.net [9] http://digitalocean-ic-306498-nyk-b3.c.telia.net [10] http://nyk-bb1-link.telia.net [11] http://nyk-b2-link.telia.net [12] http://xe-3-3-3.GW10.EWR6.ALTER.NET [13] http://pool-173-75-56-000.pitbpa.fios.ve
Please remove me from this list. Many thanks! Begin forwarded message:
From: Scott Martin via Outages <outages@outages.org> Date: November 27, 2015 at 3:28:10 PM CST To: outages@ouages.org Subject: Re: [outages] Verizon and Telia daytime issue for several weeks now Reply-To: Scott Martin <swm@funkit.com>
Yup. Telia sucks, VZN sucks. Verizon is one of the shittiest providers when it comes to peering, as is Telia. I pay > 130$ for business class FiOS, and have the same issues after about 4PM US/Eastern. Connectivity to Level(3) has improved over the last 6 months, but not to other providers. My backup COX cable modem never has problems (with the exception of routes that traverse 701).
I will say that in the mtr's provided, I don't see any packet loss. Please post your results when you're seeing some. I see latency spikes, but providers will just tell you that the traffic is de-prioritized. You might want to reach out to Digital Ocean as well - they are good folks, and will probably tell you what they know from their side.
On 2015-11-27 13:10, Norman Brown via Outages wrote:
Does anyone know what's going on between Verizon and TeliaSonera? There appears to be a daytime only (10am to 6pm daily) issue impacting the Asbhurn, VA peering points between Verizon AS701 and TeliaSonera AS1299. I've not been able to get confirmation of the issue from either party. Latency spikes and throughput drops like a rock off and on throughout the entire day. This has been going on for approximately three weeks now.
|------------------------------------------------------------------------------------------| | WinMTR statistics | | Host - % | Sent | Recv | Best | Avrg | Wrst | Last | |------------------------------------------------|------|------|------|------|------|------| |lo0-100.PITBPA-VFTTP-303.verizon-gni.net - 0 | 6 | 6 | 3 | 7 | 26 | 4 | | T0-5-0-6.PITBPA-LCR-21.verizon-gni.net - 0 | 6 | 6 | 3 | 5 | 7 | 5 | | No response from host - 100 | 1 | 0 | 0 | 0 | 0 | 0 | | No response from host - 100 | 1 | 0 | 0 | 0 | 0 | 0 | | 0.ae1.GW11.IAD8.ALTER.NET - 0 | 6 | 6 | 14 | 15 | 17 | 14 | | teliasonera-gw.customer.alter.net - 0 | 6 | 6 | 81 | 87 | 94 | 81 | | ash-bb4-link.telia.net - 0 | 6 | 6 | 84 | 90 | 96 | 84 | | nyk-bb2-link.telia.net - 0 | 6 | 6 | 88 | 97 | 123 | 123 | | nyk-b3-link.telia.net - 0 | 6 | 6 | 84 | 91 | 99 | 84 | |digitalocean-ic-306498-nyk-b3.c.telia.net - 0 | 6 | 6 | 86 | 92 | 99 | 86 | | 162.243.188.222 - 0 | 6 | 6 | 83 | 91 | 99 | 83 | | 104.131.177.000 - 0 | 6 | 6 | 85 | 91 | 98 | 85 | |________________________________________________|______|______|______|______|______|______| WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider
My traceroute [v0.85] fafnir (0.0.0.0) Fri Nov 27 12:53:10 2015 Packets Pings Host Loss% Snt Last Avg Best Wrst StDev 1. 104.131.0.253 0.0% 8 1.5 1.6 0.3 4.0 1.5 2. 162.243.188.241 0.0% 8 0.3 0.6 0.2 2.5 0.5 3. nyk-b3-link.telia.net 0.0% 8 1.0 2.0 0.9 9.1 2.8 4. nyk-bb1-link.telia.net 0.0% 7 1.0 3.8 1.0 20.4 7.3 5. nyk-b2-link.telia.net 0.0% 7 1.4 1.4 1.4 1.5 0.0 6. xe-3-3-3.GW10.EWR6.ALTER.NET 0.0% 7 1.6 1.7 1.4 2.4 0.0 7. ??? 8. xe-7-1-2-0.PITBPA-VFTTP-303.veri 0.0% 7 99.7 84.9 74.7 99.7 9.0 9. pool-173-75-56-000.pitbpa.fios.ve 0.0% 7 81.4 87.5 73.8 112.2 15.4
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
On 11/27/2015 18:33, Personal via Outages wrote:
Please remove me from this list.
(Pruned reply to the list intentional--people who say stupid stuff like this usually have bad addresses.) Why not try the instructs in your message? Here, I'll isolate it for you: Start paying attention: <https://puck.nether.net/mailman/options/outages>, <mailto:outages-request@outages.org?subject=unsubscribe> End paying attention. -- sed quis custodiet ipsos custodes? (Juvenal)
Packet loss is minimal, 8 hour average of .2% when this goes on. The primary issue is throughput dropping to under 1mbps. Unfortunately for me and anyone else in my area, most things are routed through Telia. In regards to Digital Ocean, they have NTT, GTT, and Comcast they could change to but those are all worse with Verizon. On Nov 27, 2015 4:29 PM, "Scott Martin via Outages" <outages@outages.org> wrote:
Yup. Telia sucks, VZN sucks. Verizon is one of the shittiest providers when it comes to peering, as is Telia. I pay > 130$ for business class FiOS, and have the same issues after about 4PM US/Eastern. Connectivity to Level(3) has improved over the last 6 months, but not to other providers. My backup COX cable modem never has problems (with the exception of routes that traverse 701).
I will say that in the mtr's provided, I don't see any packet loss. Please post your results when you're seeing some. I see latency spikes, but providers will just tell you that the traffic is de-prioritized. You might want to reach out to Digital Ocean as well - they are good folks, and will probably tell you what they know from their side.
On 2015-11-27 13:10, Norman Brown via Outages wrote:
Does anyone know what's going on between Verizon and TeliaSonera? There appears to be a daytime only (10am to 6pm daily) issue impacting the Asbhurn, VA peering points between Verizon AS701 and TeliaSonera AS1299. I've not been able to get confirmation of the issue from either party. Latency spikes and throughput drops like a rock off and on throughout the entire day. This has been going on for approximately three weeks now.
|------------------------------------------------------------------------------------------| | WinMTR statistics | | Host - % | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------| |lo0-100.PITBPA-VFTTP-303.verizon-gni.net - 0 | 6 | 6 | 3 | 7 | 26 | 4 | | T0-5-0-6.PITBPA-LCR-21.verizon-gni.net - 0 | 6 | 6 | 3 | 5 | 7 | 5 | | No response from host - 100 | 1 | 0 | 0 | 0 | 0 | 0 | | No response from host - 100 | 1 | 0 | 0 | 0 | 0 | 0 | | 0.ae1.GW11.IAD8.ALTER.NET - 0 | 6 | 6 | 14 | 15 | 17 | 14 | | teliasonera-gw.customer.alter.net - 0 | 6 | 6 | 81 | 87 | 94 | 81 | | ash-bb4-link.telia.net - 0 | 6 | 6 | 84 | 90 | 96 | 84 | | nyk-bb2-link.telia.net - 0 | 6 | 6 | 88 | 97 | 123 | 123 | | nyk-b3-link.telia.net - 0 | 6 | 6 | 84 | 91 | 99 | 84 | |digitalocean-ic-306498-nyk-b3.c.telia.net - 0 | 6 | 6 | 86 | 92 | 99 | 86 | | 162.243.188.222 - 0 | 6 | 6 | 83 | 91 | 99 | 83 | | 104.131.177.000 - 0 | 6 | 6 | 85 | 91 | 98 | 85 |
|________________________________________________|______|______|______|______|______|______| WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider
My traceroute [v0.85] fafnir (0.0.0.0) Fri Nov 27 12:53:10 2015 Packets Pings Host Loss% Snt Last Avg Best Wrst StDev 1. 104.131.0.253 0.0% 8 1.5 1.6 0.3 4.0 1.5 2. 162.243.188.241 0.0% 8 0.3 0.6 0.2 2.5 0.5 3. nyk-b3-link.telia.net 0.0% 8 1.0 2.0 0.9 9.1 2.8 4. nyk-bb1-link.telia.net 0.0% 7 1.0 3.8 1.0 20.4 7.3 5. nyk-b2-link.telia.net 0.0% 7 1.4 1.4 1.4 1.5 0.0 6. xe-3-3-3.GW10.EWR6.ALTER.NET 0.0% 7 1.6 1.7 1.4 2.4 0.0 7. ??? 8. xe-7-1-2-0.PITBPA-VFTTP-303.veri 0.0% 7 99.7 84.9 74.7 99.7 9.0 9. pool-173-75-56-000.pitbpa.fios.ve 0.0% 7 81.4 87.5 73.8 112.2 15.4
_______________________________________________ Outages mailing listOutages@outages.orghttps://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (4)
-
Larry Sheldon -
Norman Brown -
Personal -
Scott Martin