Comcast and or Tata meltdown?
Seem to be having issues exiting their network to many destinations....
TATA confirmed having issues in Montreal affecting multiple routers. -- Jean-Francois Levesque, ing. Vice-president Technologies / CTO Fibrenoire - www.fibrenoire.ca A: 400 ave Atlantic, suite 900, Montreal, Qc, H2V 1A5 T: 514 907-3002 x101 C: 514 805-4136 jf@fibrenoire.ca Twitter: @Fibrenoire @LevesqueJF On Wed, Aug 8, 2012 at 2:31 PM, Jared Mauch <jared@puck.nether.net> wrote:
Seem to be having issues exiting their network to many destinations.... _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Something interesting is clearly going on.. i'm now seeing everything leaving comcast to tata in Miami? 4. te-8-1-ur02.nannarbor.mi.michiga 0.0% 26 12.0 14.0 10.4 55.3 9.2 5. te-0-7-0-10-ar01.taylor.mi.michi 0.0% 26 30.1 21.8 15.3 39.6 5.1 6. pos-3-2-0-0-cr01.ashburn.va.ibon 0.0% 26 25.9 30.6 24.3 71.0 10.6 7. pos-0-2-0-0-pe01.ashburn.va.ibon 0.0% 26 25.7 30.4 25.3 81.0 11.9 8. 66.208.233.50 0.0% 26 26.4 30.5 24.6 69.6 12.0 9. ??? 10. if-6-0-0-1772.core5.MLN-Miami.as 0.0% 26 90.2 110.1 55.6 245.6 50.5 11. if-4-899.tcore1.MLN-Miami.as6453 0.0% 26 55.4 61.3 54.0 99.8 12.1 - Jared On Aug 8, 2012, at 2:33 PM, Jean-François Lévesque wrote:
TATA confirmed having issues in Montreal affecting multiple routers.
-- Jean-Francois Levesque, ing. Vice-president Technologies / CTO Fibrenoire - www.fibrenoire.ca A: 400 ave Atlantic, suite 900, Montreal, Qc, H2V 1A5 T: 514 907-3002 x101 C: 514 805-4136 jf@fibrenoire.ca Twitter: @Fibrenoire @LevesqueJF
On Wed, Aug 8, 2012 at 2:31 PM, Jared Mauch <jared@puck.nether.net> wrote:
Seem to be having issues exiting their network to many destinations.... _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Jared I would be interested in the full trace if you could send it my way please. Thanks! -ren On Wed, Aug 8, 2012 at 2:40 PM, Jared Mauch <jared@puck.nether.net> wrote:
Something interesting is clearly going on.. i'm now seeing everything leaving comcast to tata in Miami?
4. te-8-1-ur02.nannarbor.mi.michiga 0.0% 26 12.0 14.0 10.4 55.3 9.2 5. te-0-7-0-10-ar01.taylor.mi.michi 0.0% 26 30.1 21.8 15.3 39.6 5.1 6. pos-3-2-0-0-cr01.ashburn.va.ibon 0.0% 26 25.9 30.6 24.3 71.0 10.6 7. pos-0-2-0-0-pe01.ashburn.va.ibon 0.0% 26 25.7 30.4 25.3 81.0 11.9 8. 66.208.233.50 0.0% 26 26.4 30.5 24.6 69.6 12.0 9. ??? 10. if-6-0-0-1772.core5.MLN-Miami.as 0.0% 26 90.2 110.1 55.6 245.6 50.5 11. if-4-899.tcore1.MLN-Miami.as6453 0.0% 26 55.4 61.3 54.0 99.8 12.1
- Jared
On Aug 8, 2012, at 2:33 PM, Jean-François Lévesque wrote:
TATA confirmed having issues in Montreal affecting multiple routers.
-- Jean-Francois Levesque, ing. Vice-president Technologies / CTO Fibrenoire - www.fibrenoire.ca A: 400 ave Atlantic, suite 900, Montreal, Qc, H2V 1A5 T: 514 907-3002 x101 C: 514 805-4136 jf@fibrenoire.ca Twitter: @Fibrenoire @LevesqueJF
On Wed, Aug 8, 2012 at 2:31 PM, Jared Mauch <jared@puck.nether.net> wrote:
Seem to be having issues exiting their network to many destinations.... _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Was to puck... Jared Mauch On Aug 8, 2012, at 3:27 PM, Ren Provo <ren.provo@gmail.com> wrote:
Jared I would be interested in the full trace if you could send it my way please. Thanks! -ren
On Wed, Aug 8, 2012 at 2:40 PM, Jared Mauch <jared@puck.nether.net> wrote:
Something interesting is clearly going on.. i'm now seeing everything leaving comcast to tata in Miami?
4. te-8-1-ur02.nannarbor.mi.michiga 0.0% 26 12.0 14.0 10.4 55.3 9.2 5. te-0-7-0-10-ar01.taylor.mi.michi 0.0% 26 30.1 21.8 15.3 39.6 5.1 6. pos-3-2-0-0-cr01.ashburn.va.ibon 0.0% 26 25.9 30.6 24.3 71.0 10.6 7. pos-0-2-0-0-pe01.ashburn.va.ibon 0.0% 26 25.7 30.4 25.3 81.0 11.9 8. 66.208.233.50 0.0% 26 26.4 30.5 24.6 69.6 12.0 9. ??? 10. if-6-0-0-1772.core5.MLN-Miami.as 0.0% 26 90.2 110.1 55.6 245.6 50.5 11. if-4-899.tcore1.MLN-Miami.as6453 0.0% 26 55.4 61.3 54.0 99.8 12.1
- Jared
On Aug 8, 2012, at 2:33 PM, Jean-François Lévesque wrote:
TATA confirmed having issues in Montreal affecting multiple routers.
-- Jean-Francois Levesque, ing. Vice-president Technologies / CTO Fibrenoire - www.fibrenoire.ca A: 400 ave Atlantic, suite 900, Montreal, Qc, H2V 1A5 T: 514 907-3002 x101 C: 514 805-4136 jf@fibrenoire.ca Twitter: @Fibrenoire @LevesqueJF
On Wed, Aug 8, 2012 at 2:31 PM, Jared Mauch <jared@puck.nether.net> wrote:
Seem to be having issues exiting their network to many destinations.... _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
According to NANOG, Bell Canada leaked a full table, and then Tata turned right around and *re*-leaked that full table. -- j ----- Original Message -----
From: "Jared Mauch" <jared@puck.nether.net> To: outages@outages.org Sent: Wednesday, August 8, 2012 2:31:26 PM Subject: [outages] Comcast and or Tata meltdown? Seem to be having issues exiting their network to many destinations.... _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
-- Jay R. Ashworth Baylink jra@baylink.com Designer The Things I Think RFC 2100 Ashworth & Associates http://baylink.pitas.com 2000 Land Rover DII St Petersburg FL USA #natog +1 727 647 1274
Hi, Looks as if AS46618 ( Dery Telecom Inc) is the root cause of this. AS46618, dual homed to bell and videotron, leaked routes learned from videotron to bell, which then propagated that to its peers such as Tata. Based on BGPMon.net data I see that 107,754 prefixes were affected, i.e. leaked via 577 (bell) 46618 (Dery Telecom Inc). Problem started at 17:27 UTC . Cheers, Andree .-- My secret spy satellite informs me that at 12-08-08 12:26 PM Jay Ashworth wrote:
According to NANOG, Bell Canada leaked a full table, and then Tata turned right around and *re*-leaked that full table. -- j
----- Original Message -----
From: "Jared Mauch" <jared@puck.nether.net> To: outages@outages.org Sent: Wednesday, August 8, 2012 2:31:26 PM Subject: [outages] Comcast and or Tata meltdown? Seem to be having issues exiting their network to many destinations.... _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
Thanks, Doug On Aug 8, 2012, at 4:06 PM, Andree Toonk <andree+outages@toonk.nl> wrote:
Hi,
Looks as if AS46618 ( Dery Telecom Inc) is the root cause of this. AS46618, dual homed to bell and videotron, leaked routes learned from videotron to bell, which then propagated that to its peers such as Tata.
Based on BGPMon.net data I see that 107,754 prefixes were affected, i.e. leaked via 577 (bell) 46618 (Dery Telecom Inc). Problem started at 17:27 UTC .
Cheers, Andree
.-- My secret spy satellite informs me that at 12-08-08 12:26 PM Jay Ashworth wrote:
According to NANOG, Bell Canada leaked a full table, and then Tata turned right around and *re*-leaked that full table. -- j
----- Original Message -----
From: "Jared Mauch" <jared@puck.nether.net> To: outages@outages.org Sent: Wednesday, August 8, 2012 2:31:26 PM Subject: [outages] Comcast and or Tata meltdown? Seem to be having issues exiting their network to many destinations.... _______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
_______________________________________________ Outages mailing list Outages@outages.org https://puck.nether.net/mailman/listinfo/outages
participants (6)
-
Andree Toonk -
Doug Schemp -
Jared Mauch -
Jay Ashworth -
Jean-François Lévesque -
Ren Provo