On Tue, Aug 12, 2014 at 5:29 PM, Geoffrey Mina via Outages <outages@outages.org> wrote:
We were told by Quality Technology Services in Atlanta that they were "installing additional memory" to correct the issue. Perhaps they meant they were actually reconfiguring/bouncing the routers.... I know they had Cisco engineers on site in GA, CA, and NJ today.
Probably they were recarving the TCAM allocation. Quick summary document for those having the issue: http://www.cisco.com/c/en/us/support/docs/switches/catalyst-6500-series-swit... This increases the size of the TCAM allocated for v4 routes, at the cost of v6 space. This doesn't actually *solve* the issue, but does at least kick the can down the road a bit longer... TCAM based solutions for FIB, while cheap to implement, leads to pain... W
Either way, after our network link went totally down and came back up, the issue was resolved.
________________________________ From: Bill Wichers [billw@waveform.net] Sent: Tuesday, August 12, 2014 3:27 PM To: Geoffrey Mina Cc: Michael Peterman; outages@outages.org Subject: Re: [outages] So what is broken
That's a tcam limit on the 6500/7600 platform. It's not upgradable, but it is configurable.
The gsr platform doesn't have a hard limit like this, its just memory (And is upgradeable), but most with that gear will have already had to upgrade well before now.
Sent from my iPhone
On Aug 12, 2014, at 4:14 PM, "Geoffrey Mina via Outages" <outages@outages.org> wrote:
Cisco gear can't support more than 512K routes... We hit that or close to that at around 4am EDT today.
ISPs are scrambling to update memory in their routers.
-------- Original message -------- From: Michael Peterman via Outages Date:08/12/2014 1:00 PM (GMT-07:00) To: outages@outages.org Subject: [outages] So what is broken
So is this issue all related to a fiber cut or a DC/Peering point having issues?
http://www.thewhir.com/web-hosting-news/liquidweb-among-companies-affected-m...
Michael Peterman
-----Original Message----- From: Outages [mailto:outages-bounces@outages.org] On Behalf Of outages-request@outages.org Sent: Tuesday, August 12, 2014 11:00 AM To: outages@outages.org Subject: Outages Digest, Vol 75, Issue 9
Send Outages mailing list submissions to outages@outages.org
To subscribe or unsubscribe via the World Wide Web, visit https://puck.nether.net/mailman/listinfo/outages or, via email, send a message with subject or body 'help' to outages-request@outages.org
You can reach the person managing the list at outages-owner@outages.org
When replying, please edit your Subject line so it is more specific than "Re: Contents of Outages digest..."
Today's Topics:
1. Windstream (Mike Walter) 2. CoreSite Any2 LA (jd) 3. Re: CoreSite Any2 LA (Paul Stewart) 4. LastPass.com has a DC outage (Chris Egeland) 5. Major outages today, not much info at this time (Hoyle Anderson (AM)) 6. Re: Major outages today, not much info at this time (Teun Vink)
----------------------------------------------------------------------
Message: 1 Date: Tue, 12 Aug 2014 13:19:08 +0000 From: Mike Walter <mwalter@3z.net> To: "'outages@outages.org'" <outages@outages.org> Subject: [outages] Windstream Message-ID: <D7092CF606B8964193F248C92106B7810FCDE655@zionex01.ZION.local> Content-Type: text/plain; charset="us-ascii"
Just an FYI, there is a Windstream fiber cut effecting Ohio and Kentucky customers, no ETA to repair based on their phone message. Still on hold waiting to open case to find out more. -Mike