Lightower, Worcester, MA fiber cut

We lost several dark fiber circuits out of Lightower in Worcester, MA. There is a manhole fire down the street at Main St. & Highland St. that is most likely the cause. Smoke is billowing out of several manholes. NGrid, NStar, police & fire are on the scene. Lightower has dispatched techs. No ETR yet. One other of my circuits that leaves the building via a diverse path is still up luckily, or we'd be off the net entirely.

Updates as of 01:41:40 -0500 and 02:58:11 -0500: "We have two (2) 288 cables that were burnt through in this National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole. NO ETTR at this time." My initial outage time was exactly 18:58:54 EST on two circuits. On Thu, Nov 06, 2014 at 08:49:16PM -0500, Chuck Anderson via Outages wrote:
We lost several dark fiber circuits out of Lightower in Worcester, MA. There is a manhole fire down the street at Main St. & Highland St. that is most likely the cause. Smoke is billowing out of several manholes. NGrid, NStar, police & fire are on the scene. Lightower has dispatched techs. No ETR yet.
One other of my circuits that leaves the building via a diverse path is still up luckily, or we'd be off the net entirely.

Update as of 06:05:16 -0500: "Status has remained the same Lightower has two (2) 288 cables that were burnt through in a National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will be no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole still NO ETTR at this time. We apologize for this inconvenience." On Fri, Nov 07, 2014 at 04:04:27AM -0500, Chuck Anderson wrote:
Updates as of 01:41:40 -0500 and 02:58:11 -0500:
"We have two (2) 288 cables that were burnt through in this National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole. NO ETTR at this time."
My initial outage time was exactly 18:58:54 EST on two circuits.
On Thu, Nov 06, 2014 at 08:49:16PM -0500, Chuck Anderson via Outages wrote:
We lost several dark fiber circuits out of Lightower in Worcester, MA. There is a manhole fire down the street at Main St. & Highland St. that is most likely the cause. Smoke is billowing out of several manholes. NGrid, NStar, police & fire are on the scene. Lightower has dispatched techs. No ETR yet.
One other of my circuits that leaves the building via a diverse path is still up luckily, or we'd be off the net entirely.

Update Fri, 7 Nov 2014 08:25:53 -0500: "Regions/Locations: New England Trouble Description: Fiber Cut ETTR: Mid-Afternoon Current Update: Dear Valued Customer, Impact Update: Estimated timeline of reroute, 500 feet of cable is being pulled, ETA to complete cable pull is 9am. Cable prepping will be performed from 9-10am, splicing should start by 11am." On Fri, Nov 07, 2014 at 07:26:56AM -0500, Chuck Anderson via Outages wrote:
Update as of 06:05:16 -0500:
"Status has remained the same Lightower has two (2) 288 cables that were burnt through in a National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will be no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole still NO ETTR at this time. We apologize for this inconvenience."
On Fri, Nov 07, 2014 at 04:04:27AM -0500, Chuck Anderson wrote:
Updates as of 01:41:40 -0500 and 02:58:11 -0500:
"We have two (2) 288 cables that were burnt through in this National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole. NO ETTR at this time."
My initial outage time was exactly 18:58:54 EST on two circuits.
On Thu, Nov 06, 2014 at 08:49:16PM -0500, Chuck Anderson via Outages wrote:
We lost several dark fiber circuits out of Lightower in Worcester, MA. There is a manhole fire down the street at Main St. & Highland St. that is most likely the cause. Smoke is billowing out of several manholes. NGrid, NStar, police & fire are on the scene. Lightower has dispatched techs. No ETR yet.
One other of my circuits that leaves the building via a diverse path is still up luckily, or we'd be off the net entirely.

Today's updates: Fri, 7 Nov 2014 11:10:02 -0500 ETTR: Mid-Afternoon Lightower fiber crew has completed installation of replacement temp cable and advised prep work is ongoing, Once complete we will commence splicing. Updates will be provided as they are recieved. Fri, 7 Nov 2014 13:39:53 -0500 ETTR: Mid-Afternoon Cable has been pulled, Prep work has been completed. Splicing has commenced... Updates will be provided as they are recieved. Fri, 7 Nov 2014 16:19:19 -0500 ETTR: N/A Lightower fiber crew advised that splicing is still ongoing to re-route services. Updates will be provided as they are available. There is no current ETTR available. Fri, 7 Nov 2014 18:29:03 -0500 ETTR: N/A Lightower fiber crew advised that splicing is still ongoing to re-route services. Updates will be provided as they are available. There is no current ETTR available. On Fri, Nov 07, 2014 at 08:30:38AM -0500, Chuck Anderson via Outages wrote:
Update Fri, 7 Nov 2014 08:25:53 -0500:
"Regions/Locations: New England Trouble Description: Fiber Cut
ETTR: Mid-Afternoon
Current Update:
Dear Valued Customer,
Impact Update: Estimated timeline of reroute, 500 feet of cable is being pulled, ETA to complete cable pull is 9am. Cable prepping will be performed from 9-10am, splicing should start by 11am."
On Fri, Nov 07, 2014 at 07:26:56AM -0500, Chuck Anderson via Outages wrote:
Update as of 06:05:16 -0500:
"Status has remained the same Lightower has two (2) 288 cables that were burnt through in a National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will be no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole still NO ETTR at this time. We apologize for this inconvenience."
On Fri, Nov 07, 2014 at 04:04:27AM -0500, Chuck Anderson wrote:
Updates as of 01:41:40 -0500 and 02:58:11 -0500:
"We have two (2) 288 cables that were burnt through in this National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole. NO ETTR at this time."
My initial outage time was exactly 18:58:54 EST on two circuits.
On Thu, Nov 06, 2014 at 08:49:16PM -0500, Chuck Anderson via Outages wrote:
We lost several dark fiber circuits out of Lightower in Worcester, MA. There is a manhole fire down the street at Main St. & Highland St. that is most likely the cause. Smoke is billowing out of several manholes. NGrid, NStar, police & fire are on the scene. Lightower has dispatched techs. No ETR yet.
One other of my circuits that leaves the building via a diverse path is still up luckily, or we'd be off the net entirely.

The last email update I received was: --------- Sat, 8 Nov 2014 07:21:07 -0500 ETTR: Not at this time Current Update: Fiber reroute still ongoing, no ETTR as of yet. -------- However, all the circuits I have visibility to are restored, other than one circuit on a diverse path out of the building that got knocked offline while repairs were happening to the first path. That incident took my campus entirely offline for several hours early this morning until a manual workaround was put into place. What a "fun" 2 days this was. I hope we find out what caused the explosion/fire in the first place... I think it was some kind of electrical fault. Not much news on this one, but I did find this which gets the details wrong (location should be Lincoln Square, not Lincoln St.): http://www.masslive.com/news/worcester/index.ssf/2014/11/manhole_explosion_k... http://www.telegram.com/article/20141107/NEWS/311079660/1116#.VF0G5aguXC4.tw... http://www.qcc.edu/ was also affected: "Last night a fire in a manhole in Lincoln Square severed the fiber that connects the West Boylston St campus to the Internet. Using back-up lines we were able to ..." On Fri, Nov 07, 2014 at 06:33:43PM -0500, Chuck Anderson via Outages wrote:
Today's updates:
Fri, 7 Nov 2014 11:10:02 -0500
ETTR: Mid-Afternoon
Lightower fiber crew has completed installation of replacement temp cable and advised prep work is ongoing, Once complete we will commence splicing. Updates will be provided as they are recieved.
Fri, 7 Nov 2014 13:39:53 -0500
ETTR: Mid-Afternoon
Cable has been pulled, Prep work has been completed. Splicing has commenced... Updates will be provided as they are recieved.
Fri, 7 Nov 2014 16:19:19 -0500
ETTR: N/A
Lightower fiber crew advised that splicing is still ongoing to re-route services. Updates will be provided as they are available. There is no current ETTR available.
Fri, 7 Nov 2014 18:29:03 -0500
ETTR: N/A
Lightower fiber crew advised that splicing is still ongoing to re-route services. Updates will be provided as they are available. There is no current ETTR available.
On Fri, Nov 07, 2014 at 08:30:38AM -0500, Chuck Anderson via Outages wrote:
Update Fri, 7 Nov 2014 08:25:53 -0500:
"Regions/Locations: New England Trouble Description: Fiber Cut
ETTR: Mid-Afternoon
Current Update:
Dear Valued Customer,
Impact Update: Estimated timeline of reroute, 500 feet of cable is being pulled, ETA to complete cable pull is 9am. Cable prepping will be performed from 9-10am, splicing should start by 11am."
On Fri, Nov 07, 2014 at 07:26:56AM -0500, Chuck Anderson via Outages wrote:
Update as of 06:05:16 -0500:
"Status has remained the same Lightower has two (2) 288 cables that were burnt through in a National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will be no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole still NO ETTR at this time. We apologize for this inconvenience."
On Fri, Nov 07, 2014 at 04:04:27AM -0500, Chuck Anderson wrote:
Updates as of 01:41:40 -0500 and 02:58:11 -0500:
"We have two (2) 288 cables that were burnt through in this National Grid enclosure. National Grid has informed us that there is an exposed high tension power line in this enclosure and there will no access granted in the near future. National Grid has deemed this manhole unsafe at this time. Lightower is working on an alternate solution that will re-route fibers around the affected man hole. NO ETTR at this time."
My initial outage time was exactly 18:58:54 EST on two circuits.
On Thu, Nov 06, 2014 at 08:49:16PM -0500, Chuck Anderson via Outages wrote:
We lost several dark fiber circuits out of Lightower in Worcester, MA. There is a manhole fire down the street at Main St. & Highland St. that is most likely the cause. Smoke is billowing out of several manholes. NGrid, NStar, police & fire are on the scene. Lightower has dispatched techs. No ETR yet.
One other of my circuits that leaves the building via a diverse path is still up luckily, or we'd be off the net entirely.
participants (1)
-
Chuck Anderson