Originally Posted by
danver2099
Dear Client,
BACKGROUND:
FOBN1 serves as the primary link for VisMin and FOBN2 serves as the protection. FOBN2 was first hit last night at 2 places. One located at Ormoc (FOBN2) and the other located at Pili (FOBN2) affected by the typhoon Bebeng. While restoration was ongoing for FOBN2, our FOBN1 also experienced an outage on the submarine cable segment between Mindoro and Roxas. The Globe NOC Transmission team is pushing to restore the Pili area which is part of FOBN2 since restoration of submarine cable will take time.
INITIAL FINDINGS:
Affected by catastrophic outage at Fiber Optic Backbone Network 1 (FOBN1 via Roxas) and Fiber Optic Backbone Network 2 (FOBN2 via Ormoc & Pili). Some Visayas – Mindanao (VisMin) nodes affected.
EVENT LOG/ ACTIONS TAKEN:
MONDAY 05/09/2011 1325H
FAULT: Some Visayas and Mindanao (VISMIN) nodes affected by fiber cut.
ACTIONS TAKEN: 1420H: Optical Time-Domain Reflectometer (OTDR - used for estimating the fiber's length and overall attenuation, including splice and mated-connector losses) already measured 77km from San Jose Mindoro to Roxas, ongoing restoration.
• 1800H: As to the 6pm target, NOC Transmission team has only been able to repair the Ormoc cut (part of FOBN2). Pili (also part of FOBN2) will take a longer restoration time due to cable is submerged to water.
• 2045H:
Pili – Pagbilao (FOBN2): On going resplicing. Ongoing excavation due to rising flood.
Calbayog – Ormoc (FOBN2): On going physical checking at Ormoc due to monitored Loss of Signal (LOS) alarm at site. Possible defective RPC card. Ongoing sourcing for spare.
San Jose – Roxas (FOBN1): On going resplicing.
• 2205H:
Pili – Pagbilao (FOBN2): Alarms cleared at Network Monitoring System (NMS) after splicing on working fibers. Ongoing restoration for the remaining fibers. Still for confirmation for services restored.
Calbayog - Ormoc (FOBN2): Ongoing fiber testing at Ormoc side.
San Jose - Roxas (FOBN1): Still on going splicing.
TUESDAY 05/10/2011
ACTIONS TAKEN:
• 0012H:
Pili – Pagbilao (FOBN2): Already completed splicing on the remaining fibers. Majority of the network elements went up after the restoration of the transmission link.
Calbayog – Ormoc (FOBN2): Possible defective RPC card. Awaiting for RPC card from Tacloban. Fiber already tested good.
San Jose – Roxas (FOBN1): Already completed splicing but alarm still exists. Ongoing troubleshooting. Still for verification on other affected circuits.
• 0055H:
Calbayog – Ormoc (FOBN2): RPC card already at ORMOC. Ongoing replacement.
San Jose – Roxas (FOBN1): FOC needs another re splicing.
• 0250H:
Calbayog-Ormoc (FOBN2): RPC card already replaced but alarm still exist. For checking of the patch cord from Optical Distribution Frame (ODF) to RPC.
San Jose – Roxas (FOBN1): Awaiting for completion of re splicing of FOC.
• 0315H:
Calbayog – Ormoc (FOBN2): Alarms already cleared after re splicing of patch cord from ODF to RPC at Ormoc. Confirmed all affected down circuits are up except for 1/2 signaling link, 2/10 ATER for BSC Palawan2.
San Jose – Roxas (FOBN1): Splicing at San Jose already completed. On-going splicing at Roxas.
Note: Majority of all the affected circuits are already up via FOBN2 (protection path)
• 0545H:
San Jose – Roxas (FOBN1): Re splicing at Roxas already completed but alarm still exist. For further troubleshooting.
• 0700H:
San Jose – Roxas (FOBN1): Unable to reroute remaining affected circuits due to log-off San Jose, Mindoro (FOBN2) Network Elements. On-going restoration.
Note: Final report will indicate the circuit affected and time stamps.
We will keep you posted for any update. Many thanks!!!
Best regards,
Service Level Management / Enterprise Service Management
Re: Is Globe Down Today?
Reply With Quote
Posting Permissions
