Chinese
English
Problem Description
The OptiX OSN3500 device needs to back up the network element configuration data during routine maintenance to ensure that the network element main control board automatically recovers operation after losing data or the device is powered down. Backing up the network element configuration data to the main control board means backing up the network element configuration data to the FLASH of the main control board. The main control board automatically reads the configuration from the FLASH and sends it down to the single board when the network element is restarted after a power down.OptiX OSN3500 devices are upgraded. the two line boards SSN4SLD64 STM-64 Optical Interface Board Status Abnormal Service Interruption. After the problem occurs. try to use the network element database that was backed up before the upgrade to recover. but the recovery fails and the service is interrupted.
Processing
1. After the upgrade, the SLD64 boards of slot8 and slot11 are found to be offline, and the related services are interrupted;
2、Customer maintenance personnel found that the N4SLD64 physical board of slot8 and slot11 changed from the N1SLD64 logical board before the upgrade to the SSN2SL64 logical board, and modified the logical board from N2SL64 to N1SLD64.
3. After modifying the logical board type, the single board goes online but the service is not restored;
4. The problem was reported to the local Chinese side and TAC, and Huawei's Chinese side began to intervene;
5. After communicating with the organization's GTAC, the decision was made to perform a rollback;
6. Remove the two R10 version GSCCs that have been upgraded, insert the R8 version of SSN4GSCC, and start to use the database that was backed up before the upgrade to recover;
7, recovery timeout, recovery failure, business is still interrupted (DC password error, resulting in timeout);
8, give up the recovery from the database, GTAC according to the database backed up before the upgrade to create a cross-configuration script, the local command line to send;
9、Downloaded successfully, but the business is still all interrupted, found that the database backed up before upgrading has problems, can not be used;
10、Start looking for valid data that was recently backed up, and use the business configuration collected from the November inspection to make cross-configuration scripts;
11, the implementation of the script, business recovery.
Root cause
The synchronization switch between DRDB and FDB inside the master single board GSCC was abnormally turned off, resulting in the data stored in FDB being historically configured and not matching the currently running service. This leads to two problems:
1. After the upgrade, the master control resets, and after the reset, the master control re-issues the data, and the data issued is the old data in the FDB, which is inconsistent with the current configuration of the logical board position and the business configuration, so the upgrade is reported successfully but the business is interrupted;
2、Network data backup is backed up from the FDB, so the data backed up by the DC before the upgrade is also problematic, and cannot be recovered based on this database, leading to rollback failure, resulting in business interruption.
The database backup function is enabled by default, and the faulty network element was found to be disabled by inspection before the faulty network element was not repaired.
#9-48:szhw [48-***_OSN-4 ][][2014-12-12 14:31:50+06:00]>
:dbms-get-autobackup
DBMS-AUTO-BACKUP : disable
#9-48:szhw [48-***_OSN-4 ][][ 2014-12-12 14:31:52+06:00]>
:dbms-get-cyclebackup
CYCLE-BACKUP-SWITCH : disable
#9-48:szhw [48-***_OSN-4 ][][ 2014-12-12 14:31:53+06:00]& gt;
:mml-get-evtflag
CMD EVT FLAG: disable
Solution.
Find the most recent valid network element database backup file before the upgrade, or the network management backup script before the upgrade, and create a business recovery script accordingly to re-delete and reconfigure the full network crossover.
Suggestions and Summary
1、Timely inspection, timely tracking and resolution of anomalies found in the inspection, even if the customer does not take the initiative to request a solution, but also to take the initiative to promote the solution;
2、Upgrade actions strictly refer to the upgrade guide, especially for the steps that do not understand, but also to strictly implement, because it is likely to be the key filtering measures for a potential pitfalls;
3, strengthen the understanding of product knowledge, distinguish the meaning of the concepts of network element data backup (backup from FDB), network management data upload (upload from DRDB), network management script backup (DRDB dynamic valid data), network management on the synchronization of the entrance (backup of the network element data to the SCC), the failure of the timely find valid data.
4, upgrade strict compliance with the process to do a variety of backups, in case of emergency.
The relevant technical information in this chapter and the SDH equipment troubleshooting process are collected and organized by Shenzhen Optical Transmission Network Technology Company Limited (www.opticaltrans.com), reproduced and retained! Our company specializes in Huawei SDH optical transmission equipment,SDH transmission equipment sales.
