Description of the problem

Customer feedback a large number of single boards reported COMMUN_FAIL alarm, engineers go to the site plug OSN3500 device SSN1AUX single board, the problem is solved. The version of network element is 5.21.18.50.

Alarm information

77723 5 COMMUN_FAIL MJ end 2011-08-22 00:03:43 2011-08-23 00:03:58 0x01 0x00 0x03 0xff 0xff

77726 16 COMMUN_FAIL MJ end 2011-08-22 00:03:43 2011-08-23 00:04:09 0x01 0x00 0x03 0xff 0xff

77725 12 COMMUN_FAIL MJ end 2011-08-22 00:03:43 2011-08-23 00:04:12 0x01 0x00 0x03 0xff 0xff 0xff

77721 1 COMMUN_FAIL MJ end 2011-08-22 00:03:43 2011-08-23 00:04:14 0x01 0x00 0x03 0xff 0xff 0xff

77722 3 COMMUN_FAIL MJ end 2011-08-22 00:03:43 2011-08-23 00:04:14 0x01 0x00 0x03 0xff 0xff 0xff

77727 2 COMMUN_FAIL MJ end 2011-08-22 00:03:44 2011-08-23 00:04:14 0x01 0x00 0x03 0xff 0xff 0xff

77728 7 COMMUN_FAIL MJ end 2011-08-22 00:03:44 2011-08-23 00:04:14 0x01 0x00 0x03 0xff 0xff 0xff

77729 15 COMMUN_FAIL MJ end 2011-08-22 00:03:44 2011-08-23 00:04:12 0x01 0x00 0x03 0xff 0xff 0xff

77730 4 COMMUN_FAIL MJ end 2011-08-22 00:03:45 2011-08-23 00:04:12 0x01 0x00 0x03 0xff 0xff 0xff

77731 10 COMMUN_FAIL MJ end 2011-08-22 00:03:46 2011-08-23 00:04:14 0x01 0x00 0x03 0xff 0xff 0xff

77724 9 COMMUN_FAIL MJ end 2011-08-22 00:03:43 2011-08-23 00:04:32 0x01 0x00 0x03 0xff 0xff 0xff

78022 37 BD_STATUS MJ end 2011-08-23 00:04:01 2011-08-23 00:04:44 0xff 0xff 0xff 0xff 0xff 0xff 0xff 0xff

Processing

Temporary solution: Plug and unplug the SSN1AUX board.

Complete solution: Replace the AUX veneer with one shipped after 2/28/2009.

Root Cause

COMMUN_FAIL alarm parameter of 0x03 indicates that there is a fault in inter-board communication, while a large number of HARD_BAD alarm messages are recorded in the master black box BB10.

12713 2011-8-22 19:3:45 0xB033 LEVEL: 3, FILE: cfg_init.cpp, LINE: 9784, ERRNO: 0x0001, Info: Hard Bad 0 6

12714 2011-8-22 19:3:59 0xB033 LEVEL: 3, FILE: cfg_init.cpp, LINE: 9784, ERRNO: 0x0001, Info: Hard Bad 0 6

12715 2011-8-22 19:4:3 0xB033 LEVEL: 3, FILE: cfg_init.cpp, LINE: 9784, ERRNO: 0x0001, Info: Hard Bad 0 2

12716 2011-8-22 19:4:5 0xB033 LEVEL: 3, FILE: cfg_init.cpp, LINE: 9784, ERRNO: 0x0001, Info: Hard Bad 0 6

These alarms indicate a failure in both the network element's external network port connection and the inter-board communication Ethernet port. These communications are handled by the 5328 chip on the AUX veneer. 5328 communication chip has a small probability of hang-up defect, by plugging and unplugging the veneer (power down) can reactivate the chip, and return to normal. 5338 chip is used in SSN1AUX shipped after February 28, 2009, which has already solved this defect.

Suggestions and Summary

The following veneer boards have all used the 5328 chip, and their switchover to the 5338 chip is at the point of time:

SSJ1JCOM was switched on 2007/7/27.

SST1EOW, SSN1AUX, SSQ1SAP, SSQ2SAP, SSR1AUX, SSR2AUX were switched on 2009/2/28.

The related technical information and SDH equipment troubleshooting procedures in this chapter are collected and organized by Shenzhen Optical Transmission Network Technology Company Limited (www.opticaltrans.com), and are reproduced and retained! Our company specializes in Huawei SDH optical transmission equipment,SDH transmission equipment sales.