某局點 S6805-56HF-G 告警分析 Continous packet loss no longer detected on protocol message queue 125

不涉及

%Jan 17 05:32:39:176 2025  DRVPLAT/4/SOFTCAR DROP:

 Chip=0, Cos=125, Drop at Stage=0, StageCnt=9691, TotalCnt=9691, possible protocol TTL_FAIL/MTU_FAIL/URPF_FAIL/RARP

%Jan 17 05:32:39:176 2025  DEV/4/BOARD_WARNING_OCCUR: Board warning alarm occurred. (PhysicalIndex=173, PhysicalName=Board, RelativeResource=(chiptype:Switch Chip,chassis:1,slot:1,chipid:0,channel:125), ErrorCode=423038, Reason=Continuous packet loss detected on the queue of protocol messages from the switch chip to the CPU. Queue=125, Stage=0, StageCnt=9691, TotalCnt=9691, Possible protocols=TTL_FAIL/MTU_FAIL/URPF_FAIL/RARP)

%Jan 17 05:42:42:414 2025  DRVPLAT/4/SOFTCAR DROP:

 Chip=0, Cos=125, Drop at Stage=0, StageCnt=28786, TotalCnt=38477, possible protocol TTL_FAIL/MTU_FAIL/URPF_FAIL/RARP

%Jan 17 05:52:45:707 2025  DRVPLAT/4/SOFTCAR DROP:

 Chip=0, Cos=125, Drop at Stage=0, StageCnt=28336, TotalCnt=66813, possible protocol TTL_FAIL/MTU_FAIL/URPF_FAIL/RARP

%Jan 17 06:02:48:827 2025  DRVPLAT/4/SOFTCAR DROP:

 Chip=0, Cos=125, Drop at Stage=0, StageCnt=961, TotalCnt=67774, possible protocol TTL_FAIL/MTU_FAIL/URPF_FAIL/RARP

%Jan 17 09:03:47:447 2025 DRVPLAT/4/SOFTCAR RECOVER:  Chip=0 Cos=125

%Jan 17 09:03:47:447 2025  DEV/4/BOARD_WARNING_CLEAR: Board warning alarm cleared. (PhysicalIndex=173, PhysicalName=Board, RelativeResource=(chiptype:Switch Chip,chassis:1,slot:1,chipid:0,channel:125), ErrorCode=423038, Reason=Continous packet loss no longer detected on protocol message queue 125.)

cos125隊列上cpu持續丟包

某局點 S7800XPG 下掛同網段終端ping測試丟首包 - 知了社區 

參考此方法，發現TTL_FAIL  有丟包記錄

  ===============display hardware internal rxtx softcar show slot 1=============== 

SoftCar limit rate info

Id   Type                     ReasonId QueueId ReasonRcvAll ReasonRcvPps Pps  

62   TTL_FAIL                 79       125     175758889    0            100  

 ===============display hardware internal rxtx coscar show slot 1=============== 

CosCar limit rate info

Index    RcvPktAll       RcvPktPps      DisPktAll    DisPktPps   Pps

125      175758886       0              57637256     0           100  

將cos125打印出來看都是ttl=1的報文

system-view
probe
dis rxtx cos 125 slot x
undo dis rxtx send slot x
dis rxtx switchflag slot x
debugging driver notice slot x
debug rxtx -c 100 -s 256 pkt slot x
return
t d
t m

從打印的信息能看到這些ttl=1的報文都是那個接口進來的

[2025-01-22 18:20:25]    *Jan 22 18:20:25:171 2025 DRVPLAT/7/RxTxDebug: 

[2025-01-22 18:20:25]     driver rx:lchip=0, queue=125,reason=79,len=60,gchip=0,flag=0x1,src logicport 0, fid 0,

[2025-01-22 18:20:25]    *Jan 22 18:20:25:171 2025 HZ-TL-M204PROD-B01-H3C-S6805-WC-1 DRVPLAT/7/RxTxDebug: 

[2025-01-22 18:20:25]     bridge header: 00 04 01 f5 00 aa 00 04 80 06 02 78 00 10 08 09 80 40 00 00 00 00 80 26 e3 49 44 80 14 00 70 00 00 00 00 00 0

[2025-01-22 18:20:25]    *Jan 22 18:20:25:171 2025  DRVPLAT/7/RxTxDebug: 

[2025-01-22 18:20:25]    From board 1: received packet from chip0,port9,reason=0x4f,cos=125,gslot=0,len=60,Matched=0,time: s=0, ns=0, dstgchip=0, dstLport=0

[2025-01-22 18:20:25]     -----------------------------------------------------

[2025-01-22 18:20:25]     0000  ac ce 92 7c 0c 0e 7c de 78 25 ba 01 08 00 45 00 

[2025-01-22 18:20:25]     0010  00 2c d4 31 00 00 01 06 7d 09 8f 2a 01 d5 73 e7 

[2025-01-22 18:20:25]     0020  63 ab 99 f2 15 ff b5 8b 74 dc 00 00 00 00 60 02 

[2025-01-22 18:20:25]     0030  ff ff 55 3b 00 00 02 04 05 b4 00 00 

[2025-01-22 18:20:25]     -----------------------------------------------------

[2025-01-22 18:20:25]    *Jan 22 18:20:25:171 2025 DRVPLAT/7/RxTxDebug: 

[2025-01-22 18:20:25]     Rx To Platform:p1=0,p2=1, p3=0x3, p4=60,p5=0, p6=ffffff8001fc24f8, p7=65, P8=0, P9=79, P10=1, P11=0

[2025-01-22 18:20:25]    *Jan 22 18:20:25:568 2025 HZ-TL-M204PROD-B01-H3C-S6805-WC-1 DRVPLAT/7/RxTxDebug: 

[2025-01-22 18:20:25]     driver rx:lchip=0, queue=125,reason=79,len=60,gchip=0,flag=0x1,src logicport 0, fid 0,

[2025-01-22 18:20:25]    *Jan 22 18:20:25:568 2025 HZ-TL-M204PROD-B01-H3C-S6805-WC-1 DRVPLAT/7/RxTxDebug: 

[2025-01-22 18:20:25]     bridge header: 00 04 01 f5 00 38 00 04 00 06 02 78 00 10 08 0a 00 40 00 00 00 00 80 22 e6 3f 90 e8 14 06 40 20 00 00 00 00 0

[2025-01-22 18:20:25]    *Jan 22 18:20:25:568 2025  DRVPLAT/7/RxTxDebug: 

[2025-01-22 18:20:25]    From board 1: received packet from chip0,port8,reason=0x4f,cos=125,gslot=0,len=60,Matched=0,time: s=0, ns=0, dstgchip=0, dstLport=0

[2025-01-22 18:20:25]     -----------------------------------------------------

[2025-01-22 18:20:25]     0000  ac ce 92 7c 0c 0e 7c de 78 25 ba 01 08 00 45 08 

[2025-01-22 18:20:25]     0010  00 2c 4f 12 00 00 01 06 a2 c6 c1 a3 7d f7 7b 94 

[2025-01-22 18:20:25]     0020  0c bd a2 ce 06 e2 1e f9 eb 31 00 00 00 00 60 02 

[2025-01-22 18:20:25]     0030  39 08 e3 56 00 00 02 04 05 b4 00 00 

從打印的信息能看出是從1/0/1 和1/0/2進來的ttl=1的報文

排除對端為什麼發來這些ttl=1的報文