[MVS]Oracle Exadata X8存儲主動更換硬盤

硬盤在係統日誌提示有error，但ASM多次嚐試修複，影響數據庫穩定，主動更換硬盤。

查看存儲節點係統日誌，多次提示硬盤error，但ASM接管重新掛載硬盤後，恢複正常。

Oracle Exadata X8存儲主動更換硬盤

環境：Oracle Exadata X8

exadata system info: 19.2.13.0.0.200428

OS: oracle linux 7.7

硬盤在係統日誌提示有error，但ASM多次嚐試修複，影響數據庫穩定，主動更換硬盤。

1.檢查硬盤號；

查看硬盤插槽，硬盤上承載的grid disk等；

# cellcli list diskmap

或：# cellcli list physicaldisk   

或  # cellcli –e "list diskmap" | grep 'X:Y'

2.刪除硬盤

2.1. 如Oracle Exadata System Software release 21.2.0,則如下命令將自動刪除硬盤並管理冗餘性；

CellCLI> alter physicaldisk X:Y drop for replacement maintain redundancy

注意：等命令執行結束才能下一步；

2.2：如Oracle Exadata System Software release 小於21.2.0，則需要順序執行如下命令：

1）、.刪除對應grid disk;

SQL> ALTER DISKGROUP diskgroup_name DROP DISK asm_disk_name;

備注：如刪除griddisk報錯

ORA-15032: not all alterations performed

ORA-15410: Disks in disk group OCRVT do not have equal size.

或者

ORA-15032: not all alterations performed

ORA-15411: Failure groups in disk group OCRVT have different number of disks.

解決方案：

動態修改這兩個隱藏參數解決限製副本數問題：

alter system set "_asm_disable_failgroup_size_checking"=true;

alter system set "_asm_disable_dangerous_failgroup_checking"=true;

2) . 等待磁盤rebalance操作完成，查詢：select  * from v$asm_operation; 

3). cell中刪除物理硬盤

CellCLI> alter physicaldisk X:Y drop for replacement

如防止超時退出，可後台執行：# cellcli -e "alter physicaldisk X:Y drop for replacement" & 

備注：

• ϒ⁄ cell alert log  cell中查看進度， 日誌路徑：/opt/oracle/cell/log/diag/asm/cell/<cell_name>/trace/alert.log
• ϒ⁄ 查看總體髒塊刷新速度，最終是否結束以日誌提示為準。CellCLI> list metriccurrent attributes name,metricvalue where name like 'FC_BY_DIRTY';  
• ϒ⁄ exadata 19.2版本可能會hang,  但本次測試解決方案效果不明顯；Exadata ALTER PHYSICALDISK N:N DROP FOR REPLACEMENT is hung (Doc ID 2574663.1)   
• 14T HDD硬盤刪除耗時5小時左右；

3.Ensure that the blue OK to Remove LED on the disk is lit before removing the disk.

硬盤刪除成功後，# cellcli list physicaldisk 查看磁盤已刪除；

4.Replace the new hard disk.

手動更換硬盤後，係統自動按原配置加到ASM 磁盤組中；

5.verify the LUN, cell disk and grid disk associated with the hard disk were created.

CellCLI> alter cell validate configuration     》》》自動升級固件；不能有mdadm錯誤； 

CellCLI> list lun lun_name

CellCLI> list celldisk where lun=lun_name

CellCLI> list griddisk where celldisk=celldisk_name

CellCLI> LIST PHYSICALDISK  detail

6.硬盤更換完成後將ASM隱藏參數修改回來；

alter system set "_asm_disable_failgroup_size_checking"=false;

alter system set "_asm_disable_dangerous_failgroup_checking"=false;

7.Verify the grid disk was added to the Oracle ASM disk groups.

The following query should return no rows.

SQL> SELECT path,header_status FROM v$asm_disk WHERE group_number=0;

The following query shows whether all the failure groups have the same number of disks:

SQL> select * from v$asm_disk;

參考：

官方文檔：3.3.5 Replacing a Hard Disk Proactively

***.***/en/engineered-systems/exadata-database-machine/dbmmn/replacing-hard-disk-proactively.html

 

Oracle Exadata換盤操作-Replacing a Hard Disk Proactively

https://blog.csdn.net/xxzhaobb/article/details/126389951

 

Exadata存儲節點，主動更換磁盤

https://www.cnblogs.com/missyou-shiyh/p/18581627

 

MOS:

How to Replace a Hard Drive in an Exadata Storage Cell Server (Predictive Failure) (Doc ID 1390836)