Difference between revisions of "Megaraid SAS"
(First save) |
m (Better formatting.) |
||
(2 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
These | These The MegaRAID SAS controllers re called Percraid on Dell Poweredge servers. They use the MegaCLI utility, which is described here. | ||
== MegaCLI == | == MegaCLI == | ||
This to show what virtual disks are present. This describes a system with a pair of 300GB SAS 15k rpm disks holding the OS, an array of four 1TB drives and a pair modern 20TB drives, forming a 300GB OS drive, a 20TB data drive and a 3TB additional storage drive. | This to show what virtual disks are present. This describes a system with a pair of 300GB SAS 15k rpm disks holding the OS, an array of four 1TB drives and a pair modern 20TB drives, forming a 300GB OS drive, a 20TB data drive and a 3TB additional storage drive. | ||
Line 463: | Line 463: | ||
Exit Code: 0x00</nowiki> | Exit Code: 0x00</nowiki> | ||
One of the 300GB SAS drives (for the OS) is reporting a [ | One of the 300GB SAS drives (for the OS) is reporting a [https://techterms.com/definition/smart SMART] error. This disk should be replaced before it fails. | ||
=== Disk swap === | |||
This is where the disk is swapped over. Once the new disk is inserted it rebuilds itself. | |||
<nowiki># megacli -pdoffline -physdrv[32:5] -a0 | |||
Adapter: 0: EnclId-32 SlotId-5 state changed to OffLine. | |||
Exit Code: 0x00 | |||
# megacli -pdmarkmissing -physdrv[32:5] -a0 | |||
EnclId-32 SlotId-5 is marked Missing. | |||
Exit Code: 0x00 | |||
# megacli -pdprprmv -physdrv[32:5] -a0 | |||
Prepare for removal Success | |||
Exit Code: 0x00 | |||
</nowiki> | |||
=== Check the rebuild === | |||
You can see how the rebuild is progressing like this: | |||
<nowiki># megacli -PDRbld -ShowProg -PhysDrv[32:5] -a0 | |||
Rebuild Progress on Device at Enclosure 32, Slot 5 Completed 7% in 8 Minutes.</nowiki> |
Latest revision as of 22:06, 25 February 2024
These The MegaRAID SAS controllers re called Percraid on Dell Poweredge servers. They use the MegaCLI utility, which is described here.
MegaCLI
This to show what virtual disks are present. This describes a system with a pair of 300GB SAS 15k rpm disks holding the OS, an array of four 1TB drives and a pair modern 20TB drives, forming a 300GB OS drive, a 20TB data drive and a 3TB additional storage drive. Below are the virtual drives:
# megacli -LDInfo -Lall -a0 Adapter 0 -- Virtual Drive Information: Virtual Drive: 0 (Target Id: 0) Name :OS-Disk RAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0 Size : 278.875 GB Sector Size : 512 Mirror Data : 278.875 GB State : Optimal Strip Size : 64 KB Number Of Drives : 2 Span Depth : 1 Default Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disk's Default Encryption Type : None Default Power Savings Policy: Controller Defined Current Power Savings Policy: None Can spin up in 1 minute: Yes LD has drives that support T10 power conditions: Yes LD's IO profile supports MAX power savings with cached writes: No Bad Blocks Exist: Yes Is VD Cached: No Virtual Drive: 1 (Target Id: 1) Name :spare-r5 RAID Level : Primary-5, Secondary-0, RAID Level Qualifier-3 Size : 2.727 TB Sector Size : 512 Parity Size : 931.0 GB State : Optimal Strip Size : 64 KB Number Of Drives : 4 Span Depth : 1 Default Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disk's Default Ongoing Progresses: Background Initialization: Completed 41%, Taken 933 min. Encryption Type : None Default Power Savings Policy: Controller Defined Current Power Savings Policy: None Can spin up in 1 minute: Yes LD has drives that support T10 power conditions: No LD's IO profile supports MAX power savings with cached writes: No Bad Blocks Exist: No Is VD Cached: No Virtual Drive: 2 (Target Id: 2) Name : RAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0 Size : 18.189 TB Sector Size : 512 Mirror Data : 18.189 TB State : Optimal Strip Size : 64 KB Number Of Drives : 2 Span Depth : 1 Default Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteThrough, ReadAheadNone, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disk's Default Ongoing Progresses: Background Initialization: Completed 4%, Taken 933 min. Encryption Type : None Default Power Savings Policy: Controller Defined Current Power Savings Policy: None Can spin up in 1 minute: Yes LD has drives that support T10 power conditions: No LD's IO profile supports MAX power savings with cached writes: No Bad Blocks Exist: No Is VD Cached: No Exit Code: 0x00
And here are the physical drives. All eight drive bays are filled.
# megacli -pdlist -a0 Adapter #0 Enclosure Device ID: 32 Slot Number: 0 Drive's position: DiskGroup: 1, Span: 0, Arm: 0 Enclosure position: 1 Device Id: 0 WWN: 50014ee057c5c7cd Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Raw Size: 931.512 GB [0x74706db0 Sectors] Non Coerced Size: 931.012 GB [0x74606db0 Sectors] Coerced Size: 931.0 GB [0x74600000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: 0C12 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221107000000 Connected Port Number: 7(path0) Inquiry Data: WD-WMATV8663060WDC WD1002FBYS-18W8B1 03.00C12 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 3.0Gb/s Link Speed: 3.0Gb/s Media Type: Hard Disk Device Drive Temperature :43C (109.40 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 3.0Gb/s Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 1 Drive's position: DiskGroup: 1, Span: 0, Arm: 1 Enclosure position: 1 Device Id: 1 WWN: 50014ee057c5c5f4 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Raw Size: 931.512 GB [0x74706db0 Sectors] Non Coerced Size: 931.012 GB [0x74606db0 Sectors] Coerced Size: 931.0 GB [0x74600000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: 0C12 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221106000000 Connected Port Number: 6(path0) Inquiry Data: WD-WMATV8635175WDC WD1002FBYS-18W8B1 03.00C12 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 3.0Gb/s Link Speed: 3.0Gb/s Media Type: Hard Disk Device Drive Temperature :47C (116.60 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 3.0Gb/s Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 2 Drive's position: DiskGroup: 1, Span: 0, Arm: 2 Enclosure position: 1 Device Id: 2 WWN: 50014ee206916984 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Raw Size: 931.512 GB [0x74706db0 Sectors] Non Coerced Size: 931.012 GB [0x74606db0 Sectors] Coerced Size: 931.0 GB [0x74600000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: 1V02 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221105000000 Connected Port Number: 1(path0) Inquiry Data: WD-WMAW30234603WDC WD1003FBYX-18Y7B0 01.01V02 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 3.0Gb/s Link Speed: 3.0Gb/s Media Type: Hard Disk Device Drive Temperature :44C (111.20 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 3.0Gb/s Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 3 Drive's position: DiskGroup: 1, Span: 0, Arm: 3 Enclosure position: 1 Device Id: 3 WWN: 50014ee057c5c89b Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Raw Size: 931.512 GB [0x74706db0 Sectors] Non Coerced Size: 931.012 GB [0x74606db0 Sectors] Coerced Size: 931.0 GB [0x74600000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: 0C12 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221104000000 Connected Port Number: 2(path0) Inquiry Data: WD-WMATV8637476WDC WD1002FBYS-18W8B1 03.00C12 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 3.0Gb/s Link Speed: 3.0Gb/s Media Type: Hard Disk Device Drive Temperature :44C (111.20 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 3.0Gb/s Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 4 Drive's position: DiskGroup: 0, Span: 0, Arm: 1 Enclosure position: 1 Device Id: 4 WWN: 5000C50072369C50 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 279.396 GB [0x22ecb25c Sectors] Non Coerced Size: 278.896 GB [0x22dcb25c Sectors] Coerced Size: 278.875 GB [0x22dc0000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: YSFA Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x5000c50072369c51 SAS Address(1): 0x0 Connected Port Number: 4(path0) Inquiry Data: SEAGATE ST9300453SS YSFA6XN69MSN FDE Capable: Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive Temperature :37C (98.60 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Port-1 : Port status: Active Port's Linkspeed: Unknown Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 5 Drive's position: DiskGroup: 0, Span: 0, Arm: 0 Enclosure position: 1 Device Id: 5 WWN: 5000C50070D8CDEC Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 1 Last Predictive Failure Event Seq Number: 4812 PD Type: SAS Raw Size: 279.396 GB [0x22ecb25c Sectors] Non Coerced Size: 278.896 GB [0x22dcb25c Sectors] Coerced Size: 278.875 GB [0x22dc0000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: ES66 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x5000c50070d8cded SAS Address(1): 0x0 Connected Port Number: 3(path0) Inquiry Data: SEAGATE ST3300657SS ES666SJ7P3BJ FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive Temperature :42C (107.60 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Port-1 : Port status: Active Port's Linkspeed: Unknown Drive has flagged a S.M.A.R.T alert : Yes Enclosure Device ID: 32 Slot Number: 6 Drive's position: DiskGroup: 2, Span: 0, Arm: 0 Enclosure position: 1 Device Id: 6 WWN: 5000c500e5e26a83 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Raw Size: 18.190 TB [0x918600000 Sectors] Non Coerced Size: 18.189 TB [0x918500000 Sectors] Coerced Size: 18.189 TB [0x918500000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: EN01 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221101000000 Connected Port Number: 5(path0) Inquiry Data: ZVT3DWS4ST20000NE000-3G5101 EN01 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive: Not Certified Drive Temperature :38C (100.40 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Drive has flagged a S.M.A.R.T alert : No Enclosure Device ID: 32 Slot Number: 7 Drive's position: DiskGroup: 2, Span: 0, Arm: 1 Enclosure position: 1 Device Id: 7 WWN: 5000c500e5e0b4b9 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SATA Raw Size: 18.190 TB [0x918600000 Sectors] Non Coerced Size: 18.189 TB [0x918500000 Sectors] Coerced Size: 18.189 TB [0x918500000 Sectors] Sector Size: 0 Firmware state: Online, Spun Up Device Firmware Level: EN01 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x4433221100000000 Connected Port Number: 0(path0) Inquiry Data: ZVT4F6DGST20000NE000-3G5101 EN01 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive: Not Certified Drive Temperature :36C (96.80 F) PI Eligibility: No Drive is formatted for PI information: No PI: No PI Drive's NCQ setting : N/A Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Drive has flagged a S.M.A.R.T alert : No Exit Code: 0x00
One of the 300GB SAS drives (for the OS) is reporting a SMART error. This disk should be replaced before it fails.
Disk swap
This is where the disk is swapped over. Once the new disk is inserted it rebuilds itself.
# megacli -pdoffline -physdrv[32:5] -a0 Adapter: 0: EnclId-32 SlotId-5 state changed to OffLine. Exit Code: 0x00 # megacli -pdmarkmissing -physdrv[32:5] -a0 EnclId-32 SlotId-5 is marked Missing. Exit Code: 0x00 # megacli -pdprprmv -physdrv[32:5] -a0 Prepare for removal Success Exit Code: 0x00
Check the rebuild
You can see how the rebuild is progressing like this:
# megacli -PDRbld -ShowProg -PhysDrv[32:5] -a0 Rebuild Progress on Device at Enclosure 32, Slot 5 Completed 7% in 8 Minutes.