昨夜テストしたRAIDのディスク交換後の再ビルドが無事に終わって、10台構成の正常なRAID6に復旧して喜んだのもつかの間、OMVを再起動してみると2台見失った8台構成に戻ってしまいます。。。OMVからは以下の様なメールが届きます。
This is an automatically generated mail message from mdadm
running on OMV-NODE804
A SparesMissing event had been detected on md device /dev/md0.
Faithfully yours, etc.
P.S. The /proc/mdstat file currently contains the following:
Personalities : [raid6] [raid5] [raid4]
md0 : inactive sdd[1]
2930135512 blocks super 1.2
unused devices: none
コマンドで確認してみると、昨日のHDDをフォーマットした直後とほぼ同じ状態になっています。変わったのはactiveなデバイスが/dev/sdfから/dev/sdhになっています。
cat /proc/mdstat
Personalities : [raid6] [raid5] [raid4]
md0 : active raid6 sdd[1] sdg[9] sdm[7] sdh[6] sdi[5] sdl[4] sdj[3] sdk[2]
23441080320 blocks super 1.2 level 6, 512k chunk, algorithm 2 [10/8] [_UUUUUUU_U]
unused devices: none
mdadm --detail /dev/md0
/dev/md0:
Version : 1.2
Creation Time : Wed Aug 19 23:22:08 2015
Raid Level : raid6
Array Size : 23441080320 (22355.16 GiB 24003.67 GB)
Used Dev Size : 2930135040 (2794.39 GiB 3000.46 GB)
Raid Devices : 10
Total Devices : 8
Persistence : Superblock is persistent
Update Time : Fri Sep 25 07:33:03 2015
State : clean, degraded
Active Devices : 8
Working Devices : 8
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 512K
Name : OMV-NODE804:10DisksRAID6 (local to host OMV-NODE804)
UUID : 22a559e2:1d468c1e:75c0ffeb:2b2e8494
Events : 1141
Number Major Minor RaidDevice State
0 0 0 0 removed
1 8 48 1 active sync /dev/sdd
2 8 160 2 active sync /dev/sdk
3 8 144 3 active sync /dev/sdj
4 8 176 4 active sync /dev/sdl
5 8 128 5 active sync /dev/sdi
6 8 112 6 active sync /dev/sdh
7 8 192 7 active sync /dev/sdm
8 0 0 8 removed
9 8 96 9 active sync /dev/sdg
OMVのフォーラムに書いてあった方法ででデバイスを指定して強制的にRAIDを再構築してみます。
# デバイスの一覧を取得 fdisk -l Disk /dev/sda: 120.0 GB, 120034123776 bytes 255 heads, 63 sectors/track, 14593 cylinders, total 234441648 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x0002dce1 Device Boot Start End Blocks Id System /dev/sda1 * 2048 224860159 112429056 83 Linux /dev/sda2 224862206 234440703 4789249 5 Extended /dev/sda5 224862208 234440703 4789248 82 Linux swap / Solaris WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted. Disk /dev/sdb: 256.1 GB, 256060514304 bytes 255 heads, 63 sectors/track, 31130 cylinders, total 500118192 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x61bb483d Device Boot Start End Blocks Id System /dev/sdb1 * 2048 500115455 250056704 7 HPFS/NTFS/exFAT Disk /dev/sdd: 3000.6 GB, 3000592982016 bytes 255 heads, 63 sectors/track, 364801 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0xa854a854 Disk /dev/sdd doesn't contain a valid partition table WARNING: GPT (GUID Partition Table) detected on '/dev/sdc'! The util fdisk doesn't support GPT. Use GNU Parted. Disk /dev/sdc: 3000.6 GB, 3000592982016 bytes 256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0x00000000 Device Boot Start End Blocks Id System /dev/sdc1 1 4294967295 2147483647+ ee GPT Partition 1 does not start on physical sector boundary. Disk /dev/sde: 31.3 GB, 31260704768 bytes 144 heads, 55 sectors/track, 7709 cylinders, total 61056064 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 512 bytes I/O size (minimum/optimal): 512 bytes / 512 bytes Disk identifier: 0x00000000 Device Boot Start End Blocks Id System /dev/sde1 2048 61056063 30527008 83 Linux WARNING: GPT (GUID Partition Table) detected on '/dev/sdf'! The util fdisk doesn't support GPT. Use GNU Parted. Disk /dev/sdf: 3000.6 GB, 3000592982016 bytes 256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0x00000000 Device Boot Start End Blocks Id System /dev/sdf1 1 4294967295 2147483647+ ee GPT Partition 1 does not start on physical sector boundary. Disk /dev/sdg: 3000.6 GB, 3000592982016 bytes 255 heads, 63 sectors/track, 364801 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0x00000000 Disk /dev/sdg doesn't contain a valid partition table Disk /dev/sdh: 3000.6 GB, 3000592982016 bytes 255 heads, 63 sectors/track, 364801 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0xa856a856 Disk /dev/sdh doesn't contain a valid partition table Disk /dev/sdi: 3000.6 GB, 3000592982016 bytes 255 heads, 63 sectors/track, 364801 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0x00000000 Disk /dev/sdi doesn't contain a valid partition table Disk /dev/sdj: 3000.6 GB, 3000592982016 bytes 255 heads, 63 sectors/track, 364801 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0xa855a856 Disk /dev/sdj doesn't contain a valid partition table Disk /dev/sdk: 3000.6 GB, 3000592982016 bytes 255 heads, 63 sectors/track, 364801 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0x00000000 Disk /dev/sdk doesn't contain a valid partition table Disk /dev/sdl: 3000.6 GB, 3000592982016 bytes 255 heads, 63 sectors/track, 364801 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0xa854a855 Disk /dev/sdl doesn't contain a valid partition table Disk /dev/sdm: 3000.6 GB, 3000592982016 bytes 255 heads, 63 sectors/track, 364801 cylinders, total 5860533168 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 4096 bytes / 4096 bytes Disk identifier: 0x00000000 Disk /dev/sdm doesn't contain a valid partition table Disk /dev/md0: 24003.7 GB, 24003666247680 bytes 2 heads, 4 sectors/track, -1 cylinders, total 46882160640 sectors Units = sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / 4096 bytes I/O size (minimum/optimal): 524288 bytes / 4194304 bytes Disk identifier: 0x00000000 Disk /dev/md0 doesn't contain a valid partition table # RAIDアレイをアンマウント umount /dev/md0 # RAIDを停止 mdadm --stop /dev/md0 # デバイスを指定して強制的にRAIDを構築(エラーになりますorz) mdadm --assemble /dev/md0 /dev/sd[cdfghijklm] --verbose --force dadm: looking for devices for /dev/md0 mdadm: Cannot assemble mbr metadata on /dev/sdc mdadm: /dev/sdc has no superblock - assembly aborted
うーん。エラーの原因がよくわからない。さらなる調査が必要なようです。
追記：復旧しようと試行錯誤していたら、間違って生き残っている8台のうち1台に対して 'mdadm --zero-superblock /dev/sdh' でRAIDの構成情報を削除してしまいました。。。これで3台がFAILした状態になったので終了です。。。
# RAID6で3台がFAILした状態でRAID構築できず＼(^o^)／ mdadm --assemble --scan mdadm: /dev/md0 assembled from 7 drives - not enough to start the array.
これが実運用中だと思ったらシャレにならないオペミスですね。。。とりあえず一からOMVを構築しなおすとして、ちょっとWindowsの記憶域スペースとやらを試してみようかと思います。
0 件のコメント:
コメントを投稿