I was looking forward to creating a big fileserver with disk crash recovery capabilities. LVM2 with reiserfs partitions couldn’t do the trick for me. I had 3 200Gb disks “united” under a logical volume, and formated them with reiserfs and I want to test what would happen if one disk “crashed”. So I created a fake crash..I shut the machine down, pulled the plugs of a disk and rebooted. I managed to see the logical volume using the latest lvm2 sources and the latest version of the device mapper:<\/p>\n
# lvm version
\nversion LVM version: 2.00.24 (2004-09-16)
\nversion Library version: 1.00.19-ioctl (2004-07-03)
\nversion Driver version: 4.1.0\n<\/p><\/blockquote>\nUnfortunately I had no luck in reading the reiserfs partition. The superblock was corrupted and the reiserfsck –rebuild-sb \/device<\/i> did not work… Salvation was impossible.
\nWhile googling the web and trying to find out possible solutions I came up to the wonderful idea of creating a software raid5 array of the 3 disks and have LVM2 on top of the raid. I would lose 1 disk in “space”…but I gained the ability to recover after an error and to be able to add more disks if that was necessary.<\/p>\nBefore we continue I must say that it’s necessary that you HAVE worked before with raid and lvm so some commands are familiar to you. This is NOT a step by step guide…but more like a draft of how things are done.I am not going to explain every little detail…man pages and google are always around if you have any questions.<\/p>\n
Enough of this…let’s start. <\/p>\n
Initialization<\/b><\/li>\n First of all let’s say that we got our 3 disks on \/dev\/hde, \/dev\/hdg, \/dev\/hdi<\/i>
\n1) We create 1 partition on each one covering the total space using our favorite disk managment software (fdisk, cfdisk,etc). (btw, drives MUST be IDENTICAL).
\n2) Then it’s time to create the \/etc\/raidtab<\/i> file. Our contents should look like:<\/p>\nraiddev \/dev\/md0
\n raid-level 5
\n nr-raid-disks 3
\n nr-spare-disks 0
\n persistent-superblock 1
\n chunk-size 32
\n parity-algorithm right-symmetric
\n device \/dev\/hde1
\n raid-disk 0
\n device \/dev\/hdg1
\n raid-disk 1
\n device \/dev\/hdi1
\n raid-disk 2\n<\/p><\/blockquote>\n3) Now let’s create our array:<\/p>\n
mkraid \/dev\/md0<\/p><\/blockquote>\n
4) It’s time for LVM2 now…let’s edit the \/etc\/lvm\/lvm.conf<\/i> so that we add support for raid devices. My filter line looks like this:<\/p>\n
filter =[ “a|loop|”, “a|\/dev\/md0|”, “r|.*|” ]<\/p><\/blockquote>\n
5) Start initializing the LVM:<\/p>\n
pvcreate \/dev\/md0 (you can issue a pvdisplay<\/i> to see if all things are correct)
\nvgcreate test \/dev\/md0 (you can issue a vgdisplay<\/i> to see if all things are correct)\n<\/p><\/blockquote>\n6) Time to create a small logical volume just for testing:<\/p>\n
lvcreate -L15000 -nbig test<\/p><\/blockquote>\n
(you can issue a lvdisplay<\/i> to see if all things are correct)
\n7) Now there’s something that’s distro-specific. “Usually” lvm is started on init script before software raid. But in our case, when a reboot occurs, we want a) start the raid b) start the lvm. I am using gentoo as a distro and gentoo had these things the other way round…It first started the lvm and then the raid, which resulted in errors during the boot process. This case is easily solved in gentoo by editing \/etc\/init.d\/checkfs<\/i> and moving the part about the LVM below the part about the software raid. The config file is really easy to read so I don’t think anyone might have a problem on that…
\n8) Let’s test what we’ve done so far…Let’s format that logical volume we’ve created with ext3.<\/p>\nmke2fs -j \/dev\/test\/big<\/p><\/blockquote>\n
9) Make an entry inside your \/etc\/fstab<\/i> to point to a place you want to mount that logical volume…and then issue a:<\/p>\n
mount \/dev\/test\/big<\/p><\/blockquote>\n
10) You are now ready to start copying data onto that volume…I’d suggest that you copy 5-10Gb out of the first 15Gb that we’ve created (remember that -L15000 ?). <\/p>\n
Now it’s time to simulate a crash! \ud83d\ude42<\/b><\/li>\n 11) We first stop the raid device (after unmounting it and changing the activation of the logical volume, lvchange -a n \/dev\/test\/big<\/i>):<\/p>\n
raidstop \/dev\/md0<\/p><\/blockquote>\n
12) Let’s destroy one disk. Open up again your favorite disk managment tool and pick up one disk to destroy…let’s say \/dev\/hdi<\/i>. Delete the partition it already has…and create a new one. All previous data is now lost!
\n13) If you want to make sure that you are on the right path of destroying everything…reboot your machine. Upon reboot you should get errors on the software raid and on the LVM not being able to activate the volume group “test”<\/i>.
\n14) Upon the root prompt issue: <\/p>\nraidstart \/dev\/md0<\/p><\/blockquote>\n
and then do a: cat \/proc\/mdstat<\/i>
\nYou should probably see something similar to this:<\/p>\ncat \/proc\/mdstat
\nPersonalities : [linear] [raid0] [raid1] [raid5] [multipath]
\nmd0 : active raid5 hdi1[2] hdg1[1] hde1[0]
\n 390716672 blocks level 5, 32k chunk, algorithm 3 [3\/3] [UUU]
\n [========>…………] resync = 43.9% (85854144\/195358336) finish=115.9min speed=15722K\/sec\n<\/p><\/blockquote>\n15) When that is finished, it will mean that raid5 has rebuilt the array after recovering from the “faulty” disk, that we’ve created, and the placement of the “new” drive. (both destruction and the new disk placement was done on step 12)
\n16) Issue: vgscan<\/i>
\nIt will make the volume group active again.<\/p>\nResizing the Logical Volume<\/b><\/li>\n 17) Say that you need more space to that logical volume you had created…15Gb is not that much after all…<\/p>\n
lvextend -L100G \/dev\/test\/big<\/p><\/blockquote>\n
We’ve now made that previous 15Gb logical volume to a 100Gb one…already feels much better…doesn’t it ?
\n18) But that’s not all, we now need to extend the ext3 partition to cover up all that “new space”<\/p>\ne2fsck -f \/dev\/test\/big ; resize2f \/dev\/test\/big<\/p><\/blockquote>\n
We first check that the partition is ok…and then resize it to the full extends of the logical volume.
\n19) We are set! We just need to mount our new partition…and we now have 100Gb of space! You can now extend that even further or create more logical volumes to satisfy your needs.<\/p>\nExtend the raid5 array<\/b><\/li>\n This section is to come in a few days…stay tuned.<\/p>\n
I hope that all the abobe helped you to create a better and more secure fileserver. Comments are much appreciated.<\/p>\n","protected":false},"excerpt":{"rendered":"
I was looking forward to creating a big fileserver with disk crash recovery capabilities. LVM2 with reiserfs partitions couldn’t do the trick for me. I had 3 200Gb disks “united” under a logical volume, and formated them with reiserfs and I want to test what would happen if one disk “crashed”. So I created a […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ep_exclude_from_search":false,"footnotes":""},"categories":[1],"tags":[],"class_list":["post-60","post","type-post","status-publish","format-standard","hentry","category-general"],"aioseo_notices":[],"views":9954,"_links":{"self":[{"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/posts\/60","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/comments?post=60"}],"version-history":[{"count":0,"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/posts\/60\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/media?parent=60"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/categories?post=60"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.void.gr\/kargig\/blog\/wp-json\/wp\/v2\/tags?post=60"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}