Jump to content

RAID concerns


Bill4sman

Recommended Posts

Bill4sman

I've currently got a Mediasonic 4 Bay ProRaid sety for RAID 5 with (4) 4TB WD black drives. Having recently had a drive failure I've come across the fact that RAID 5 is NOT the ideal choice given the file sizes and quantity of data. So, I'm thinking of moving to Raid 10. Thoughts, Concerns or better suggestions? Thanks in advance!

Link to comment
Share on other sites

KMBanana

Why do you think RAID5 is wrong for your setup?  

You'd lose available space going to RAID10.  It's faster but do you need speed for media files?  

Link to comment
Share on other sites

Bill4sman

It has to do with the statistically proven data errors. Dealing with 12TB of data you ARE more than likely to have bad bits. Now, on a 12TB rebuild which I just had to go through, if you lose another drive during that process you're essentially hosed. I'll probably go with RAID 10.

Link to comment
Share on other sites

KMBanana

It has to do with the statistically proven data errors. Dealing with 12TB of data you ARE more than likely to have bad bits. Now, on a 12TB rebuild which I just had to go through, if you lose another drive during that process you're essentially hosed. I'll probably go with RAID 10.

RAID6 might be a better option.  It can handle any 2 drives failing without loss of data.

RAID10 is basically a mirrored raid 1, so it can't handle any 2 drives failing.  If you look at the drives on a RAID10 array like this. 

|A1|A2|-|B1|B2|

If A1 fails its data is only on A2.  It can survive B1 or B2 also failing, but if A2 is 2nd drive that dies or errors you're out of luck. 

 

Also, with regards to RAID5 I don't think it's bad with 4TB disks and for something that isn't a customer facing production environment.  The risk of failing during a rebuild should be pretty low.  As always though anything that you can not afford to lose must be backed up.  You aren't rebuilding 12TB of data, but 4TB.  

Link to comment
Share on other sites

Bill4sman

Unfortunately not supported by my ProRaid but you're right about 6. The problem is that 4K movies are a little hefty so with almost 500 movies in the library I'm going to need to have more storage. Upgrading drives in Raid 10 is FAR easier and faster whereas 6 would be an issue.

Link to comment
Share on other sites

Guest asrequested

Drive pooling. It's far better and has much more configurability. And a range of possible software.

  • Like 4
Link to comment
Share on other sites

Gilgamesh_48

Raid "anything" is a poor choice for safety. Mostly, even the best, do not protect from the underlying system failing. That is if you lose the "computer" that is running things you no longer can access the data on your drives.

 

Pooling, in particular StableBit's DrivePool as it is what I am familiar with, stores all the files in a hidden, but accessible, hidden directory on the drives in the pool. The stored files are in a standard Windows readable form and can even be accessed and played without the DrivePool software even running.

 

For me that makes pooling vastly superior to all the "raid" systems I have heard of.

 

I had a computer that was running DrivePool fail a couple of years ago and all I needed to do was move the drives to another computer and install DrivePool on the new computer and it detected the pool on the drives and recreated it on the new computer. Then all that was needed was to reenter the activation key and all was good to go. The whole process took less that 30 mins.

 

There are a LOT of people running various raid systems successfully but I think they are taking a risk.

 

The only drawback to using pooling is that it does not compress the files at all and, if you turn on duplication for redundancy, the space used by the files is exactly doubled. But drives are quite cheap and the extra cost is more that offset by safety.

  • Like 1
Link to comment
Share on other sites

KMBanana

Disagree with Gilgamesh, most RAID controllers will recognize an orphaned RAID configuration exists if you plug drives back in in the same order on another machine with the same model RAID controller. 

 

But that's a small point because the real lesson should be that no data is safe without a proper system of backups.  

Link to comment
Share on other sites

BAlGaInTl

Drive pooling. It's far better and has much more configurability. And a range of possible software.

That would be my advice as well. My system uses a RAID5 array right now, but once I find a deal on some new disks, I'm going with snapraid and drive pooling.

Link to comment
Share on other sites

BAlGaInTl

Don't forget DriveBender :)

 

Also, this thread:

 

https://emby.media/community/index.php?/topic/45382-drive-pooling/

 

 

But I'm a Linux server kind of guy.

 

I'm running OMV right now and may go to Snapraid + MergerFS.

 

I'm also considering evaluating Unraid instead.

 

I've been looking at several NAS' that run BTFRS but they're pricey...

 

You can always roll your own.  That's normally what I recommend anyway.

Link to comment
Share on other sites

Guest asrequested

If you're using Linux, ZFS is probably the best choice. I haven't used it, but the guys on here highly recommend it.

Link to comment
Share on other sites

BAlGaInTl

If you're using Linux, ZFS is probably the best choice. I haven't used it, but the guys on here highly recommend it.

 

ZFS has a lot more demanding hardware needs.

 

I thought about it, but ultimately decided against it.

Link to comment
Share on other sites

rbjtech

On largely static media collections, for home use, I came to the conclusion that there is very little point in having a redundant RAID setup and as has been highlighted in this thread, this actually increases the recovery risk due to sheer volume of parity data required or complications such as identical disk sizes, firmware, raid controllers etc etc

 

An offline and easily accessible BACKUP of the data is far more important - and if you have a set of disks available for RAID 1/10, then I would personally use them for backup, not redundancy.

 

After some discussion in this recent thread below - I've moved to drive pooling (from JBOD) and it makes use of ALL my old odd sized disks (for a 100% backup) AND the beauty is they are 100% portable to use as standalone if required. 

 

Have a read - there are some interesting views and a wealth of experience  :)

 

https://emby.media/community/index.php?/topic/71145-how-do-you-backuprecover-your-emby-system/?hl=%2Bhow+%2Byou+%2Bbackup

Edited by rbjtech
Link to comment
Share on other sites

BAlGaInTl

On largely static media collections, for home use, I came to the conclusion that there is very little point in having a redundant RAID setup and as has been highlighted in this thread, this actually increases the recovery risk due to sheer volume of parity data required or complications such as identical disk sizes, firmware, raid controllers etc etc

 

An offline and easily accessible BACKUP of the data is far more important - and if you have a set of disks available for RAID 1/10, then I would personally use them for backup, not redundancy.

 

After some discussion in this recent thread below - I've moved to drive pooling (from JBOD) and it makes use of ALL my old odd sized disks (for a 100% backup) AND the beauty is they are 100% portable to use as standalone if required. 

 

Have a read - there are some interesting views and a wealth of experience  :)

 

https://emby.media/community/index.php?/topic/71145-how-do-you-backuprecover-your-emby-system/?hl=%2Bhow+%2Byou+%2Bbackup

 

Which is why I'm leaning towards something like Snapraid + MergerFS

 

It's not raid in the truest sense.  Pooling will be done with Merger.

 

Even a disk fails, the rest of the drives can still be read.

  • Like 1
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...