Recovering from my NIGHTMARE situation! (help ENCOURAGED)

[Garbonzo17 26]

6 hours ago, rbjtech said:

This 'concept' obviously only works for Static data - but I find it works perfectly for my 50Tb worth of online data with 50Tb(on old HDD's) sitting offline AND acting as a backup.

I'd love to have the budget for that... I do not. I am in this situation because I am migrating my collection off a terrible setup of several 1tbs, several more 2tbs, and more 3tbs, onto a managable pool of a few drives. Trying to NOT have to keep plugging in and resyncing "parts" of the collection as it is added to. Its not practical with that many tiny drives.. and too many points of failure. If I had the budget for 3x16's or 4x12's I'd be sitting pretty. I just don't right now.  

I have a customer of mine that is upgrading their storage from 5x6tb drives to 5x14s and I can probably get the 6's at a steal, but I know how many hours are on them, so not super stoked about getting into that too deep.

anyway, all options are on the table, but I am just trying to get to a point where I am as safe as I can be with as little disk waste as possible. for the time being just getting back from my bone-headed deletion of data will be enough to work on...

[Garbonzo17 26]

7 hours ago, CBers said:

 

3 hours ago, CBers said:

I think this is going a bit off-topic now. 

@Garbonzo17 Are you happy with the responses, or do you need anything else?

 

Yeah. I think Sonarr is gonna help with the missing stuff... and I have some good new ideas on sync and Snapraid seems worth looking into.  Still going through them. I didn't get any alerts via Tapatalk like I have in the past, and I just tried connecting with my phone and get a network error. Other forums seem working. Not sure if this is something others are experiencing.

Thanks for all the help though.  This is going to take longer than I'd like, but certainly not as long as it would without Emby/AutoOrganize and now plus Sonarr.

-G

 

 

[Gilgamesh_48 944]

35 minutes ago, Garbonzo17 said:

I didn't get any alerts via Tapatalk like I have in the past, and I just tried connecting with my phone and get a network error.

I believe that Emby has removed Tapatalk support from their forums.. I do not really know why but it seems a firm decision.

[Garbonzo17 26]

1 minute ago, Gilgamesh_48 said:

I believe that Emby has removed Tapatalk support from their forums.. I do not really know why but it seems a firm decision.

Good to know, all I used Tapatalk for was XDA and Emby... Ill move on. Thanks.

[pwhodges 1534]

Tapatalk was a lovely idea at first, but now many forums have responsive themes that make it unnecessary.  A forum I'm admin of still has it (and I know a couple of users swear by it), but their push towards commercialisation got quite irritating (as an admin getting their messages) until I manged to turn them off.

I presume it was not so much removed here as simply not added back into the new software.

Paul

Edited August 11, 2020 by pwhodges

[C.S. 62]

6 hours ago, Garbonzo17 said:

I gotta think that any rebuilding would be terrrrrriblty slow, especially since this is all on a not to modern pc...

You'd be correct there. Even the fastest computer on earth can't write to a 12tb spinner at more than a couple hundred megs a second. That adds up to some serious waiting.

Like many here I'm sure, I use the DrivePool / Snapraid combo and it's great. It's saved lots and lots of data for me time and again, but if I ever have the money, or if there's a serious breakthrough in storage technology, I'll be building a server with so much storage that I can just use DrivePool to keep 3 or 4 copies of everything. That way if I lose a drive, I just replace it and walk away. Omg that sounds like so much fun, so much better than waiting on a 48hr+ rebuild.

Someday.

[Carlo 4330]

Tapatalk was installed with the new forum software but introduced a security whole. If when it gets fixed it can be looked at again by the forum admins, but for now it's a firm OFF/UNINSTALLED.

[Garbonzo17 26]

On 10/08/2020 at 15:28, CBers said:

You could install Sonarr and import your TV shows. It would then show what is missing. 

No. 

Hoooooly Crap is Sonarr pretty amazing now.  (I had been relying on showRSS for the things I don't/cant record myself).

But Sonarr/Jacket together are gonna help fill in the missing episodes without having to pull out and re-rip the DVD/Bluray sets again) and maybe track down some of the recorded stuff too... though alot was old and obscure even when it was current.

Anyway, thanks again for putting that recommendation out there.

-G

[vaise 307]

I have the reverse.

I used drivepool for a while on windows, but twice had a complete loss of the drive pool - would not startup etc, opened a call but no good.  That was when I was a beginner on it, but those issues drove me towards an proper Unraid server and I have never looked back - everything I use is now on unraid dockers, even my router is a vm on unraid.

I use the drivepool on my desktop PC now only as a backup for the unraid nas, as I can add all the older drives together and run a sync from unraid to drivepool.

Moral of the story - backup backups backups - I also have an offsite backup set that gets updated every few months.

I work in IT - I would get laughed at by colleagues if I lost data.

[Garbonzo17 26]

On 13/08/2020 at 22:51, vaise said:

I have the reverse.

I used drivepool for a while on windows, but twice had a complete loss of the drive pool - would not startup etc, opened a call but no good.  That was when I was a beginner on it, but those issues drove me towards an proper Unraid server and I have never looked back - everything I use is now on unraid dockers, even my router is a vm on unraid.

I use the drivepool on my desktop PC now only as a backup for the unraid nas, as I can add all the older drives together and run a sync from unraid to drivepool.

Moral of the story - backup backups backups - I also have an offsite backup set that gets updated every few months.

I work in IT - I would get laughed at by colleagues if I lost data.

Thats the way I'd do it if it was mission critical.  But this is just my personal media server that is hit by at MOST 3 people, so this is more of a hoby...

I am using old hardware that is insufficient for VM.

Though I did just get a couple of non-working dell's with Xeons in them, and if I can get one working using parts from both, that may change my outlook on this front.

I work in IT as well, i've never lost a clients data... but I also don't drink at work ... Oh, I don't think I mentioned that before... that was a factor in my overlooking the sync direction button.

Good insights nonetheless.

-G

[GWTPqZp6b 41]

On 8/10/2020 at 2:15 PM, cayars said:

The thing I don't like about duplication is that it cuts your media storage in half. 100 TB is only useful for storing 50 TB. 

The thing I don’t like about duplication is that it doubles your storage costs! You need 200TB to store 100TB. It’s perspective. 

[C.S. 62]

47 minutes ago, GWTPqZp6b said:

The thing I don’t like about duplication is that it doubles your storage costs! You need 200TB to store 100TB. It’s perspective. 

I look at it like this: The 2 or 3 days I spend waiting for snapraid to rebuild a drive is the cost I pay for not buying enough storage to keep 2 or 3 copies of everything. If money was less of a factor for me, then absolutely I would fork over the cash for 100TB (or 150TB) to store my 50TB.

Zero downtime? Yes, please!

[arrbee99 1561]

Just reading about this Snapraid thing. It says usb hdds not recommended for reasons of speed. Does that mean they are ok to use ? Any experience with that ? success, failure, little bit slower, 10 times slower...

[Carlo 4330]

I've always used USB3 HDDs for the parity.

I certainly have some USB3 drives that are faster than many internal drives so I'm not sure about the speed thing.

[Garbonzo17 26]

On 13/08/2020 at 22:51, vaise said:

I have the reverse.

I used drivepool for a while on windows, but twice had a complete loss of the drive pool - would not startup etc, opened a call but no good.  That was when I was a beginner on it, but those issues drove me towards an proper Unraid server and I have never looked back - everything I use is now on unraid dockers, even my router is a vm on unraid.

I use the drivepool on my desktop PC now only as a backup for the unraid nas, as I can add all the older drives together and run a sync from unraid to drivepool.

Moral of the story - backup backups backups - I also have an offsite backup set that gets updated every few months.

I work in IT - I would get laughed at by colleagues if I lost data.

 

Edited August 17, 2020 by Garbonzo17
This was an accidental duplicate

[Garbonzo17 26]

Ok, so and update and additional questions.

Sonarr has been awesome at letting me know the files that are missing.

However I have some files that are corrupted... Boy do I wish I was using SnapRAID.

Example: I hit an episode of Lucifer that wouldn't play... so I then clicked on each file of the season and 2 of the 26 had this problem.  I then went to adjacent seasons and shows and hit about 12 or 13 out of about 300ish...  Does anywone know of any software that will check if a video can play? I doubt there is, but maybe someone has an idea of a way to script it and dump bad files (names) into a text file, or just move them to another directory... either really.  Just need to re-source the bad episodes.

Any ideas?

-G

[PenkethBoy 2063]

You could try using ffprobe as a first pass - not 100% sure it will pick up corrupt files so you would need to test it against one you have (i dont have any  )

If you have one of the corrupt files still

run this against it

"ffprobe -i "path to file" -loglevel +level -hide_banner -print_format json -show_streams -show_format -show_chapters > test.json 2>%1"

part of the output will contain lines prefixed with [info], [warning], [error] and [fatal] - if relevant - if the file is not corrupted you will see just [info] - also not all warnings/errors are show stoppers

the rest of the test.json file will give you detailed info on the file contents

If you do see non [info] output then its picking up the corrupt files

Next you would create a script to run against all your files - and output information as necessary - to a list file and/or move the corrupt files somewhere else etc etc

[Garbonzo17 26]

21 minutes ago, PenkethBoy said:

You could try using ffprobe as a first pass - not 100% sure it will pick up corrupt files so you would need to test it against one you have (i dont have any  )

I am giving that a try now.

I am sure I can eventually figure it out.... not sure the best indicator to use, or if attaching my output here is ok, but I did.

test1 is a bad file

test 2 is the next one in the folder (good)

I will do a few more and then figure out how to script it.

It looks like "index" might be all I need, but maybe codec_time_base or codec_tag (I am reading though the ffprobe.exe wiki now)

Thanks!

test1.json test2.json

[PenkethBoy 2063]

you have missed something out those json files are not complete

[Garbonzo17 26]

7 minutes ago, PenkethBoy said:

you have missed something out those json files are not complete

I basically cut-n-pasted.

[PenkethBoy 2063]

you missed of the 1 after the %

 

[feerlessleadr 155]

I'm going to go against the grain a little bit as an alternative. 

I used snapraid + drivepool for a long time, and then I had a controller failure which corrupted one of my drives (not sure how it happened, but the data on the drive was unreadable). I had an up to date parity snapshot via snapraid, and after rebuilding the missing drive using the parity drive (over a number of days), snapraid constantly errored out right at the end. I don't remember what the issue was, but long story short, I lost about 7TB worth of 'ISOs' from the damaged drive. 

I probably could have set things up better, etc., etc., but considering the first time I needed to do a major restore (not just restoring a deleted file), snapraid failed me. I realize this is not going to be common, but it did push me to find another solution. 

I signed up for a single account on Gsuite and started using rclone to upload all of my encrypted media (via rclone) to Gsuite Drive. At the time, I had approx 30TB of media, so it took me quite a bit of time to get everything uploaded (I also started this before Google implemented the ~700GB per day cap). However, after that initial upload, automating the upload of new files every night w/ rclone has been super easy. 

I've lost a number of drives since then, and it's been very easy to restore my missing data by just reversing the rclone paths. 

I know that some people will say this isn't worth while since eventually, Google will start enforcing the 1TB per user limit (for those w/ less than 5 users), but in that case, I would happily pay the $60 a month for unlimited storage (and will most likely just split it with a buddy to defray the costs). 

 

Something to think about, and has been really rock solid for me for the last 4 or 5 years. 

[Garbonzo17 26]

44 minutes ago, PenkethBoy said:

you missed of the 1 after the %

 

I added the 1 on the end and still got the same results.

[Garbonzo17 26]

34 minutes ago, feerlessleadr said:

I used snapraid + drivepool for a long time, and then I had a controller failure which corrupted one of my drives (not sure how it happened, but the data on the drive was unreadable). I had an up to date parity snapshot via snapraid, and after rebuilding the missing drive using the parity drive (over a number of days), snapraid constantly errored out right at the end. I don't remember what the issue was, but long story short, I lost about 7TB worth of 'ISOs' from the damaged drive. 

Well that is disconcerting. I was really hoping it would get me so security in addition to the file mirroring.

But I am also saving the cash to finally build another array that will be a mirror and then put it at a relatives house across town. That way I can mirror it onsite and drive it over there and then have them sync nightly or something.  I have about half as much data as you ~17tb.... but I also have a 1tb monthly cap and no real alternative ISP available. So uploading to any cloud provider would be an issue. (I was originally looking at something like backblaze)

[Carlo 4330]

I've seen that and caused it to happen on purpose testing.  You can easily do this on purpose by removing data and replacing it OR moving things between drives and not updating the parity after making changes.  When you keep the parity up to date you shouldn't have problems.  That why I turn off any type of drive balancing so once files are written they are there for good.