New Emby Unraid instalation - slow scan

[ChapeL 3]

Hi,

 

First of all I would like to thank you for this amazing piece of software, looks great and offers exactly what I was looking for. Thanks danioj on uraid forums for showcasing it.

 

One problem though, I've seen people reporting slow library scan/update speed and non of solutions there helped me to solve it. I run fresh Unraid setup with Emby docker enabled. I only have movies added to Emby, it's unraid Share with around 1200 titles.

 

Initial library scan took around 55 min, problem is that any next scan takes approx the same time, Ive tried to turn off everything that is possible to turn off, chapters, fanart, subtitles, posters etc with no change to how Emby behaves. I even deleted all my posters, fanart, nfo files to let emby build them from scratch, no joy. 

 

Could someone have a look at my log and see if there is something wrong there? I did search for error in txt file and this shows up around 150 times but nothing else.

2016-01-28 10:01:37.4151 Error App: Error in Nfo

 

It goes fast to 60% and then around 40 minutes to around 75% and then finishes within seconds.

 

2016-01-28 10:45:07.4847 Info App: Scan media library Completed after 44 minute(s) and 10 seconds

 

I really like the idea and the software, would love to have it sorted.

 

Thanks

ChapeL

server-63589571735.txt

Edited January 28, 2016 by ChapeL

[mgworek 134]

I've been running it on Unraid for over a year now and haven't found a fix for this yet. Hopefully someone can help you out. My TV Shows go quickly then it hits Movies, with almost 3000 movies and comes to a complete crawl. I have scanning scheduled to only once a week because of this. Tv shows are updated as soon as their downloaded without a scan thanks to Sonar.

[MSattler 390]

I've been running it on Unraid for over a year now and haven't found a fix for this yet. Hopefully someone can help you out. My TV Shows go quickly then it hits Movies, with almost 3000 movies and comes to a complete crawl. I have scanning scheduled to only once a week because of this. Tv shows are updated as soon as their downloaded without a scan thanks to Sonar.

 

One of the things I would do, is move the metadata to a folder on the cache drive instead of saving it with the media.  Reason being is that this slows down the scan as every write now results in a parity calculation and parity write as well.  Additionally, when using unraid to list movies, it has to spin up the drives to get metadata, until it's cached.   I don't run Emby on my unRaid server, but I did move my metadata to a separate non parity protected drive and that sped up my scans.   Again, ymmv, but it helped me in my case.

[ChapeL 3]

Oh I see, shame as I really wanted it to work like simillar to kodi, it scans new movies in seconds, one hour wait for new movie to show is bit too much. I don't even have parity set yet, only user shares. Can't imagine how slow would it be with parity active. Docker and Emby is on Cache Drive btw so I wouldn't be affected by parity anyway. 

 

Thanks Anyway

ChapeL

[mgworek 134]

One of the things I would do, is move the metadata to a folder on the cache drive instead of saving it with the media.  Reason being is that this slows down the scan as every write now results in a parity calculation and parity write as well.  Additionally, when using unraid to list movies, it has to spin up the drives to get metadata, until it's cached.   I don't run Emby on my unRaid server, but I did move my metadata to a separate non parity protected drive and that sped up my scans.   Again, ymmv, but it helped me in my case.

 

 I think I have metadata going to the cache.

 

I don't have it checked off to go to media folders but i do have .nfo files in the share. 

[Luke 42077]

due to the nfo parsing failures the scan is going to keep retrying the ones that failed. I will look at what is causing the error and make sure it doesn't get stuck on that, for the next release. in the meantime you could try deleting some of the nfo's mentioned in the log

[ChapeL 3]

Quick update, I've deleted everything apart from video files, took about 200 films for testing purposes and put them in separate folders for each movie (I had them all in one before, was planing to move them to their respective folders anyway). Added new folder, fist scan completed in 4 minutes, next ones are done in 5-10s !!! Great, looks like I just have to redo my entire library but it looks promising. Thank you all for your help. BTW subtitles download doesn't seem to work. I type in my opensubtitiles details but I'm not sure if password is being saved as it stays blank when I click save. Not a big deal, I just though I'll let you know.