Library scan takes "forever"

[Happy2Play 9780]

Where do you get that plugin?

I don't see anything called Statistics in the Plugin Catalog ?

 

In the plugin forum - New Statistics plugin

[dcook 299]

Thanks, is the Plugin Catalog no longer maintained?

[mastrmind11 722]

Thanks, is the Plugin Catalog no longer maintained?

It is.  The stats plugin is brand new and has not made it there yet (still a work in progress).

[dcook 299]

Got it working:

 

 

 

Looks like I need to add to my Movies, pretty low compared to you guys.

Edited February 24, 2017 by dcook

[chjohans 34]

Before I do a complete reinstall as a last resort I would like to try and change how I store metadata, instead of storing everything in one folder I would like to store it with the media.

 

So, if I delete all my metadata (except "People" which is quite big) from the common metadata folder, reconfigure the server to store metadata with media, and then do a library scan. Would that download any missing metadata? Or do I need to do something else, like "refreshing" each library, do achieve that? Or is this not possible at all?

[Luke 42077]

No, you would have to refresh manually as it will still just go by what is saved in the db. I would suggest doing that with the reinstall simultaneously. A clean database will probably improve performance just based on the age of your installation.

[chjohans 34]

Did a fresh install, my initial library scan took 14+ hours, that was expected though. But after that subsequent library scans *still* take 1+ hour to finish. So with a fresh install, fresh database and fresh metadata library (now storing metadata with media on my NAS) this is still much slower than I would like.

[chjohans 34]

Finally found the culprit, it turned out to be my photo library. I had assumed it didn't add much to the library scan times since there are no metadata download involved and it's pretty much static this would not add much to the scan times. But alas how wrong could I be, when I deleted my photo library my library scan time is now around 15 minutes, and that's even as my NAS is running a scheduled "consistency check" on it's raid, so I expect this to be even lower when the NAS is less busy.

 

This issue with slow library scans has been bugging me for a long time so I'm very happy to finally figure it out.

 

But someone might wanna look into why some photos adds so much to the library scan time, as it is now I can't add photo libraries to Emby. Not that I'll miss it much as it's hardly used, I just liked to have everything available "Just in case".

[Happy2Play 9780]

And your photo library contained how many images since most people will have more photos then total video files.

[chjohans 34]

True, and I have quite a bit of photos. My photo library has about 78000 pictures, that added 1+ hour to the library scan time.

 

My library scan times are now really fast, less than 5 minutes with 2796 movies, 163 TV shows and 8527 episodes, plus some music about 27000 mp3 files in total.

 

Those music files adds practically nothing to the library scan times, so something must be up with photos since the slowdown is that dramatic.