Large Library- Optimal Library Scan Settings

[FlixNow 0]

Hi everyone

 

I am looking at migrating over from Plex however library scans in Emby seem much slower.

 

I have a large library (6000+ Movies, 1000+ TV Series) and Plex takes about 20 minutes to scan, whereas Emby takes over an hour, sometimes longer.

 

These are the settings I have for Library scans:

- 1 metadata agent per library

- No chapter thumbnail creation

- Open Subtitles turned on

- Download images in advance off

 

I have Detect Changes turned on, but it doesn't seem to work (my files are located in a MergerFS folder)

 

Is there anything else I can do to speed up Library scans and/or make Emby detect changes.

 

Would love to swap over to Emby but scans are taking too long.

[Luke 42079]

Hi there, you could try uninstalling the nfo plugin, if you don't use nfo files. Then the I/O checks for these files will be eliminated.

[FlixNow 0]

Thanks Luke I'll give that a shot.

 

Any ideas on how to get Auto Detect to work on MergerFS

[Luke 42079]

What do you mean by Auto Detect? 

[FlixNow 0]

Sorry, realtime monitoring.

Edited August 27, 2019 by FlixNow

[lorac 118]

Under each library make sure enable real time monitoring is checked. Does the scan time really matter as long as it picks up the changes?

 

My library is just as large and my last scan took just under 30 minutes.

[FlixNow 0]

It does matter when it takes over an hour. It means it could potentially take 2 hours for content to appear in your library.

 

I'll keep playing with the settings, was just wanting to know if there were any tips to speed up the scan

[lorac 118]

My checked settings are enable real time, themoviedb, NFO, themoviedb, fan art, screen grabber, save artwork, enable thumbnail, open subtitles and save subs into media folders.

 

With real time monitoring content shows up within a minute or so.

 

Library scans are much faster than they used to be

 

Sent from my ONEPLUS A6003 using Tapatalk

[Luke 42079]

It does matter when it takes over an hour. It means it could potentially take 2 hours for content to appear in your library.

 

I'll keep playing with the settings, was just wanting to know if there were any tips to speed up the scan

 

Can we look at a server log? thanks.

[FlixNow 0]

I'll submit the logs once the current scan has finished. Current scan is taking over 8 hours and isn't the initial scan.

 

Granted, I have a lot of content, and running off an Rclone mount, so I don't expect it to be super fast, but the equivalent scans in Plex take 30 minutes.

[Luke 42079]

Great, thanks.

[FlixNow 0]

I've direct messaged you the log file as it contains my domain info. 

This scan took 14 hours - and wasn't an "initial" scan

 

Edited August 28, 2019 by FlixNow

[Luke 42079]

Try removing the statistics plugin and also turning off subtitle downloading.

[FlixNow 0]

Thanks. Tried that, down to 7 hours 51 minutes for a library scan.

 

Anything else that might help?

[Luke 42079]

Can you provide a new log after doing that? Thanks.

[FlixNow 0]

Just an FYI for anyone else using Emby and GDrive via Rclone - once applying a higher dir-cache-time to the rclone mount (say 96hrs), library scans reduced to minutes. 

Thanks Luke for your help

Edited September 3, 2019 by FlixNow

[Luke 42079]

Thanks for the feedback !