Library Scan Problems

[rhodges 49]

Emby 4.0.3.0

 

I noticed a library scan was running for over an hour. I also saw the subtitles job was running at the same time. I stopped both and then started the library scan.

 

I then noticed that in the log, the library scan job was trying to download subtitles for everything. I'm guessing I hit the 30 day fresh everything as specified in the library, but I didn't expect it to download subtitles as well.

 

I then disabled the subtitles providers and started seeing errors with autoboxsets.

 

I then removed autoboxsets.

 

Now, the scan runs about 30 to 60 seconds, but never really "finishes". Oh, it says it has completed, but then if I run it again, it picks up where it "left off"

 

You'll notice it processes S01E10, then says, done. Then I start the task again and it starts again, but this time with S01E11. So it knows where to start again.

2019-06-05 13:41:48.865 Debug MediaEncoder: Ffprobe -i file:"V:\Video\Television\The Mentalist\Season 01\THE MENTALIST - S01E10 - RED BRICK AND IVY 720P DD5.1 x264 MMI.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2019-06-05 13:41:48.865 Info MediaEncoder: ProcessRun 'ffprobe' Execute: C:\Users\Administrator\AppData\Roaming\Emby-Server\system\ffprobe.exe -i file:"V:\Video\Television\The Mentalist\Season 01\THE MENTALIST - S01E10 - RED BRICK AND IVY 720P DD5.1 x264 MMI.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2019-06-05 13:41:48.872 Info MediaEncoder: ProcessRun 'ffprobe' Started.
2019-06-05 13:41:48.954 Info MediaEncoder: ProcessRun 'ffprobe' Process exited with code 0
2019-06-05 13:41:53.550 Info TaskManager: Scan media library Completed after 0 minute(s) and 39 seconds
2019-06-05 13:41:53.550 Info LibraryMonitor: Watching directory V:\Video\Movies
2019-06-05 13:41:53.550 Info LibraryMonitor: Watching directory V:\Video\Television
2019-06-05 13:41:53.557 Info TaskManager: ExecuteQueuedTasks
2019-06-05 13:41:53.966 Info App: Emby.Kodi.SyncQueue: Starting Library Sync...
2019-06-05 13:41:53.967 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" Added 0 items:  
2019-06-05 13:42:00.957 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" Updated 117 items:  73434,73435,73436,73437,73438,73439,73440,73441,73442,73443,73755,73756,73757,73758,73759,73760,73761,73762,73763,73764,73765,73766,73972,73973,73974,76182,76183,76184,76185,76186,76187,76188,76189,76190,76191,76192,76193,76194,76195,76196,76197,76198,76199,76200,76201,76202,76203,76204,76205,76206,76207,76208,76291,76292,76293,76294,76295,76296,76297,76298,76299,76300,76869,76870,76871,76872,76873,76874,76875,76876,76877,76878,76879,76880,76881,76882,76883,76884,76885,76886,76887,76888,76889,76890,76891,76892,76893,76894,76895,76896,76897,76898,76899,76900,76901,76902,76903,76904,76905,76906,76907,76908,76909,76910,76911,76912,76913,77220,77221,77222,77223,77224,77225,77226,77227,77228,77229
2019-06-05 13:42:00.957 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" Removed 0 items:  
2019-06-05 13:42:00.957 Info App: Emby.Kodi.SyncQueue: Finished Library Sync Taking 00:00:06.9900764
2019-06-05 13:43:04.054 Info HttpServer: HTTP POST http://<<redacted>>:8096/ScheduledTasks/Running/6330ee8fb4a957f33981f89aa78b030f. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36
2019-06-05 13:43:04.055 Info HttpServer: HTTP Response 204 to 192.168.121.1. Time: 1ms. http://<<redacted>>:8096/ScheduledTasks/Running/6330ee8fb4a957f33981f89aa78b030f
2019-06-05 13:43:04.055 Info TaskManager: Executing Scan media library
2019-06-05 13:43:04.056 Info LibraryMonitor: Stopping directory watching for path V:\Video\Television
2019-06-05 13:43:04.056 Info LibraryMonitor: Stopping directory watching for path V:\Video\Movies
2019-06-05 13:43:04.056 Info App: Validating media library
2019-06-05 13:43:04.109 Info HttpServer: HTTP GET http://<<redacted>>:8096/ScheduledTasks?isHidden=false. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36
2019-06-05 13:43:04.110 Info HttpServer: HTTP Response 200 to 192.168.121.1. Time: 1ms. http://<<redacted>>:8096/ScheduledTasks?isHidden=false
2019-06-05 13:43:04.116 Info HttpServer: HTTP GET http://<<redacted>>:8096/Users/888da77dfc9540cdb7af02d0c62b3c36. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36
2019-06-05 13:43:04.116 Info HttpServer: HTTP Response 200 to 192.168.121.1. Time: 1ms. http://<<redacted>>:8096/Users/888da77dfc9540cdb7af02d0c62b3c36
2019-06-05 13:43:18.435 Debug MediaEncoder: Ffprobe -i file:"V:\Video\Television\The Mentalist\Season 01\THE MENTALIST - S01E11 - RED JOHN'S FRIENDS 720P DD5.1 x264 MMI.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2019-06-05 13:43:18.435 Info MediaEncoder: ProcessRun 'ffprobe' Execute: C:\Users\Administrator\AppData\Roaming\Emby-Server\system\ffprobe.exe -i file:"V:\Video\Television\The Mentalist\Season 01\THE MENTALIST - S01E11 - RED JOHN'S FRIENDS 720P DD5.1 x264 MMI.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2019-06-05 13:43:18.442 Info MediaEncoder: ProcessRun 'ffprobe' Started.
2019-06-05 13:43:18.534 Info MediaEncoder: ProcessRun 'ffprobe' Process exited with code 0
2019-06-05 13:43:18.554 Debug MediaEncoder: Ffprobe -i file:"V:\Video\Television\The Mentalist\Season 01\THE MENTALIST - S01E12 - RED RUM 720P DD5.1 x264 MMI.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2019-06-05 13:43:18.554 Info MediaEncoder: ProcessRun 'ffprobe' Execute: C:\Users\Administrator\AppData\Roaming\Emby-Server\system\ffprobe.exe -i file:"V:\Video\Television\The Mentalist\Season 01\THE MENTALIST - S01E12 - RED RUM 720P DD5.1 x264 MMI.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2019-06-05 13:43:18.560 Info MediaEncoder: ProcessRun 'ffprobe' Started.

Why is it not running to completion? Why is it downloading subtitles on a library scan? Isn't that what the subtitle task is for?

[Luke 42085]

As far as why it's downloading on the scan, it's doing exactly what you configured it to do in library settings. Have you explored those?

[rhodges 49]

As far as why it's downloading on the scan, it's doing exactly what you configured it to do in library settings. Have you explored those?

I did, that's how I turned it completely off. I guess I didn't realize that it would download during a full scan. I assumed that control what the "download subtitles" schedule task or the real time monitor.

 

I have over 30,000 files. The subtitle task runs for 3 to 5 hours when it runs. When the full library scan runs, every 12 hours, it seems like when it hits the 30 day metadata refresh (as specified in the library settings) it downloads subtitles. But the actual subtitle job might be running as well.

 

Maybe an option, like with creating chapter files, to not download subtitles during the full library scan job? Not sure if that is a solution or my problem is just an outlier.

 

Regarding the scan only pulling some data, I just scripted something to run the library scan, over and over again until it finally "caught up". Not sure what the magic number was, but I ran it about 100 times. Sometimes it would do 30 items, sometimes it would do 300 items.

[Luke 42085]

Yes that option would make sense. Sorry, I thought we already had it but you're right it's for chapters (now called Thumbnails).