Is my initial library scan frozen?

[cutter 0]

I am performing an initial library scan on my Emby server but the scan seems to be stuck at 86,7% for more than 12 hours. I had checked the "Download Images in Advance" box prior to scanning, so this could explain the delay; I don't mind waiting for the scan to finish, I just want to make sure that I'm not waiting in vain.

I am checking the library every few hours to check whether new content is being presented but it seems stuck. Which log file should I check to make sure the scan process is still running? 

[FrostByte 5044]

 

It's probably not frozen as that is typical of an initial scan.  If you go to the logs and refresh the current log labeled "embyserver.txt" a few times you should see activity showing that it's actually processing. The % just isn't always true to the actual time it takes.  If you don't see the different media being processed then you may be stuck

BTW: it's always recommended to turn off "Generate video preview thumbnails" for each library during the initial scan and then you can turn them back on afterward.  It takes a lot of time to create all the chapter and visual seeking images so do that after you're up and running (maybe even schedule while you're sleeping).  I also always add one library at a time during initial installs for the same reason that I start doing things and I'm not waiting for 3 huge libraries to scan all at once. 

[cutter 0]

Thx for your answer FrostByte.

The embyserver.txt log continues writing so the process is not dead; it's just that no new items are being scanned in the library and the entries in the log do not seem to indicate anything useful taking place in terms of scanning for media. 

Here are the latest lines from the log:

2020-08-13 15:52:52.066 Error PortMapper: Error creating port map

*** Error Report ***

Version: 4.4.3.0

Command line: /var/packages/EmbyServer/target/server/EmbyServer.exe -package synology -programdata /var/packages/EmbyServer/target/var -ffmpeg /var/packages/EmbyServer/target/ffmpeg/bin/ffmpeg -ffprobe /var/packages/EmbyServer/target/ffmpeg/bin/ffprobe -ffdetect /var/packages/EmbyServer/target/ffmpeg/bin/ffdetect -restartexitcode 121

Operating system: Unix 3.10.105.0

64-Bit OS: True

64-Bit Process: True

User Interactive: False

Mono: 6.8.0.105 (tarball Fri Apr 10 10:02:27 UTC 2020)

Runtime: file:///volume1/@appstore/EmbyServer/3rdparty/mono/6.8.0.105/lib/mono/4.5/mscorlib.dll

System.Environment.Version: 4.0.30319.42000

Processor count: 4

Program data path: /var/packages/EmbyServer/target/var

Application directory: /volume1/@appstore/EmbyServer/releases/4.4.3.0

MediaBrowser.Model.Net.HttpException: MediaBrowser.Model.Net.HttpException: The remote server returned an error: (500) Internal Server Error. ---> System.Net.WebException: The remote server returned an error: (500) Internal Server Error.

at System.Net.HttpWebRequest.GetResponseFromData (System.Net.WebResponseStream stream, System.Threading.CancellationToken cancellationToken) [0x00146] in <b373cc92cfb94ef6a19b4f1140645494>:0

at System.Net.HttpWebRequest.RunWithTimeoutWorker[T] (System.Threading.Tasks.Task`1[TResult] workerTask, System.Int32 timeout, System.Action abort, System.Func`1[TResult] aborted, System.Threading.CancellationTokenSource cts) [0x000f8] in <b373cc92cfb94ef6a19b4f1140645494>:0

at System.Net.HttpWebRequest.EndGetResponse (System.IAsyncResult asyncResult) [0x00020] in <b373cc92cfb94ef6a19b4f1140645494>:0

at System.Threading.Tasks.TaskFactory`1[TResult].FromAsyncCoreLogic (System.IAsyncResult iar, System.Func`2[T,TResult] endFunction, System.Action`1[T] endAction, System.Threading.Tasks.Task`1[TResult] promise, System.Boolean requiresSynchronization) [0x0000f] in <9d3f0d4bd0fb4c1e8b6c2ac1ba1303ac>:0

--- End of inner exception stack trace ---

at Emby.Server.Implementations.HttpClientManager.HttpClientManager.SendAsyncInternal (MediaBrowser.Common.Net.HttpRequestOptions options, System.String httpMethod) [0x00858] in <4b2b35e458474e708c04b3533f59ad82>:0

at Emby.Server.Implementations.HttpClientManager.HttpClientManager.SendAsync (MediaBrowser.Common.Net.HttpRequestOptions options, System.String httpMethod) [0x0009e] in <4b2b35e458474e708c04b3533f59ad82>:0

at Mono.Nat.Upnp.UpnpNatDevice.GetSpecificMappingAsync (Mono.Nat.Protocol protocol, System.Int32 publicPort, System.Threading.CancellationToken cancellationToken) [0x000b9] in <dbdb8af7976c471bbb665e85d4c12c08>:0

at Mono.Nat.Upnp.UpnpNatDevice.CreatePortMap (Mono.Nat.Mapping mapping, System.Threading.CancellationToken cancellationToken) [0x00147] in <dbdb8af7976c471bbb665e85d4c12c08>:0

at Emby.PortMapper.ExternalPortForwarding.CreateRules (Mono.Nat.INatDevice device, System.Threading.CancellationToken cancellationToken) [0x001c0] in <dbdb8af7976c471bbb665e85d4c12c08>:0

Source: mscorlib

TargetSite: Void Throw()

InnerException: System.Net.WebException: The remote server returned an error: (500) Internal Server Error.

Source: System

TargetSite: System.Net.WebResponse EndGetResponse(System.IAsyncResult)

at System.Net.HttpWebRequest.GetResponseFromData (System.Net.WebResponseStream stream, System.Threading.CancellationToken cancellationToken) [0x00146] in <b373cc92cfb94ef6a19b4f1140645494>:0

at System.Net.HttpWebRequest.RunWithTimeoutWorker[T] (System.Threading.Tasks.Task`1[TResult] workerTask, System.Int32 timeout, System.Action abort, System.Func`1[TResult] aborted, System.Threading.CancellationTokenSource cts) [0x000f8] in <b373cc92cfb94ef6a19b4f1140645494>:0

at System.Net.HttpWebRequest.EndGetResponse (System.IAsyncResult asyncResult) [0x00020] in <b373cc92cfb94ef6a19b4f1140645494>:0

at System.Threading.Tasks.TaskFactory`1[TResult].FromAsyncCoreLogic (System.IAsyncResult iar, System.Func`2[T,TResult] endFunction, System.Action`1[T] endAction, System.Threading.Tasks.Task`1[TResult] promise, System.Boolean requiresSynchronization) [0x0000f] in <9d3f0d4bd0fb4c1e8b6c2ac1ba1303ac>:0

 

2020-08-13 15:59:42.421 Info HttpServer: HTTP GET http://192.168.1.3:8096/emby/Users/075456d8d8de495e874894329ebd6412/Items/6c2a057148b4d7c20a207c789aba6d07. UserAgent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36 Edg/84.0.522.59

2020-08-13 15:59:42.424 Info HttpServer: HTTP Response 200 to 192.168.1.26. Time: 3ms. http://192.168.1.3:8096/emby/Users/075456d8d8de495e874894329ebd6412/Items/6c2a057148b4d7c20a207c789aba6d07

2020-08-13 15:59:42.431 Info HttpServer: HTTP GET http://192.168.1.3:8096/emby/Users/075456d8d8de495e874894329ebd6412/Items?SortBy=SortName&SortOrder=Ascending&IncludeItemTypes=Series&Recursive=true&Fields=BasicSyncInfo%2CPrimaryImageAspectRatio&ImageTypeLimit=1&EnableImageTypes=Primary%2CBackdrop%2CThumb&StartIndex=0&Limit=50&ParentId=6c2a057148b4d7c20a207c789aba6d07. UserAgent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36 Edg/84.0.522.59

2020-08-13 15:59:43.826 Info HttpServer: HTTP Response 200 to 192.168.1.26. Time: 1395ms. http://192.168.1.3:8096/emby/Users/075456d8d8de495e874894329ebd6412/Items?SortBy=SortName&SortOrder=Ascending&IncludeItemTypes=Series&Recursive=true&Fields=BasicSyncInfo%2CPrimaryImageAspectRatio&ImageTypeLimit=1&EnableImageTypes=Primary%2CBackdrop%2CThumb&StartIndex=0&Limit=50&ParentId=6c2a057148b4d7c20a207c789aba6d07

2020-08-13 15:59:43.975 Info HttpServer: HTTP GET http://192.168.1.3:8096/emby/Items/Prefixes?IncludeItemTypes=Series&Recursive=true&ParentId=6c2a057148b4d7c20a207c789aba6d07&userId=075456d8d8de495e874894329ebd6412. UserAgent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36 Edg/84.0.522.59

2020-08-13 15:59:44.066 Info HttpServer: HTTP Response 200 to 192.168.1.26. Time: 92ms. http://192.168.1.3:8096/emby/Items/Prefixes?IncludeItemTypes=Series&Recursive=true&ParentId=6c2a057148b4d7c20a207c789aba6d07&userId=075456d8d8de495e874894329ebd6412

2020-08-13 15:59:48.211 Info HttpServer: HTTP GET http://192.168.1.3:8096/emby/Users/075456d8d8de495e874894329ebd6412. UserAgent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36 Edg/84.0.522.59

2020-08-13 15:59:48.213 Info HttpServer: HTTP Response 200 to 192.168.1.26. Time: 2ms. http://192.168.1.3:8096/emby/Users/075456d8d8de495e874894329ebd6412

2020-08-13 15:59:48.214 Info HttpServer: HTTP GET http://192.168.1.3:8096/emby/LiveTv/Channels?userId=075456d8d8de495e874894329ebd6412&limit=1&ImageTypeLimit=1&EnableTotalRecordCount=false&EnableImages=false&EnableUserData=false. UserAgent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36 Edg/84.0.522.59

2020-08-13 15:59:48.217 Info HttpServer: HTTP Response 200 to 192.168.1.26. Time: 3ms. http://192.168.1.3:8096/emby/LiveTv/Channels?userId=075456d8d8de495e874894329ebd6412&limit=1&ImageTypeLimit=1&EnableTotalRecordCount=false&EnableImages=false&EnableUserData=false

2020-08-13 15:59:48.796 Info HttpServer: HTTP GET http://192.168.1.3:8096/emby/Users/075456d8d8de495e874894329ebd6412/Items/Resume?Limit=12&Recursive=true&Fields=PrimaryImageAspectRatio%2CBasicSyncInfo%2CProductionYear&ImageTypeLimit=1&EnableImageTypes=Primary%2CBackdrop%2CThumb&EnableTotalRecordCount=false&MediaTypes=Video. UserAgent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36 Edg/84.0.522.59

2020-08-13 15:59:48.797 Info HttpServer: HTTP GET http://192.168.1.3:8096/emby/Users/075456d8d8de495e874894329ebd6412/Items/Resume?Limit=12&Recursive=true&Fields=PrimaryImageAspectRatio%2CBasicSyncInfo%2CProductionYear&ImageTypeLimit=1&EnableImageTypes=Primary%2CBackdrop%2CThumb&EnableTotalRecordCount=false&MediaTypes=Audio. UserAgent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.125 Safari/537.36 Edg/84.0.522.59

 

As far as your suggestions are concerned, "Enable image thumbnail creation" is unchecked, and same as you, I actually have 3 libraries I want to scan into Emby but I thought it would be best to create each library after the previous one had completed scanning, so i added only the first one, but still, no luck.

I'll probably wait until tomorrow and if it's still stuck, I'll delete the library, restart the emby server and try again.

 

[Luke 37022]

Hi there, please attach the complete emby server log. Thanks.

[cutter 0]

Hi there, quick update; after a few more hours of no progress at all, I decided to restart emby server. The server didn't restart and I had to stop and restart the package from Synology in order to login to Emby again. I started rescanning my library from where it had left off, it went from 86,7 to 87,6% and imported a few more TV series in a matter of minutes and then seems stuck again. I am attaching the full log.

embyserver.txt

[Luke 37022]

Hi, there's ongoing activity in this log. I would just be patient and allow it to finish.

[cutter 0]

ok, thx will do; I'll let it do its thing for 2 more days and if it hasn't completed by Sunday morning, I'll delete everything and try again from scratch.

[Luke 37022]

You may also see better performance with this:

 

[cutter 0]

I don't know if it's really related to the new version or it was just a problem with my previous install, but since I upgraded from 4.4.3 to beta 4.5.0.17, not only the scan completed in a few hours (whereas with 4.4.3 it never completed), but the overall interface and response feels snappier and much more lightweight! Thanks for your help Luke. Keep up the great work guys! 

[FrostByte 5044]

The .NET core used in the newer packages are faster than mono.  There was a .NET core for 4.4.3 (stable) also on that link which you could have tried, but if you're happy with the beta that is fine.  Or, if you want to once a new stable is released just stay on stable at that time.

[cutter 0]

A few hours ago I also updated to 4.5.0.18 beta but yeah, I'll definitely keep an eye out for the stable release as well.

Edited August 14, 2020 by cutter