Scan media library not completing

[LurchZA 4]

Hi all,

 

I'm running Emby as a service on Windows 10 x64.

Current version is 3.2.1.116 (yes I know there is a newer version, I will update, but the problem I will describe has occurred over multiple versions)

 

My media was split between multiple drives.

Recently I cleaned it up and consolidated it all only one HDD.

When I scan my media library now, it never completes.

Only way to get it to stop running is if you restart the service.

If I disconnect from the internet then the scan completes, so my best guess is that it is unable to pull information from IMDB or one of the other options and is getting stuck on a file or folder.

 

I obviously did try clean up the %appdata%\Roaming\Emby-Server\data\ScheduledTasks folder in case there was an issue with the temp data there.

 

Any ideas would be appreciated.

 

Server log is attached.

ServerLog.txt

[LurchZA 4]

Update: I have upgraded to 3.2.5.1 and still have the issue, so definitely not linked to an older version.

[Luke 42078]

Can you provide a server log from the latest version? thanks !

[LurchZA 4]

Hi Luke,

 

As requested, latest log attached.

Log.txt

[Luke 42078]

Can you try removing your installed plugins and see if the issue persists? Thanks !

[LurchZA 4]

Hi Luke,

 

Plugins removed.

Same issue.

Log.txt

[Luke 42078]

This is a one minute log. Can you give it a little more time? thanks.

[LurchZA 4]

Another log attached

Log.txt

[Luke 42078]

Ok, I would suggest a little trial and error disabling some features under Metadata settings. See if you can disable some metadata providers for the various media types and get the scan to complete. that might help isolate where it's getting hung up. Thanks.

[LurchZA 4]

Ok, I would suggest a little trial and error disabling some features under Metadata settings. See if you can disable some metadata providers for the various media types and get the scan to complete. that might help isolate where it's getting hung up. Thanks.

I tried various combinations of the metadata on/off, and the percentages are different, but it still stops.

[LurchZA 4]

I decided to remove all the libraries except the smallest one.

What I then did was remove everything in that library that was not showing complete metadata.

Ran the library scan and it completed.

 

I store metadata in the folders with the content, so I took one item, deleted the images and nfo file (so it can pull fresh information), and placed it back into the library.

I then ran the scan again and the scan stopped at 72.6% and after about half an hour I restarted the Emby service.

I see the file I added back still shows the original date it was added (Added 8/4/2014 5:12 PM) so that got me thinking, is it not perhaps a database issue I am having?

Is a fresh install perhaps required?

I'd rather avoid it if I can , but my libraries aren't exactly huge, and I only have myself and 2 other users accessing my server, so not a huge deal to redo from scratch.

If it is necessary, I still have the emby.windows.zip I downloaded from github to update.

Can I run a clean installation from there or do I have to run the setup.exe off the site?

Nevermind, I found my answer here: https://emby.media/windows-server.html

 

I have time as I am not in the office today, so think I'm going to do the clean install. 

Edited February 28, 2017 by LurchZA

[LurchZA 4]

I've done a clean installation, but seem to have the same issue still.

Not 100% sure as it may just need some time to do the initial scan, but it got to 42.1% relatively fast and has been sitting for ages with no movement.

Will give it some time and check on it later.

[LurchZA 4]

I've done a clean installation, but seem to have the same issue still.

Not 100% sure as it may just need some time to do the initial scan, but it got to 42.1% relatively fast and has been sitting for ages with no movement.

Will give it some time and check on it later.

[LurchZA 4]

I appear to be going backwards here...

With my clean installation I definitely have the same issue (log attached)

Not sure if the logs show anything as I pulled it after the restart, but, I also can now not restart the service or run the exe if I am connected to the internet. As soon as I disconnect then either one works fine.

Log.txt

[Happy2Play 9780]

I've done a clean installation, but seem to have the same issue still.

Not 100% sure as it may just need some time to do the initial scan, but it got to 42.1% relatively fast and has been sitting for ages with no movement.

Will give it some time and check on it later.

 

If this is an initial scan depending on how much media you have and library setting it can take 24+ hours for a library scan to complete, the percentage can be quite deceiving.  I know mine say in the 40+ percent range for over 10 hours back when I set the server up.  There is a post in Introduce yourself where a new user said it took over 48hrs to scan their Large Library.

[LurchZA 4]

If this is an initial scan depending on how much media you have and library setting it can take 24+ hours for a library scan to complete, the percentage can be quite deceiving.  I know mine say in the 40+ percent range for over 10 hours back when I set the server up.  There is a post in Introduce yourself where a new user said it took over 48hrs to scan their Large Library.

I'll leave it overnight to see what happens.

I have a fairly small library compared to most (a little over 500GB) so will see what happens.

Before I consolidated the media I never had it take more than a few minutes to scan the old library.

[LurchZA 4]

So I have left the scan to run overnight, with no movement.

Latest log attached.

Log.txt

[Luke 42078]

As a way of narrowing it down, can you remove all libraries, verify the scan completes, then add one at a time until you run into the issue again? Thanks !

[LurchZA 4]

I tried removing all the libraries and the scan does not complete as long as I am connected to the internet - even if I untick all the options for metadata.

Only pulled the log after restarting the service, but I have attached it anyway.

Log.txt

[ebr 16182]

Looks like your server is being blocked from all internet access, or there is a network configuration problem:

	System.Net.WebException: The remote name could not be resolved: 'github.com'

[Happy2Play 9780]

I tried removing all the libraries and the scan does not complete as long as I am connected to the internet - even if I untick all the options for metadata.

1.gif

2.gif

Only pulled the log after restarting the service, but I have attached it anyway.

That log does not show a library scan.

 

That screenshot controls one content type there is a drop-down list for each media type with a list like that.  If you don't want to get info from the internet you need to disable it per library via Library and select each library to see their options.  But if there is no libraries neither matters.

Edited March 1, 2017 by Happy2Play

[LurchZA 4]

 

Looks like your server is being blocked from all internet access, or there is a network configuration problem:

	System.Net.WebException: The remote name could not be resolved: 'github.com'

Hi ebr,

 

I stand under correction , but, I don't think it's being blocked.

The 'refresh people' completes, and I presume that has to be coming from the internet?

 

I did check my firewall rules, and I noticed that I only had inbound rules for Emby.

No idea what it looked like with my old installation (though the firewall was not changed and it randomly stopped working and that is what prompted the reinstall), but I did add an outbound rule which didn't seem to make a difference.

[LurchZA 4]

That log does not show a library scan.

 

That screenshot controls one content type there is a drop-down list for each media type with a list like that.  If you don't want to get info from the internet you need to disable it per library via Library and select each library to see their options.  But if there is no libraries neither matters.

Hi Happy2Play,

 

Latest log attached.

 

To be honest, I didn't notice the dropdown.

I do what it to pull the metadata from the internet - I was only disabling it because Luke had suggested removing some of the sources as a test.

I'll try disabling all the options under all the content to test.

Log.txt

[Luke 42078]

it looks like you've enabled music metadata fetching. can you disable that as a way of further narrowing it down? thanks !

[LurchZA 4]

it looks like you've enabled music metadata fetching. can you disable that as a way of further narrowing it down? thanks !

Hi Luke,

 

I've disabled all music related metadata, and also removed the music library for now.

Started a new scan so will give it some time and see.

 

Thanks