Jump to content

Library Scan Issues


chiefnerd

Recommended Posts

chiefnerd

Over time Emby has started taking more and more time to scan the library and now it's sending the CPU ballistic during scans so I started looking at the logs and it appears to be attempting to scan every single TV Show in the EPG- I'm not talking about recordings but rather it seems to be going through the guide and scanning every show. I'm left scratching my head completely and now it's such an issue that we have to cut the scan short every time because the CPU load is well in the dangerous levels and stays there indefinitely.

 

Here's a snippet from the log. How it's made is in no library, it's not a recording, it's not a scheduled recording but emby is trying to scan it. I don't know if this is the main cause of the scans going to hell but seems a likely culprit:

 

Debug App: Running ProgramImageProvider for How It's Made 2016-07-23 14:22:19.4250 
Link to comment
Share on other sites

chiefnerd

The logs are ginormous mate- 58MB-300MB thus I posted the snippet. Same error repeats over and over for each TV Show in the guide.

 

The server is now sitting at nearly 90% CPU load and has been there for 30 minutes and this is a Xeon E5-2620 v3 with 128GB RAM so God knows what the Hell Emby thinks it's doing using up every thread on the processor. Forgot to add we're on Ubuntu Trusty, emby is the latest version with tvheadend plugin, Kodi Sync Queue, Auto Boxsets, Rotton Tomatoes, TImelords 2 plugins installed.

 

Link to the log in Dropbox- https://dl.dropboxusercontent.com/u/27236363/Log%20%283%29.txt 

Edited by chiefnerd
Link to comment
Share on other sites

Ok, the TVHeadEnd plugin prints a lot of debug info to the log. I would consider asking the developer to reduce that.

 

I would try removing the Kodi Sync Queue plugin and see if that has an affect on the performance of your library scan.

 

Unrelated, it looks like you configured a camera upload path that the server does not have access to:

	InnerException: System.UnauthorizedAccessException
	Access to the path "/home/nerdvideo/cam/sports" is denied.
	  at System.IO.Directory.CreateDirectoriesInternal (System.String path) <0x7f8440703370 + 0x00120> in <filename unknown>:0 
	  at System.IO.Directory.CreateDirectory (System.String path) <0x7f84407031c0 + 0x000a0> in <filename unknown>:0 
	  at CommonIO.ManagedFileSystem.CreateDirectory (System.String path) <0x4043bc70 + 0x00018> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.Devices.DeviceManager+<AcceptCameraUpload>c__async1.MoveNext () <0x40db78a0 + 0x003d8> in <filename unknown>:0 

Link to comment
Share on other sites

pünktchen

@@Luke my logs also have tons of entries like in chiefnerds starting post although i set program images to false in my tv plugins. What is Emby trying to do here?

Link to comment
Share on other sites

chiefnerd

Cheers for having a look Luke. There isn't actually a folder /home/nerdvideo/cam/sports so I'm not sure what it's trying to access.

 

I tried removing Kodi Sync before and trying a scan without any difference but I'll give it another try

Link to comment
Share on other sites

chiefnerd

Still identical behaviour and having to restart the server to stop the scan.

 

LOG

 

UPDATE: After upgrading to the latest Emby Build, doing a full Server reboot- It is exactly the same. Goes fine, gets to 97.7 then hangs with average server load then starts spiking through the roof. Add to this we keep notification popups from chrome saying new season added for what appears to be Home and Away of which there aren't any episodes, it's there for when we record it so Emby can auto organise an episode yet the notification popup is saying for a season from 1990! Why is Emby attempting to scan every single Season for a TV Show when there isn't even an Episode from 1 Season...this is kind of crazy, waste of server overheads and time when the Season does not exist on the server.

 

This is becoming so much of a headache I'm thinking of removing Emby now, it's absolutely crazy taking up so much CPU use when all it is doing is indexing and downloading- (chapter scans are turned off) so it is very, very worrying the load it's putting on the CPU

Edited by chiefnerd
Link to comment
Share on other sites

chiefnerd

And it's getting worse.

 

This is the server at idle, Emby has no tasks, it's not transcoding, it's not synccing, yet it's calling ffmpeg to check files. I have restarted Emby 4 times and the task stays

 

57970135bd71f_Screenshot20160726071822.p

Link to comment
Share on other sites

chiefnerd

Uninstalled Emby, reinstalled Emby- still the same. And I'm noticing Emby is not stopping FFMPEG instances after transcoding leaving them open. We have FFMPEG installed separately from the Emby Version because we use it to pipe in m3u8 streams to TVHeadend. Is having our own instance of ffmpeg causing issues? Mono is also left open constantly optimising Emby- is this normal for Mono?

 

Should add that this is a headless server running only web interfaces for the minimal software installed- Webmin, Emby, TVHeadend

Link to comment
Share on other sites

chiefnerd

I kind of figured that out but do you think it's because we're running the version installed separately from Emby and Emby is trying to run it instead of it's own version?

 

SInce I forcibly stopped the processes running it doesn't seem to have happened again so not sure if it's a one off? Mono CPU use also seems to have tailed off after 5 hours or so. Managed to get a full library scan having removed the TV Series in the library it was trying to scan every season of and also removing TVheadend completely and re-installing. Now I'm going to try and add 2 movies and see if it completes it's scan (other scans were made with no media added to the library)

Edited by chiefnerd
Link to comment
Share on other sites

chiefnerd

I'm over the moon the developers have solved this...oops, they didn't. Had alot of respect for the developers til now, guess Premiere support is worth it's weight in Gold and to think I was going to give additional donations

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...