Jump to content

Instability & High CPU Usage - Debian

keithjeb

By keithjeb
in Linux

 Share
Go to solution Solved by Luke,

Recommended Posts

keithjeb

keithjeb   0

Posted
Posted

I'm using the current build ( 3.0.5597.1) on Debian Jessie, mono 3.10.

 

I'm experiencing a lot of instability and very high CPU usage at idle.

 

Hardware is an E3 1225v3 (3.2ghz quadcore xeon) which is regularly seeing 1 or 2 cores pegged at 100% even with nothing playing back.

 

Playback is failing pretty much randomly through the web client (although seems to be more successful by DLNA, haven't tried the android app yet).

 

With debugging on its pretty hard to post logs - my last one is about 50mb of this kind of thing:

2015-05-03 00:25:23.3301 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3301 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3301 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3301 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv

Presumably something is going on to get it stuck in a loop - perhaps to do with metadata as playback crashes appear to happen as a new file is added (by sonarr if that makes a difference). I've turned debug transcode logs on and will try and reproduce the failure tomorrow, at the moment the transcode log just ends mid line and requires a restart of the daemon to work. It also leaves around a couple of orphan ffmpeg threads which need to be manually cleaned up (and also have very high cpu usage).

 

Anyone have any ideas, or ideas on how to get more useful debug info? Other than these issues I'm loving the whole program, but unfortunately restarting 3/4 times in a movie isn't going to cut it with SWMBO.

Link to comment
Share on other sites
  • Solution
Luke Emby Team

Luke   37048

Posted
  • Solution
Posted

I'm using the current build ( 3.0.5597.1) on Debian Jessie, mono 3.10.

 

I'm experiencing a lot of instability and very high CPU usage at idle.

 

Hardware is an E3 1225v3 (3.2ghz quadcore xeon) which is regularly seeing 1 or 2 cores pegged at 100% even with nothing playing back.

 

Playback is failing pretty much randomly through the web client (although seems to be more successful by DLNA, haven't tried the android app yet).

 

With debugging on its pretty hard to post logs - my last one is about 50mb of this kind of thing:

2015-05-03 00:25:23.3301 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3301 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3301 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3301 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3380 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv
2015-05-03 00:25:23.3381 Debug - LibraryMonitor: Changed detected of type Changed to /media/barracuda/tvshows/Suits/Season 4/Suits - S04E16 - Not Just a Pretty Face HDTV-720p.mkv

Presumably something is going on to get it stuck in a loop - perhaps to do with metadata as playback crashes appear to happen as a new file is added (by sonarr if that makes a difference). I've turned debug transcode logs on and will try and reproduce the failure tomorrow, at the moment the transcode log just ends mid line and requires a restart of the daemon to work. It also leaves around a couple of orphan ffmpeg threads which need to be manually cleaned up (and also have very high cpu usage).

 

Anyone have any ideas, or ideas on how to get more useful debug info? Other than these issues I'm loving the whole program, but unfortunately restarting 3/4 times in a movie isn't going to cut it with SWMBO.

 

You should consider turning off the library's realtime monitor. it can be finicky on different file systems. That will make those log messages go away. And before you ask, it's not us. We're using a framework method to listen for file system changes and it appears to be firing too often for yours.

  • Like 1
Link to comment
Share on other sites
keithjeb

keithjeb   0

Posted
  • Author
Posted

You should consider turning off the library's realtime monitor. it can be finicky on different file systems. That will make those log messages go away. And before you ask, it's not us. We're using a framework method to listen for file system changes and it appears to be firing too often for yours.

Thanks, I'll give it a crack. I had it set as it doesn't seem obvious how frequently the library is updated otherwise (if its every hour or so thats cool).

 

I'm using ext4 for my data disks, just through habit, is it tested working on say XFS or BTRFS? Or is it a random confluence of hardware that messes it up?

Link to comment
Share on other sites
blublub

blublub   10

Posted
Posted (edited)

Hi

 

I have the same issue. Emby sometimes just sits at 100% load on one CPU core for no apparent reason. When restarted mostly all is peachy until the next reboot/restart where the gambling begins again - it is like 3 in 10 (re-)starts.

 

I have turned on debug log now and will report back when it ahppens again in the next days.

 

Setup:

 

CPU Xeon 1226v3 with 16GB ECC ram.

Debian Jessi with/on OMV 1.18 - tweaked to run Emby. Therefore not on Mono Version before 3.10 (the one before)

Automatic changes detection already of from the beginning - so thats likely not the issue here

Edited by blublub
Link to comment
Share on other sites
thefirstofthe300

thefirstofthe300   291

Posted
Posted

 really see

Thanks, I'll give it a crack. I had it set as it doesn't seem obvious how frequently the library is updated otherwise (if its every hour or so thats cool).

 

I'm using ext4 for my data disks, just through habit, is it tested working on say XFS or BTRFS? Or is it a random confluence of hardware that messes it up?

 

I have my entire media library on btrfs and I have the same problem. The library monitor goes crazy.

Link to comment
Share on other sites
Luke Emby Team

Luke   37048

Posted
Posted

I think I am going to have it off by default for non-windows installations

  • Like 1
Link to comment
Share on other sites
blublub

blublub   10

Posted
Posted

I don't think automatic media scanning is the issue here.

 

There is a windows thread with high CPU usage in idle as well - could the issues be related

Link to comment
Share on other sites
  • 2 weeks later...
joplass

joplass   0

Posted
Posted

Sorry guys but I was sent to post my troubles with high CPU on this thread.  How or where do one retrieve the sort of debug file posted above? 

 

Thanks

Link to comment
Share on other sites
hurricanehrndz

hurricanehrndz   149

Posted
Posted

Append the following line to your url :8096/mediabrowser/dashboard/log.html 

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...