Jump to content


Photo

Will a new CPU fix my issue or is this a fault, opinions welcome, logs, pics attached

cpu playback ffmpeg hardware

Best Answer CBers , 05 May 2015 - 03:35 AM

The ffmpeg process will use all available CPU usage to transcode as quick as possible, unless you have throttling enabled.

My Emby Server PC is a Quad-Core Q6600 2.4Ghz with 8Gb ram and I don't have any issues transcoding to my Now TV and Roku boxes. Slight issues with 1080p videos transcoding to Nexus Player and Amazon Fire TV. Go to the full post


  • Please log in to reply
42 replies to this topic

#21 lulzyatlas OFFLINE  

lulzyatlas

    Advanced Member

  • Members
  • 50 posts
  • Local time: 08:08 PM

Posted 05 May 2015 - 11:41 PM

@lulzyatlas

 

Thanks,

 

I know bandwidth could be the issue but i some time have 3 to 4 streams going(outside network) plus me locally and got no one complaining. Now sometimes within the 3 to 4 streams 1 or 2 are getting direct stream while others are transcoding. I use Drivepool and Scanner from StableBit and i checked the the drive usage and there is very little to none.(right now i have one person streaming and the drive usage is none). All i really notice when people say someting is up, is the ffpmeg (multiple) running the CPU to 100%.. As for my upload, i have a 10Mbit pipe but i dont see it getting maxed out cuz people usually keep there stream to 1/1.5Mbps

If you aren't taxing your current drive, the switch to SSD will likely do nothing for you. Based on how populated your area is, your upstream may take a hit at peak hours and not be the advertised speed, but all immediate signs point to the CPU not being able to keep up. Transcoding 3+ HD files at once is a task even for newer processors and one thing ffmpeg isn't considerate of is multiple instances of itself, they don't take each other into account when throttling.

 

Another thing to consider could be the conditions of your clients networks, router, activity, wireless vs wired, etc. 1Mbps is a small chunk, but a router being buffeted with requests from multiple devices can tune down overall throughput from it's max to lower rates for connection reliability, and QoS settings on their end could resolve this if the issue isn't your CPU.

 

Before going out and getting a new processor or mobo, I'd see how playing back these files using transcoding and similar settings performs inside your local network, just to narrow the possibilities down before making a purchase.



#22 lulzyatlas OFFLINE  

lulzyatlas

    Advanced Member

  • Members
  • 50 posts
  • Local time: 08:08 PM

Posted 05 May 2015 - 11:47 PM

The Server is acutally pretty affordable and avalible on Ebay. Look up a seller called mrrackables. The SGI half depth server plus 1 expander is about 300$ It's really awesome. The CPU upgade was only 12$.Sure the server is a couple of years old, but she's reliable and fast. ESPECIALLY with the SSD Upgrade I did to it WOW.

 

Forgot to metnion, I am using Drive Bender to manage the hard drives. It is like the WHS Pool feature in Windows Home Server, but made for any other Windows Platform. I've dealt with RAID enough times in my life and the headaches that go with it, I felt that software solution was perfect for me.

 

Maybe we should start a forum where we showcase pictures of our network setups and show pics of our racks / server setups! Just a geeky idea.

 

Great information! I'll keep this in mind when I go upgrade hunting. A showcase thread in the General area is a great idea, I saw one user over there running streams to 20 devices at once. A community moshpit of all the different uses and backends behind our Emby setups would be rather entertaining if you ask me.



#23 nagetech OFFLINE  

nagetech

    Advanced Member

  • Members
  • 311 posts
  • Local time: 07:08 PM

Posted 05 May 2015 - 11:49 PM

Great information! I'll keep this in mind when I go upgrade hunting. A showcase thread in the General area is a great idea, I saw one user over there running streams to 20 devices at once. A community moshpit of all the different uses and backends behind our Emby setups would be rather entertaining if you ask me.

 

Wow! What user was that? I'd love to chat with him to get an idea of his setup! Never hurts to compare notes!



#24 saitoh183 OFFLINE  

saitoh183

    Advanced Member

  • Members
  • 1000 posts
  • Local time: 07:08 PM
  • LocationCanada, St-Eustache, QC

Posted 05 May 2015 - 11:56 PM

If you aren't taxing your current drive, the switch to SSD will likely do nothing for you. Based on how populated your area is, your upstream may take a hit at peak hours and not be the advertised speed, but all immediate signs point to the CPU not being able to keep up. Transcoding 3+ HD files at once is a task even for newer processors and one thing ffmpeg isn't considerate of is multiple instances of itself, they don't take each other into account when throttling.

 

Another thing to consider could be the conditions of your clients networks, router, activity, wireless vs wired, etc. 1Mbps is a small chunk, but a router being buffeted with requests from multiple devices can tune down overall throughput from it's max to lower rates for connection reliability, and QoS settings on their end could resolve this if the issue isn't your CPU.

 

Before going out and getting a new processor or mobo, I'd see how playing back these files using transcoding and similar settings performs inside your local network, just to narrow the possibilities down before making a purchase.

 

@lulzyatlas

Well within my network everything is direct play for the most part  and i have never had problems with playback of any media But when my wife complains about lag, i check the server and transcoding is going on and CPU is at 99% so im very much leaning to cpu. Plus the server is not only for Emby, there are lots of other applications running, they are low cpu compared to Emby but they still count...on idle my cpu is between 5% and 10%. Since ffpmeg eats all the cpu and is not self aware, i dont think the cpu and mobo upgrade would help much but i was thinking that if the transcode finish faster because of the SSD this would help the cpu. Also i am exploring the option of allowing certain users to sync to the cloud the series they are watching the most to elevate some of the load on the server.


Edited by saitoh183, 05 May 2015 - 11:56 PM.


#25 nagetech OFFLINE  

nagetech

    Advanced Member

  • Members
  • 311 posts
  • Local time: 07:08 PM

Posted 05 May 2015 - 11:59 PM

I'm curious, and this is just coming from someone who is NOT a coder/program writer nor do I fully understand ffmpeg inside and out, but is ffmpeg the only option for transcoding? Are there alternavites perhaps we should explore/test that may be more friendly and not such a CPU hog? or is there a way for FFMPEG to play nice with itself (aka multiple transcodes)

 

Just throwing ideas out there, if they sound dumb be easy on me!

 

If there is anything I can do to help Emby develop I'm all ears!! as Emby gets better, well lets face it, we all benefit!



#26 JeremyFr79 OFFLINE  

JeremyFr79

    Advanced Member

  • Members
  • 925 posts
  • Local time: 05:08 PM
  • LocationSeattle, WA

Posted 06 May 2015 - 12:16 AM

So I want to clarify something here, I've seen a few people state they are transcoding at 30+Mbps.   This in reality is a HUGE waste of resources since most of the file's you're transcoding in the first place are going to be anywhere from 8Mbps to 15Mbps, you don't gain anything by transcoding them to a higher bitrate.  What you do though is waste bandwidth, cpu, and memory doing so.  FFMpeg is highly efficient and in most cases even with 1080P content you would not see any degradation over source running in the 6Mbps range for transcoding.  Now if you were say running straight BR ISO' then yeah run it up higher to get as close to original source quality.  But if you're just using run of the mill MKV's don't waste the bandwidth/resources, just my 2 cents.  



#27 FrostByte ONLINE  

FrostByte

    Advanced Member

  • ForumMod
  • 4896 posts
  • Local time: 08:08 PM
  • LocationThe UP

Posted 06 May 2015 - 12:42 AM

So I want to clarify something here, I've seen a few people state they are transcoding at 30+Mbps.  

Maybe I'm misunderstanding that setting on the server, but I thought that was a threshold based on what your network can handle so any file with an overall bitrate > 30Mbps was transcoded to a lower bitrate and anything below 30Mbps wasn't transcoded and thus streamed.  I don't think the server is actually transcoding anything below 30Mbps going up to 30Mbps


Edited by FrostByte, 06 May 2015 - 12:50 AM.


#28 bassistgak OFFLINE  

bassistgak

    Advanced Member

  • Members
  • 33 posts
  • Local time: 11:08 AM
  • LocationMelbourne

Posted 06 May 2015 - 12:53 AM

Thanks for the input Jeremy.
I can definitely agree that 30mbps is extreme. But for myself i like to push things to the limit for testing as a way of future proofing, (last thing i want is to have the better half complaing when that BR iso is not working.
Just a thought:
It would be great if perhaps different mbps profiles could be set on the server, for different file types on each device. Obviously still have the option to change that on the client, but a default mbps starting point would be awesome.

#29 JeremyFr79 OFFLINE  

JeremyFr79

    Advanced Member

  • Members
  • 925 posts
  • Local time: 05:08 PM
  • LocationSeattle, WA

Posted 06 May 2015 - 01:10 AM

Maybe I'm misunderstanding that setting on the server, but I thought that was a threshold based on what your network can handle so any file with an overall bitrate > 30Mbps was transcoded to a lower bitrate and anything below 30Mbps wasn't transcoded and thus streamed.  I don't think the server is actually transcoding anything below 30Mbps going up to 30Mbps

I think we may be talking about 2 different things, I'm talking about client side transcoding settings i.e. you're watching a video in the browser click the gear and select a resolution/bitrate setting.  I think you're talking about the max bitrate setting in the server for streaming, which if you are yes you are correct that tells the server the maximum bitrate you can support externally and forces it to transcode anything above that to keep it under that threshold.



#30 nagetech OFFLINE  

nagetech

    Advanced Member

  • Members
  • 311 posts
  • Local time: 07:08 PM

Posted 06 May 2015 - 01:12 AM

I think we may be talking about 2 different things, I'm talking about client side transcoding settings i.e. you're watching a video in the browser click the gear and select a resolution/bitrate setting.  I think you're talking about the max bitrate setting in the server for streaming, which if you are yes you are correct that tells the server the maximum bitrate you can support externally and forces it to transcode anything above that to keep it under that threshold.

That just confused me, unless me being up late has messed with my memory, where in the server do you set max transcode ?



#31 JeremyFr79 OFFLINE  

JeremyFr79

    Advanced Member

  • Members
  • 925 posts
  • Local time: 05:08 PM
  • LocationSeattle, WA

Posted 06 May 2015 - 01:14 AM

Thanks for the input Jeremy.
I can definitely agree that 30mbps is extreme. But for myself i like to push things to the limit for testing as a way of future proofing, (last thing i want is to have the better half complaing when that BR iso is not working.
Just a thought:
It would be great if perhaps different mbps profiles could be set on the server, for different file types on each device. Obviously still have the option to change that on the client, but a default mbps starting point would be awesome.

I can understand where you're coming from with this, but if the file is under 30Mbps you can't add data to the stream, i.e. it takes more cpu to compress down to that Say from 50Mbps to 30 (the real test if you could) than to upconvert to that from say a 10Mbps source.  Another way to think of this is that when you use say winrar, it's always much more work to compress the files, than to uncompress them, same situation here.  So if you have a source that's lower than 30mbps you're not going to see what the actual load on your cpu is going to be compared to say starting with a 50Mbps source transcoding it down to 30.


Edited by JeremyFr79, 06 May 2015 - 01:16 AM.


#32 JeremyFr79 OFFLINE  

JeremyFr79

    Advanced Member

  • Members
  • 925 posts
  • Local time: 05:08 PM
  • LocationSeattle, WA

Posted 06 May 2015 - 01:15 AM

That just confused me, unless me being up late has messed with my memory, where in the server do you set max transcode ?

Server->Playback->Streaming->Remote Client Bitrate Limit



#33 JeremyFr79 OFFLINE  

JeremyFr79

    Advanced Member

  • Members
  • 925 posts
  • Local time: 05:08 PM
  • LocationSeattle, WA

Posted 06 May 2015 - 01:17 AM

And actually I mis-stated there a bit, that setting sets the absolute limit for external streaming i.e. you can use that to prevent too many streams from overloading your upstream bandwidth on your internet provider.



#34 FrostByte ONLINE  

FrostByte

    Advanced Member

  • ForumMod
  • 4896 posts
  • Local time: 08:08 PM
  • LocationThe UP

Posted 06 May 2015 - 07:01 AM

JeremyFr79 ahh, I knew I was the one up too late all along

 

Oh, and I'm telling my wife we need a new computer because of Emby no matter what  :)



#35 drashna OFFLINE  

drashna

    Advanced Member

  • Members
  • 166 posts
  • Local time: 04:08 PM

Posted 06 May 2015 - 04:55 PM

The ffmpeg process will use all available CPU usage to transcode as quick as possible, unless you have throttling enabled.

My Emby Server PC is a Quad-Core Q6600 2.4Ghz with 8Gb ram and I don't have any issues transcoding to my Now TV and Roku boxes. Slight issues with 1080p videos transcoding to Nexus Player and Amazon Fire TV.

 

Maybe, but in my case, it seems to use all available CPU for the most part, and cause the playback to be VERY inconsistent (pausing/buffering nearly constantly, to the point that it's entirely unwatchable, even on the very low resolution settings).

 

However, loaded up process lasso and took a look.

It looks like the MediaBrowser Server app, AND ffmpeg are being ran at the "below normal" CPU priority. Using ProcessLasso to FORCE this to "Normal" looks to have completely fixed the issue for me.

 

I'm not sure why it would be set to below normal, but it's clearly impacting performance of the server. 

I'm not sure what I can post to help identify the issue in my case, but I'm more than willing to grab anything from the system, or even let a dev take a hands on look at my system. 
Because installing and configuration Process Lasso is a hack. The issue needs to be fixed in the code. 

 

 

 

So anyone else still having this issue, I'd recommend try to see if Process Lasso (or similar) fixes this issue for you.

 

 

 

 

 

Also, a suggestion, could you limit the number of threads that ffmpeg uses, instead of defaulting to "0" (all). This would help prevent it from eating all available CPU power.



#36 nagetech OFFLINE  

nagetech

    Advanced Member

  • Members
  • 311 posts
  • Local time: 07:08 PM

Posted 09 May 2015 - 08:40 PM

Just throwing an update out there, I finally installed the second CPU in my system, and oh boy what a difference. Besides the overall server feeling snappier, Emby is really loving having 8 cores :) More testing to come, but the initial testing shows very promising results. Loving it! 8 cores is where its at aparently when it comes to remote transcoding and multiple users.

 

Best 12$ I ever spent


  • bassistgak likes this

#37 bassistgak OFFLINE  

bassistgak

    Advanced Member

  • Members
  • 33 posts
  • Local time: 11:08 AM
  • LocationMelbourne

Posted 12 May 2015 - 06:39 PM

thanks for the update Nagatech. Looking forward to the results of testing.

 

$12.upgrade!! awesome.



#38 nagetech OFFLINE  

nagetech

    Advanced Member

  • Members
  • 311 posts
  • Local time: 07:08 PM

Posted 12 May 2015 - 07:10 PM

thanks for the update Nagatech. Looking forward to the results of testing.

 

$12.upgrade!! awesome.

 

As far as Testing the dual xeon with 32GB of ram is working great. So Far I've gotten 4 users streaming @ the same time with no issue! I feel it's like a new server :)


  • JeremyFr79 likes this

#39 drashna OFFLINE  

drashna

    Advanced Member

  • Members
  • 166 posts
  • Local time: 04:08 PM

Posted 12 May 2015 - 11:46 PM

As far as Testing the dual xeon with 32GB of ram is working great. So Far I've gotten 4 users streaming @ the same time with no issue! I feel it's like a new server :)

Glad to hear it!

 

Also, out of curiousity, what are you using for GFX? A dedicated card? or?



#40 pir8radio OFFLINE  

pir8radio

    NGINX

  • Members
  • 3396 posts
  • Local time: 07:08 PM
  • LocationChicago

Posted 16 May 2015 - 10:23 AM

The ffmpeg process will use all available CPU usage to transcode as quick as possible, unless you have throttling enabled.

My Emby Server PC is a Quad-Core Q6600 2.4Ghz with 8Gb ram and I don't have any issues transcoding to my Now TV and Roku boxes. Slight issues with 1080p videos transcoding to Nexus Player and Amazon Fire TV.

 

@bassistgak

Just to show you what @CBers is saying  FFMPEG will use as much CPU as it can (to a certain extent) Here is an example of my server streaming Penguins of Madagascar 1080p MKV to a single web client.  This is a 2.4 Ghz Xeon 10 core 20 thread processor and its getting beat up across the board.  I 'think' the only reason FFMPEG isn't consuming 100% is because the hard drives where ffmpeg is pulling the video file from is the bottle neck, in other words ffmpeg cant pull the video any faster from the drive to convert it.

 

5557520b93ad0_CPU_USAGE.png


Edited by pir8radio, 16 May 2015 - 10:24 AM.

  • CBers, drashna and bassistgak like this





Also tagged with one or more of these keywords: cpu, playback, ffmpeg, hardware

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users