pir8radio 1292 Posted February 1, 2019 Author Share Posted February 1, 2019 If you have that speed why even transcode. just direct stream everything lol I still get people transcoding for one reason or another. Link to comment Share on other sites More sharing options...
Fratopolis 62 Posted February 2, 2019 Share Posted February 2, 2019 (edited) testing right now. 7:21am CST: 35 is too many lol 7:26am CST: Somewhere around 28-33 seems to be it for 1080p decode to 720p encode at 24fps Edited February 2, 2019 by Fratopolis Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 testing right now. 7:21am CST: 35 is too many lol 7:26am CST: Somewhere around 28-33 seems to be it for 1080p decode to 720p encode at 24fps Not sure where my bottleneck is at the moment then.... GPU still has some room to go, I would think if ffmpeg couldnt keep up using GPU it would start using the CPU? Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 (edited) @luke is there any way for me to get from the server an xml output or something that gives me current stream counts? like how many concurrent streams are running? I would like to log this for my test. OOPS disregard that request, i can count the number of ffmpeg instances running! Edited February 2, 2019 by pir8radio Link to comment Share on other sites More sharing options...
Fratopolis 62 Posted February 2, 2019 Share Posted February 2, 2019 (edited) Wanna set a time up and pm each other or Google chat or hangouts voice so you know when I'm testing you can watch/discuss? Wish there was a longer royally free 1080 movie we could test with Edited February 2, 2019 by Fratopolis Link to comment Share on other sites More sharing options...
Senna 368 Posted February 2, 2019 Share Posted February 2, 2019 How many streams do you want each of us to open ? Have only a 400Mbit pipe to abuse Link to comment Share on other sites More sharing options...
Fratopolis 62 Posted February 2, 2019 Share Posted February 2, 2019 Not sure where my bottleneck is at the moment then.... GPU still has some room to go, I would think if ffmpeg couldnt keep up using GPU it would start using the CPU? I believe it only switches to CPU processing if it can't start a hardware accelerated encode. Which would be the case for regular Nvidia consumer cards stopping at 2. Otherwise since you have unlimited allowed it just won't encoding fast enough once it hits a certain number and depending on the source and that Target resolutions and format. Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 (edited) How many streams do you want each of us to open ? Have only a 400Mbit pipe to abuse LOL I think i'm going to disable the 4mb/stream limit and just let the server manage transcode, direct, and see how the server and drives react to "normal" ha, usage... it seems some initial testing points to about 30 ish concurrent transcodes on one GPU. So ill open the server to do direct too.. see if we can hit a hard drive, or internet bottleneck.. Edited February 2, 2019 by pir8radio Link to comment Share on other sites More sharing options...
Fratopolis 62 Posted February 2, 2019 Share Posted February 2, 2019 (edited) It's a shame I don't have any of these cards to test with. I have 2 unused Dell R720xd servers I could test with. 1 with 12 Samsung consumer 250GB SSDs, and another with 12 3TB Enterprise SAS drives. And 1 unused Dell R320xd with 4 1TB Intel Enterprise SSDs, all with 128GB of RAM. Edited February 2, 2019 by Fratopolis Link to comment Share on other sites More sharing options...
Fratopolis 62 Posted February 2, 2019 Share Posted February 2, 2019 (edited) LOL I think i'm going to disable the 4mb/stream limit and just let the server manage transcode, direct, and see how the server and drives react to "normal" ha, usage... it seems some initial testing points to about 30 ish concurrent transcodes on one GPU. So ill open the server to do direct too.. see if we can hit a hard drive, or internet bottleneck.. It won't be a hard drive limit as the file will most likely be cached in memory since we are only testing with a single file. Also your gpu encoding will handle less since I believe once you allow 5mbps and up it will encode in 1080p instead of 720p causing higher gpu processing. Which is why I now set mine at 4Mbps Max WAN facing Edited February 2, 2019 by Fratopolis Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 It won't be a hard drive limit as the file will most likely be cached in memory since we are only testing with a single file. Also your gpu encoding will handle less since I believe once you allow 5mbps and up it will encode in 1080p instead of 720p causing higher gpu processing. Which is why I now set mine at 4Mbps Max WAN facing I can confirm, different bitrates do not get cached. it starts a completely new ffmpeg log and encode. Link to comment Share on other sites More sharing options...
Fratopolis 62 Posted February 2, 2019 Share Posted February 2, 2019 Ahhhhhhhhhhh I thought you meant reading from the source file. Your speaking of the temp created files during transcode Link to comment Share on other sites More sharing options...
Senna 368 Posted February 2, 2019 Share Posted February 2, 2019 Maybe interesting to have some more choice in files to test, like Tears of Steel in 4K, which is also an Open Movie project ? https://mango.blender.org/download/ Link to comment Share on other sites More sharing options...
Carlo 4330 Posted February 2, 2019 Share Posted February 2, 2019 OOPS disregard that request, i can count the number of ffmpeg instances running! That only tells you the amount of ffmpeg instances running, not if they are keeping up or if there are problems on the client side. It won't be a hard drive limit as the file will most likely be cached in memory since we are only testing with a single file. Also your gpu encoding will handle less since I believe once you allow 5mbps and up it will encode in 1080p instead of 720p causing higher gpu processing. Everyone using the same file isn't a true test. To really test this well you want everyone playing different media which will SUBSTANTIALLY change the IO performance and you'll get less useful streams. Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 (edited) That only tells you the amount of ffmpeg instances running, not if they are keeping up or if there are problems on the client side. Everyone using the same file isn't a true test. To really test this well you want everyone playing different media which will SUBSTANTIALLY change the IO performance and you'll get less useful streams. Yes the logs im going to analyze later will tell me if clients fps drops below the video fps. I just want to know a peak attempt to transcode or direct stream. but true i get your point. FFMPEG still pulls or reads multiple instances of that file from different points across the file... so the throughput of the drive will be similar... Its a RAID so the files are spread out across multiple drives anyway, i'm not relying on a single disk io. By my drive benchmarks I don't think that will be a bottleneck im guessing... I don't think my wan connection will be either... I pretty much have a good grasp on what the GPU can handle, and i can graph that out for different file sizes (720, 1080, 4k non hevc), i plan to do a better hevc test later. so the point now is just to see what the server will do when the zombie apocalypse hits. See if i can identify any bottlenecks I didnt think of. My server is pretty separated, I have two CPU's, two separate banks of memory, two NICS that each are tied to one cpu, sata/sas interfaces broken out between the two cpus as well.. my memory is kind of slow 800mhz. this is all for fun though... It's my hobby, you know, just like these guys that build that muscle car in their garage, how often do they actually take it out and push it to its limits? Edited February 2, 2019 by pir8radio Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 (edited) Let's break this thing...... Edited February 2, 2019 by pir8radio Link to comment Share on other sites More sharing options...
maegibbons 1267 Posted February 2, 2019 Share Posted February 2, 2019 Looks like its Broke Krs Mark Link to comment Share on other sites More sharing options...
Carlo 4330 Posted February 2, 2019 Share Posted February 2, 2019 What was the verdict? Link to comment Share on other sites More sharing options...
Fratopolis 62 Posted February 2, 2019 Share Posted February 2, 2019 (edited) How did you change the title to NAM during login Edited February 2, 2019 by Fratopolis Link to comment Share on other sites More sharing options...
samuelqwe 313 Posted February 2, 2019 Share Posted February 2, 2019 How did you change the title to NAM during login That’s just the server name, the one you set on the dashboard Link to comment Share on other sites More sharing options...
Carlo 4330 Posted February 2, 2019 Share Posted February 2, 2019 How did you change the title to NAM during login If I understand your question correctly Click the 3 dots in the picture below on your main dashboard page to get to the change server name menu. Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 I think you mean my logo change?.... I rewrite it in nginx to my own logo. Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 (edited) What was the verdict? I still didn't get enough streams to hose anything up. So i'll dig through my logs and post how it went with what I have.. I guess I can make some assumptions lol.. Edited February 2, 2019 by pir8radio Link to comment Share on other sites More sharing options...
Carlo 4330 Posted February 2, 2019 Share Posted February 2, 2019 I must confess, I got my times mixed up and attempted to login one hour to late. I could have added a dozen or so streams from various devices. After crunching numbers if you decide to do it again, I'll be ready and make sure to get my times zone conversions correct. LOL Link to comment Share on other sites More sharing options...
pir8radio 1292 Posted February 2, 2019 Author Share Posted February 2, 2019 I must confess, I got my times mixed up and attempted to login one hour to late. I could have added a dozen or so streams from various devices. After crunching numbers if you decide to do it again, I'll be ready and make sure to get my times zone conversions correct. LOL lol, i included a time zone converter in the links on post 1. oh well... Ok, ill remember that thx! Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now