solabc16 379 Posted November 23, 2018 Share Posted November 23, 2018 Hello @@erikblues Two things, whilst your system is in this state... 1) Send me a screenshot from the Resource Monitor on your system, as per below. 2) Run the Send Logs utility and reply with the reference you'll get when it completes. https://github.com/MediaBrowser/Wiki/wiki/Synology-:-How-to-Send-us-Support-Logs Best - James Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 23, 2018 Share Posted November 23, 2018 That's an area that will perform much better with the next release of the server. Thanks. 1 Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 23, 2018 Author Share Posted November 23, 2018 1) Send me a screenshot from the Resource Monitor on your system, as per below. I don't have that option. My resource monitor doesn't show any "emby" process, just several processes named "mono-sgen" which seem to take up most of the memory. sendlogs_Weitenau_synology_evansport_415play_20181123T175235UTC.tgz Link to comment Share on other sites More sharing options...
solabc16 379 Posted November 23, 2018 Share Posted November 23, 2018 (edited) ...you need to be on the 'Services' tab. Best - James Edited November 23, 2018 by solabc16 Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 23, 2018 Author Share Posted November 23, 2018 (edited) ...you need to be on the 'Services' tab. Best - James I don't have those tabs somehow :/ Edited November 23, 2018 by erikblues Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 23, 2018 Author Share Posted November 23, 2018 (edited) Maybe useful: Edited November 23, 2018 by erikblues Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 Is the box checked to enable full speed sync transcoding? It is working WAY WAY better now. What I did: - removed all failed conversions from the “cloud & sync” task list - disabled this checkbox “enabled full speed sync transcoding” Now my CPU usage is at 95-98% and it is converting at least 100 times faster. Got 0.2% in 10 minutes, which yesterday took 12 hours. Maybe this info is useful somehow? I am not sure why it is working faster now. Sent from my iPhone using Tapatalk Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 (edited) Edited November 24, 2018 by erikblues Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 24, 2018 Share Posted November 24, 2018 So the box is checked now? Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 So the box is checked now? No. Once I disabled it and restarted the tasks, the server went up to 95+% and is working WAY faster. Server is also more responsive. Web app, streaming, everything is loading faster even when conversion is turned off. One of the 2 was causing it: - the checker box (unlikely) - the huge list of failed conversions kept in the “sync” list. The more items I deleted from the list, the faster the next one was deleted. First items took me 15-30 seconds, at the end it was much faster. That is why I think this was causing it (total guess) Sent from my iPhone using Tapatalk Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 24, 2018 Share Posted November 24, 2018 Yes it is probably the sync jobs that were constantly running. Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 Yes it is probably the sync jobs that were constantly running. It is weird though since the jobs were all “failed” or “stopped”. Conversion is still going: 22.9% complete in the time it went to 0.4% before. Also, the server is responding smoothly and without any issues. Thanks guys! Let me know if there is anything I can do to help you find out more about this bug? Link to comment Share on other sites More sharing options...
solabc16 379 Posted November 24, 2018 Share Posted November 24, 2018 Hello @@erikblues Thanks for the screenshots and preempting my next question. Whilst the Task Manager tab itself is model specific (https://www.synology.com/en-global/knowledgebase/DSM/help/DSM/ResourceMonitor/rsrcmonitor_task_manager) I wasn't aware of there being variations with the Processes/Servcices tabs - as they say, you learn something new everyday! I'm glad your system is starting to behave properly again now, and from what you've described there's clearly something going on under the hood causing this. If you can run the send logs utility again, I can take a look to see what's happening now vs. earlier. Best - James Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 If you can run the send logs utility again, I can take a look to see what's happening now vs. earlier. sendlogs_Weitenau_synology_evansport_415play_20181124T130527UTC.tgz There you go Thank you for your time and effort, I'm just glad I can contribute somehow, so let me know if you need anything else! Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 (edited) Update: I re-enabled the setting "enable full speed conversion" but after a while the same problems came back: The CPU usage will go down to under 10%, while the server gets extremely unresponsive. The CPU usage, even though displayed at "no use", is +80% taken over by I/O processes and it gets worse over time. I now disabled "full speed compression" again, and I'm testing the server once more. Long story short: it seems it was not the huge "sync task list" problem, but rather the "enable full speed conversion" setting which seems to be incompatible with my synology device. When I turn OFF "full speed compression", the CPU usage goes up to +97% during conversion (working pretty well). I am confirming that it runs smoothly using this setting. If all goes well, I will force the problem to happen again later, and send you a new server report while the problem is taking over the CPU. PS: sorry for all of the updates, I'm sharing as much info as I can. Edited November 24, 2018 by erikblues Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 (edited) Even with the "full speed compression" turned off, the same problem happens after some time. It starts out fine, but after a while the process goes down. Disk usage is staying at a steady 100%, so it feels like the system slows down because the disk is being used to much. It even takes long to login over SSH, and it took forever to run diagnostics (compared to other times). Also: "sudo ./sendlogs" failed first time I ran it: Is this normal? I had to try a bit untill it worked. The system is totally overloaded somehow. I hope the Diagnostics file has some hints this time: sendlogs_Weitenau_synology_evansport_415play_20181124T200441UTC.tgz CPU usage at the start of conversion: CPU usage after some time of conversion: Disk usage over time: @@solabc16 @@Luke thats all the data I could gather. I'm out of ideas :/ embyserver.txt Edited November 24, 2018 by erikblues Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 24, 2018 Share Posted November 24, 2018 Try deleting all of your cloud sync jobs and see how that compares. thanks. Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 Try deleting all of your cloud sync jobs and see how that compares. thanks. I already deleted all of them yesterday, which solved the problem for a while. Now there is only one sync job in the list, the one that is currently happening: Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 24, 2018 Share Posted November 24, 2018 Try deleting that one. Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 24, 2018 Share Posted November 24, 2018 And then not creating new ones. The thing to realize is that these conversion tasks are going to run in the background and they are going to consume significant CPU when they are converting. Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 The only other setting I changed from yesterday to today was this: Download & Sync -> Settings I changed the "Transcoding Thread Count" from "Max" to "Auto". To test this out, I changed the setting out, deleted the sync tasks, restarted the server and Changed the settings back, restarted the server and the NAS, restarted the conversion task. Result: Starts out fine. CPU usage is high, conversion speed is good. But ram is growing more and more. I think once the RAM get's maxed out the I/O Wait problems will come back. Processes: But then, after some time, the same thing happens again: Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 24, 2018 Share Posted November 24, 2018 What is converting? There shouldn't be anything if there are no sync jobs. Or is this transcoding for playback? Link to comment Share on other sites More sharing options...
erikblues 4 Posted November 24, 2018 Author Share Posted November 24, 2018 What is converting? There shouldn't be anything if there are no sync jobs. Or is this transcoding for playback? I went into my emby server (not dashboard, normal user view), right clicked on the library folder and selected “convert”. The task appears in the dashboard, but it is also displayed in the “sync jobs”. Maybe because I enabled “replace original files”? Sent from my iPhone using Tapatalk Link to comment Share on other sites More sharing options...
Solution erikblues 4 Posted November 25, 2018 Author Solution Share Posted November 25, 2018 Ok, I finally found a solution. What is (probably) causing the problem: The problem seems to be related to not enough RAM: The new update needs more RAM to run and when I start a conversion job the system starts to use the HDD Volum as backup RAM, which causes I/O Wait on the processor, which can't continue new tasks before information is saved on the (slow) HDD since the (fast) RAM is full. (this is all a guess, but it seems to be acting this way). How I solved it (for now): Emby Server Settings -> Download & Sync -> Settings Changed "Transcoding Thread Count" to: 1 This makes the transcoding work slower, but also uses less RAM. Without the RAM overflow issue, transcoding now works faster using one core than before trying to use 2. This is not a full solution, but makes the server usable until this issue has been fixed. I will post here if I discover something new. Link to comment Share on other sites More sharing options...
Luke 37994 Posted November 25, 2018 Share Posted November 25, 2018 What issue do you think needs fixing? We are simply asking ffmpeg to perform a conversion. It is very possible that for your system, the single thread count is the appropriate value. Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now