Jump to content

Newest update refuses to connect


erikblues
Go to solution Solved by erikblues,

Recommended Posts

solabc16

Hello @@erikblues

 

Two things, whilst your system is in this state...

 

1) Send me a screenshot from the Resource Monitor on your system, as per below.

 

5bf83a9f0cfb4_emby_resource_monitor.jpg

 

2) Run the Send Logs utility and reply with the reference you'll get when it completes.

 

https://github.com/MediaBrowser/Wiki/wiki/Synology-:-How-to-Send-us-Support-Logs

 

Best

- James

Link to comment
Share on other sites

erikblues

1) Send me a screenshot from the Resource Monitor on your system, as per below.

 

I don't have that option. My resource monitor doesn't show any "emby" process, just several processes named "mono-sgen" which seem to take up most of the memory.

 

5bf83efacf075_ScreenShot20181123at184622

 

sendlogs_Weitenau_synology_evansport_415play_20181123T175235UTC.tgz

 

Link to comment
Share on other sites

erikblues

...you need to be on the 'Services' tab.

 

Best

- James

 

I don't have those tabs somehow :/

 

5bf857768a2f3_ScreenShot20181123at203831

Edited by erikblues
Link to comment
Share on other sites

erikblues

Is the box checked to enable full speed sync transcoding?

It is working WAY WAY better now. What I did:

- removed all failed conversions from the “cloud & sync” task list

- disabled this checkbox “enabled full speed sync transcoding”

 

Now my CPU usage is at 95-98% and it is converting at least 100 times faster. Got 0.2% in 10 minutes, which yesterday took 12 hours.

 

Maybe this info is useful somehow? I am not sure why it is working faster now.

 

 

Sent from my iPhone using Tapatalk

Link to comment
Share on other sites

erikblues

So the box is checked now?

No. Once I disabled it and restarted the tasks, the server went up to 95+% and is working WAY faster.

 

Server is also more responsive. Web app, streaming, everything is loading faster even when conversion is turned off.

 

One of the 2 was causing it:

- the checker box (unlikely)

- the huge list of failed conversions kept in the “sync” list. The more items I deleted from the list, the faster the next one was deleted. First items took me 15-30 seconds, at the end it was much faster. That is why I think this was causing it (total guess)

 

 

Sent from my iPhone using Tapatalk

Link to comment
Share on other sites

erikblues

Yes it is probably the sync jobs that were constantly running.

It is weird though since the jobs were all “failed” or “stopped”.

 

Conversion is still going: 22.9% complete in the time it went to 0.4% before. Also, the server is responding smoothly and without any issues.

 

Thanks guys! Let me know if there is anything I can do to help you find out more about this bug?

Link to comment
Share on other sites

solabc16

Hello @@erikblues

 

Thanks for the screenshots and preempting my next question. Whilst the Task Manager tab itself is model specific (https://www.synology.com/en-global/knowledgebase/DSM/help/DSM/ResourceMonitor/rsrcmonitor_task_manager) I wasn't aware of there being variations with the Processes/Servcices tabs - as they say, you learn something new everyday!

 

I'm glad your system is starting to behave properly again now, and from what you've described there's clearly something going on under the hood causing this.

 

If you can run the send logs utility again, I can take a look to see what's happening now vs. earlier.

 

Best

- James

Link to comment
Share on other sites

erikblues

If you can run the send logs utility again, I can take a look to see what's happening now vs. earlier.

 

sendlogs_Weitenau_synology_evansport_415play_20181124T130527UTC.tgz

 

There you go :) Thank you for your time and effort, I'm just glad I can contribute somehow, so let me know if you need anything else!

Link to comment
Share on other sites

erikblues

Update:

 

I re-enabled the setting "enable full speed conversion" but after a while the same problems came back:

The CPU usage will go down to under 10%, while the server gets extremely unresponsive. The CPU usage, even though displayed at "no use", is +80% taken over by I/O processes and it gets worse over time.

 

I now disabled "full speed compression" again, and I'm testing the server once more.

 

Long story short: it seems it was not the huge "sync task list" problem, but rather the "enable full speed conversion" setting which seems to be incompatible with my synology device.

 

When I turn OFF "full speed compression", the CPU usage goes up to +97% during conversion (working pretty well).

 

I am confirming that it runs smoothly using this setting. If all goes well, I will force the problem to happen again later, and send you a new server report while the problem is taking over the CPU.

 

PS: sorry for all of the updates, I'm sharing as much info as I can.

Edited by erikblues
Link to comment
Share on other sites

erikblues

Even with the "full speed compression" turned off, the same problem happens after some time.

It starts out fine, but after a while the process goes down.

Disk usage is staying at a steady 100%, so it feels like the system slows down because the disk is being used to much.

It even takes long to login over SSH, and it took forever to run diagnostics (compared to other times).

Also: "sudo ./sendlogs" failed first time I ran it:

 

5bf9af163db48_ScreenShot20181124at210522

 

Is this normal? I had to try a bit untill it worked. The system is totally overloaded somehow. I hope the Diagnostics file has some hints this time:

sendlogs_Weitenau_synology_evansport_415play_20181124T200441UTC.tgz   

 

 

CPU usage at the start of conversion:

5bf9ac225028e_ScreenShot20181124at205227

 

CPU usage after some time of conversion:

5bf9ac3191aa0_ScreenShot20181124at205216

 

 

Disk usage over time:

 

 

5bf9aec79d6d3_ScreenShot20181124at210251

 

@@solabc16 @@Luke thats all the data I could gather. I'm out of ideas :/

embyserver.txt

Edited by erikblues
Link to comment
Share on other sites

erikblues

Try deleting all of your cloud sync jobs and see how that compares. thanks.

 

I already deleted all of them yesterday, which solved the problem for a while.

Now there is only one sync job in the list, the one that is currently happening:

5bf9b140ad23e_ScreenShot20181124at211443

Link to comment
Share on other sites

And then not creating new ones. The thing to realize is that these conversion tasks are going to run in the background and they are going to consume significant CPU when they are converting.

Link to comment
Share on other sites

erikblues

The only other setting I changed from yesterday to today was this:

 

Download & Sync -> Settings

I changed the "Transcoding Thread Count" from "Max" to "Auto".

 

To test this out, I changed the setting out, deleted the sync tasks, restarted the server and 

Changed the settings back, restarted the server and the NAS, restarted the conversion task.

 

Result:

 

Starts out fine. CPU usage is high, conversion speed is good. But ram is growing more and more. I think once the RAM get's maxed out the I/O Wait problems will come back.

 

5bf9b52f4eee5_ScreenShot20181124at213015

 

Processes:

 

5bf9b56327f40_ScreenShot20181124at213215

 

5bf9b67a0ea6f_ScreenShot20181124at213655

 

But then, after some time, the same thing happens again:

 

5bf9b8bb33433_ScreenShot20181124at214631

Link to comment
Share on other sites

What is converting? There shouldn't be anything if there are no sync jobs. Or is this transcoding for playback?

Link to comment
Share on other sites

erikblues

What is converting? There shouldn't be anything if there are no sync jobs. Or is this transcoding for playback?

I went into my emby server (not dashboard, normal user view), right clicked on the library folder and selected “convert”.

 

The task appears in the dashboard, but it is also displayed in the “sync jobs”.

 

Maybe because I enabled “replace original files”?

 

 

 

Sent from my iPhone using Tapatalk

Link to comment
Share on other sites

  • Solution
erikblues

Ok, I finally found a solution.

 

What is (probably) causing the problem:

The problem seems to be related to not enough RAM: The new update needs more RAM to run and when I start a conversion job the system starts to use the HDD Volum as backup RAM, which causes I/O Wait on the processor, which can't continue new tasks before information is saved on the (slow) HDD since the (fast) RAM is full. (this is all a guess, but it seems to be acting this way).

 

How I solved it (for now):

Emby Server Settings -> Download & Sync -> Settings

Changed "Transcoding Thread Count" to: 1

 

This makes the transcoding work slower, but also uses less RAM. Without the RAM overflow issue, transcoding now works faster using one core than before trying to use 2.

 

This is not a full solution, but makes the server usable until this issue has been fixed.

 

I will post here if I discover something new.

Link to comment
Share on other sites

What issue do you think needs fixing? We are simply asking ffmpeg to perform a conversion. It is very possible that for your system, the single thread count is the appropriate value.

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...