Sometimes slow to load pages

[happpyg 20]

I have trialling Emby for a little while now but have noticed that it often takes a long time to load the home page and my home videos and photos pages, both can often take around a 30-90 seconds to load.  After the slow load everything seems to work very fast again, 2-4 seconds each page and it will be fine for the rest of the day.  Often during the slow load time I see a lot of disk activity on the library.db file but not always however disk queue lengths are still ok and not excessive.

 

If I restart Emby, the first load is usually ok but not always, it seems to mostly happen after Emby has been left for some time but haven't been able establish a real pattern here yet.

 

I do have a fairly large photos and videos library so not sure if that is part of the issue?

My libraries consist of
- 1200 Movies

- 5300 TV Series

- 12,000 MP3's

- 97,000 Home videos and Photos

 

I have attached a log (server-63619257600).  The slow load was between: 2017-01-06 06:15 and 2017-01-06 06:21.  Subsequent loads after that were all very fast.

 

I also see lots of DLNA errors in the log, not sure if they are related? "Error Dlna: Error updating device info for Lounge Room TV".  This is our main TV and is was turned off during this time.  I have attached a second log where this TV would have been on for most of that time (server-63619210653) which shows it also has lots of DLNA messages relating to that TV if it is related somehow?

 

Thanks!

server-63619257600.txt

server-63619210653.txt

Edited January 7, 2017 by happpyg

[happpyg 20]

*bump* anyone?

 

Thanks

[rjay 21]

I see similar sort of behaviour on first login if I haven't logged in to the Emby Web Management interface for a while. The initial page spins he wheel for 30+ ish secs when first bringing up the "latest movies", "latest documentaries" section. Leaving and returning to the same area it is quicker. Screenshot attached

 

My library is a reasonable amount larger apart from the photos section.

 

I figure the algorithm is just taking a while behind the scenes to pull out the "latest" section etc but interested to follow the thread.

 

[ebr 16184]

Have any green hard drives that may have been sleeping?

[happpyg 20]

Have any green hard drives that may have been sleeping?

 

Thanks ebr, no this is a VM hosted on a Hyper-V platform with Enterprise class disks that are always running.  I am watching disk activity and queue lengths on both the host and Emby VM and there is no real indication of any I/O related issue.  Still trying to establish a pattern but was hoping the logs might have shown something.

 

I was running Plex in parallel on the same VM pointed at the same media until recently and it responded normally while Emby was slow to load.  Tried accessing from multiple clients and all the same.  Once it has done that initial load it seems to be fine for some time after that for a day or so. 

[bfir3 117]

Hoping to see this resolved, so I'm following this thread as well.

[Luke 42078]

@@happpyg please try removing all plugins (other than notifications), and see if the issue persists with the core Emby Server. Thanks !

[happpyg 20]

Thanks @@Luke, I will do that and come back.  @@rjay, do you have similar plugins to me?

 

I am running:

- EMail notifications

- Emby.Kodi Sync Queue

- Pushover Notifications

- ServerWMC

[rjay 21]

Thanks @@Luke, I will do that and come back.  @@rjay, do you have similar plugins to me?

 

I am running:

- EMail notifications

- Emby.Kodi Sync Queue

- Pushover Notifications

- ServerWMC

Yes nearly identical, just no ServerWMC for me

 

@@ebr

I can check the QNAP NAS settings in regards to disk sleep and see if it makes any difference, I am running WD Red's hardware wise not green's though. Also I recall it being the same speed wise when I was running it as a Service on a Windows VM (same as happyg). I just figured it was due to the algorithm/coding method and library size.

[happpyg 20]

@@Luke,

 

  I have removed all plugins and it does seem a little more responsive in general but I am not sure if it is just because it is not showing Live TV info any more from ServerWMC. 

 

  I have managed to see it go slowly again once today so far (just been trying every now and then while at work).  The "My Media" section on the home page loaded almost straight away but then sat for ages spinning the wheel like rjays screenshot before finally populating the rest of the home page with Continue Watching, Next up etc after about 50 seconds.  After that several subsequent page refreshes from different clients were all fast.   During the slow load time I could see the library.db file getting a working but still queue lengths were not excessive on either the VM or the Hyper-V Host machine, all other services on both servers were still responsive so I don't think it is a local resource issue.

 

Log and screenshots attached.  The slow load happened between 2017-01-10 15:19 and 2017-01-1015:21pm.

 

I'll keep watching and try to find a pattern.

 

server-63619628092.txt

Edited January 10, 2017 by happpyg

[CBers 7450]

@@happpyg & @@rjay

 

You've both seen my Long time to load HOME page thread, so thought I'd comment on your's

 

Do you really need the "Emby.Kodi Sync Queue" plugin ??

 

I also use Kodi but I don't use the plugin and the sync times for me are around 10s on Kodi start-up.

 

I probably only add a few episodes each day, and perhaps one or two movies per week.

[happpyg 20]

@@happpyg & @@rjay

 

You've both seen my Long time to load HOME page thread, so thought I'd comment on your's

 

Do you really need the "Emby.Kodi Sync Queue" plugin ??

 

I also use Kodi but I don't use the plugin and the sync times for me are around 10s on Kodi start-up.

 

I probably only add a few episodes each day, and perhaps one or two movies per week.

 

Thanks @@CBers, since removing the plugin I have been watching sync times.  On my Raspberry Pi 3's spread around the house before with the plugin it is about 2-3 seconds to sync, now it is around 30-60 seconds and I can still use Kodi while it syncs so yes, I may not need to bother unless I find another reason to put it back on?  Haven't really taken notice of sync times on my TV yet (Android TV running Kodi natively).  I am still fairly new to Emby so getting my head around all this.

 

In the next couple of days I am going to put the ServerWMC plugin back on and see how that goes.  So far I have managed to get the home page to load slow maybe 3 times but not as bad as originally posted (about 10-20 seconds) and doesn't seem to be as often.  I am checking every 2-3 hours while at work and a few times a night at home.

 

I am committed to Emby now and have gone Premiere, I was running Emby and Plex together while testing them both out but like Emby better and think it has a much better future even though there are one or two small things Plex does I like better but they are relatively minor I am sure they will come to Emby in time

 

Will keep monitoring and report back.  I was really hoping something in the logs might have stood out but obviously not.

 

Cheers!

[CBers 7450]

I haven't looked at your logs, but do you get any excessive "(slow)" messages ??

 

I know anything over 1000ms is deemed "(slow)", but mine have been ~45000ms and some higher sometimes.

[happpyg 20]

I haven't looked at your logs, but do you get any excessive "(slow)" messages ??

 

I know anything over 1000ms is deemed "(slow)", but mine have been ~45000ms and some higher sometimes.

 

Yes, there are a few of those in there but some would have been from external internet IP's while at work although even then I would not expect them to be as high as they are with the bandwidth I have available and it's usage. A few are up around 30000+ms but mostly under 3000ms. 

[rjay 21]

Some interesting replies!

 

Possibly I could remove the Emby Sync Queue plugin, I haven't done any testing without it as I have always had it installed. If it improves the speed of the sync on my 2 Kodi endpoints it just made sense to have it.

 

I will await some more results of people testing things in this thread.

[happpyg 20]

@@Luke,

 

  Since removing all plugins I found it did seem to be quicker loading the home page.  I have slowly over the last week or so been putting all the plugins back on one by one.  The last one I installed was ServerWMC and I found after reinstalling it things slowed down a bit but they still don't seem to be as bad as before, maximum of about 20-30 seconds to fully load the home page (about 5-10seconds on average).  The top "My Media" section always loads immediately and then it fills out the Continue Watching, Latest Movies, Latest recordings etc after that which is the bit that sometimes takes time.

 

  I looked at my recordings on my Windows Media Center machine and found about 1000 there (I know.. lots...  not enough time ), I have deleted a lot and reduced it to about 400 recordings and now after testing for a few days everything seems to be stable and load times are averaging the 5-10 seconds as above.   The IOS app still often doesn't like it when I use it from an external source and then try to open it at home, the circle will spin forever until I close the app and re-open it after which everything refreshes very quickly.  I have my own domain at home so emby.<myhomedomain>.com resolves both on my WiFi at home as well as externally.  I then tried with Emby Connect but it did the same.  Interestingly going the other way from Wifi to external always works no problem?  I'll see if it persists with latest IOS version.

 

  I have always found that during times where there was lots of disk activity on the library.db file the page load times were affected even though I have fast SAS disks in my server and there were no other intensive I/O operaions happening on my host or VM's at the time.  It could have been that my install is new, I am messing with adding media and things were taking time to settle or a scheduled library update task was running I missed?

 

  So from here I am just going to watch it further and see how it goes over the coming weeks/days and report back if I find anything.   

 

Cheers

Aaron

[Luke 42078]

Thanks for the report.

[Luke 42078]

This is resolved for the next release of emby server, thanks.

[bfir3 117]

Really? Would you expect no more "Slow" messages in the logs?

[Jennice 19]

I have a slightly similar "slow response" issue.

When loading the first live tv channel (especially tv channel #1) it seems to hang, spinning the colourful circle forever in the web player. 

I have to click refresh the browser window to get back. The TV next channel I try to view, starts fine. I installed the server almost a week ago.

[Luke 42078]

I have a slightly similar "slow response" issue.

When loading the first live tv channel (especially tv channel #1) it seems to hang, spinning the colourful circle forever in the web player. 

I have to click refresh the browser window to get back. The TV next channel I try to view, starts fine. I installed the server almost a week ago.

 

@@Jennice can we look at an example? Please attach the information requested in how to report a media playback issue. thanks !

[Jennice 19]

Hi Luke,

 

Thanks for getting back to me. The log files are attached.

I'm using firefox 55.0.3

Emby language is Danish (DK), as is the PC. Win10 x64. i7-3770, gtx970. HDHomerun Expand (european DVB-C, 4 tuners).

I start the Emby server, and double-click the tray icon to open the dashboard in web browser.

 

I haven't set up my media files yet, so there's just live tv to choose from.

I click that, and select channels from the top row.

I click the first channel (DR1, a danish national TV station), and press the play button (well, it's localized) to the right of the channel image (I suppose there could be on in the frame, but I don't have any).

 

The color-wheel appears. After a few seconds, the screen goes from dark grey to black as if starting to show the channel. However, nothing else happens. The wheel just keeps spinning until I  get tired of looking at it.

I have to press the back arrow in firefox to get back to a web page I want, and then click re-load page to get away from the spining color circle.

 

Regards,

Jens

 

logs.zip

[Luke 42078]

We're looking at improvements to speed up startup for the next release, thanks.

[Jennice 19]

Hi Luke,

 

I hope the log files gave a hint of a root cause.

I have no idea if it's a detail or major error, but do you have an estimate of when the nest release is due?

It's a really cool program, and I'm eager to test with the issue fixed.

 

Jennice

[Jennice 19]

Hi Luke,

 

Any news on the "can't start the tv channel" issue from my log files?

 

Jennice