Emby Completely Killing Network

[Netbug 26]

 

Issue: Starting earlier today, all of a sudden I started experiencing extreme latency and packet loss on my network. After a little trial and error, I've determined that this is being caused by Emby (running on unRAID). When I stop the Emby docker, my network traffic returns to normal.

I've never had an issue like this before. I use Emby daily and it is quite important to me.

I'm not quite sure how to go about troubleshooting this.

As soon as I start the docker, the network goes bananas. I've attached some screenshots.

If I completely reinstall the Emby server, the problem goes away for about a week, and then starts again. It really feels like some sort of update or script is running in emby that is completely obliterating my network.

Any ideas where I can start troubleshooting this?

OS: UnRAID 6.9.2

Hardware:

• Case: Lian-Li PC-A77F
• Motherboard: SuperMicro X9SCM-F
• Processor: Intel Core i3-2120 Sandy Bridge Dual-Core 3.3 GHz LGA 1155
• RAM: Kingston 8GB
• SATA Extender: Supermicro AOC-SASLP-MV8 SATA Extender
• Hot-swap Bays: SuperMicro CSE-M35T-1B (x 2)
• Power Supply: CORSAIR Enthusiast Series TX750M
• USB (unRAID): Lexar JD Firefly 8GB

Drives:

• Parity    WDC_WD80EFAX-68KNBN0_VDHBX7VD - 8 TB (sdb)
• Disk 1    WDC_WD20EADS-00R6B0_WD-WCAVY5374796 - 2 TB (sdf)
• Disk 2    WDC_WD30EZRX-19D8PB0_WD-WMC4N0J7D8TT - 3 TB (sdd)
• Disk 3    WDC_WD20EARS-00MVWB0_WD-WCAZA9034298 - 2 TB (sde)
• Disk 4    WDC_WD80EFAX-68KNBN0_VDH2MGVD - 8 TB (sdh)
• Disk 5    ST4000DM005-2DP166_WGY0E53A - 4 TB (sdj)
• Disk 6    ST3000DM001-1CH166_W1F23145 - 3 TB (sdm)
• Disk 7    WDC_WD30EZRX-00SPEB0_WD-WCC4E0NP7NLR - 3 TB (sdl)
• Disk 8    ST8000DM004-2CX188_ZR128XVM - 8 TB (sdk)
• Disk 9    ST4000DM005-2DP166_WDH2S61F - 4 TB (sdg)
• Disk 10    ST4000DM004-2CV104_ZFN0BNMN - 4 TB (sdi)
• Disk 11    ST8000DM004-2CX188_ZCT3VH40 - 8 TB (sdc)    
• Cache INTEL_SSDPEKNW512G8_PHNH929303YD512A - 512 GB (nvme0n1)
• Flash JD_FireFly - 8 GB (sda)

https://forums.unraid.net/uploads/monthly_2022_04/PingEmbyRunning.PNG.b41e0f91d95e4701bc168c38e9fb6c04.PNG

https://forums.unraid.net/uploads/monthly_2022_04/PingEmbyRunStop.png.8dda1e6aa14138afc04c9ee3a5d22406.png

https://forums.unraid.net/uploads/monthly_2022_04/PingEmbyStopped.PNG.0f58dc1f156b922a4336f5003959cb32.PNG

embyserver.txt hardware_detection-63785207120.txt

Edited April 10, 2022 by Netbug

[Happy2Play 9783]

Nothing really in the log besides an issue with your SSL cert.

[Netbug 26]

This is killing me. Any ideas where I could start looking? It's definitely Emby. When I start the Emby server, it immediately goes bananas with internet traffic. If I completely reinstall the server, it works for about a week, and then implodes again. Seems to me that would be a scheduled task.

Is there further logging that I can enable for a better idea?

 

Here's the network usage with the server running:

https://forums.unraid.net/uploads/monthly_2022_04/image.png.cbdbe8b596399e61f61cb2908ca6d97b.png

And when it's shut off:

https://forums.unraid.net/uploads/monthly_2022_04/image.png.1215c18696276449261c9e8f9c4f47e4.png

[Happy2Play 9783]

Would need to see more than a 1-minute server log but debug logging may show more info also.

SSL certificate issue

Interop+Crypto+OpenSslCryptographicException: error:23076071:PKCS12 routines:PKCS12_parse:mac verify failure

External communication being blocked.

MediaBrowser.Model.Net.HttpException: Connection to https://www.mb3admin.com/admin/service/EmbyPackages.json timed out

 

[Netbug 26]

10 minute log attached.

I think that SSL certificate was for an issue with internal network Chromecast streaming from a few years ago. I'll remove that now (it will still show in the log attached).

Edit: Issue persists after SSL removal.

embyserver-63785215702.txt

Edited April 10, 2022 by Netbug

[Luke 42083]

Hi, exactly what network traffic are you referring to?

[Netbug 26]

13 minutes ago, Luke said:

Hi, exactly what network traffic are you referring to?

Hi, Luke.

That's the trouble. We can't identify it. When Emby is running, there is a ridiculous amount of upload traffic that is completely obliterating anything else on the network. Can't figure out what's going on though. There are no scheduled processes running and no active streams or downloads. I've reinstalled again at this point, but when it pops up again, I'll try to get a more complete log. The trouble is that as soon as it starts, I have to kill emby because other users in the home need the internet.

If there's anything you can recommend for logging/debugging before the next occurrence, please advise.

[Luke 42083]

Can you enable debug logging, restart the server, and then attach a new log? Thanks.

[Happy2Play 9783]

Not really seeing anything in the 10-minute debug log above.

Do you see different results if you disable PortMapper and DLNA?

[Netbug 26]

11 minutes ago, Luke said:

Can you enable debug logging, restart the server, and then attach a new log? Thanks.

I've enabled debug logging. I have to wait for it to recur again (which it likely will within 5-7 days as I've now done a re-installation).

5 minutes ago, Happy2Play said:

Not really seeing anything in the 10-minute debug log above.

Do you see different results if you disable PortMapper and DLNA?

I'll try this as well at the next occurrence.

Thanks, guys.

[Netbug 26]

So it happened much sooner than last time. Log attached.

I've disabled DLNA and that SEEMS to have done something. It seems to be running better. I'll go to bed for now and check again in the morning.

embyserver (2).txt

[Luke 42083]

Ok we'll take a look. Thanks.

[rbjtech 5284]

Disable PortMapper (plugin) - it looks to be doing some very undesirable stuff if I'm reading the log correctly.

I would also investigate uPNP on your router - personally I would disable it ASAP - but this is your call as other services may be using it ..

Edited April 11, 2022 by rbjtech

[Netbug 26]

2 hours ago, rbjtech said:

Disable PortMapper (plugin) - it looks to be doing some very undesirable stuff if I'm reading the log correctly.

I would also investigate uPNP on your router - personally I would disable it ASAP - but this is your call as other services may be using it ..

I was looking at PortMapper earlier as I couldn't remember having installed it. I think I must have used it when attempting to correct an issue earlier last year. I have removed it now.

10 hours ago, Luke said:

Ok we'll take a look. Thanks.

It has been stable for the past 9 hours or so as far as I can tell. I will, of course, continue to monitor. It would seem that DLNA was the culprit.

[ebr 16187]

3 minutes ago, Netbug said:

It would seem that DLNA was the culprit

That would be my guess.  Most likely, one of the devices on  your network (a TV maybe) was attempting to cache your entire library.  Unfortunately, we've found this is how some DLNA-enabled devices behave so we've disabled our DLNA server by default in the next release.

[Netbug 26]

Thanks so much for the help, everyone. I've marked it as the solution.