Problems after moving to new server

[jj12345 25]

 

My windows machine hosting Emby died.  I put a new machine in place and gave it the same machine name and setup the same folder shares so UNC paths would remain.  Put a backup of my large-ish (7k movies, 52k tv episodes) media in place (video files w/o meta data).  Then restored from an Emby configuration backup that was from before the prior machine died but MAY have been from a prior version of Emby.  I mention the possible version mismatch because I don't know what version I was running prior to the machine dying and something isn't right and maybe it's a configuration mismatch.

What I'm seeing is EmbyServer consistently using 10% CPU and 8-10 GB of RAM with no streaming happening.  It's been running for a couple of days now like that.  On the local machine I can sometimes use the web interface and it seems like very few shows have images and metadata even after a couple of days. From another machine on the same LAN I often cannot even connect via the web interface.  

I've attached the log file and see a lot of errors like the one I reference here but don't know which xml file it is referencing when it complains about the root element is missing.  This error is part of what made me wonder if restoring from a backup of a prior version of Emby is the issue with some missing or incorrect configuration file.

I could start from scratch but I hate to lose user settings like titles watched, titles favorited, custom collections, etc.  Can those manually be copied from a backup into a clean installation?  If that's possible which files would contain titles watched, titles favorited, and custom collections?

Error PortMapper: Error in GetSpecificMappingAsync
	*** Error Report ***
	Version: 4.7.11.0
	Command line: C:\Users\johnp\AppData\Roaming\Emby-Server\system\EmbyServer.dll -Service
	Operating system: Microsoft Windows 10.0.22621
	Framework: .NET 6.0.10
	OS/Process: x64/x64
	Runtime: C:/Users/johnp/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll
	Processor count: 16
	Data path: C:\Users\johnp\AppData\Roaming\Emby-Server\programdata
	Application path: C:\Users\johnp\AppData\Roaming\Emby-Server\system
	System.Xml.XmlException: System.Xml.XmlException: Root element is missing.
	   at System.Xml.XmlTextReaderImpl.Throw(Exception e)
	   at System.Xml.XmlTextReaderImpl.ThrowWithoutLineInfo(String res)
	   at System.Xml.XmlTextReaderImpl.ParseDocumentContent()
	   at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace)
	   at System.Xml.XmlDocument.Load(XmlReader reader)
	   at System.Xml.XmlDocument.LoadXml(String xml)
	   at Mono.Nat.Upnp.ResponseMessage.Decode(UpnpNatDevice device, String message, ILogger logger)
	   at Mono.Nat.Upnp.UpnpNatDevice.GetSpecificMappingAsync(Protocol protocol, Int32 publicPort, CancellationToken cancellationToken)
	   at Mono.Nat.Upnp.UpnpNatDevice.CreatePortMap(Mapping mapping, CancellationToken cancellationToken)
	Source: System.Private.Xml
	TargetSite: Void Throw(System.Exception)

 

embyserver.txt

[Luke 42085]

Hi, please try removing the statistics and auto organize plugins, then restart the server and see if that helps with resource consumption. Thanks.

[jj12345 25]

13 hours ago, Luke said:

Hi, please try removing the statistics and auto organize plugins, then restart the server and see if that helps with resource consumption. Thanks.

Thanks Luke.  I removed those plugins and restarted.  It's been running about 12 hours now and performance is the same... hovering around 10% CPU and 8-10 GB RAM used with no streaming happening since it is very slow to respond to clients (if there is any response before a timeout) including the web client.

The scan media library task has been running basically for days ... starts after Emby is started and never stops until Emby is stopped.  Not sure on all that happens during that task but during part of it you can see a percentage counter on various libraries... maybe it's past that part as no libraries are showing percentages and the progress bar is "stuck" around the 90% mark.

Fresh log file is attached.

embyserver.txt

[Luke 42085]

As a test, can you try removing your photo libraries and then see how that compares? Thanks.

[jj12345 25]

11 hours ago, Luke said:

As a test, can you try removing your photo libraries and then see how that compares? Thanks.

Luke I think this put me on the right track.  I dropped that library and a couple of others that had the type of "Mixed Content" but should have had the content type "Home videos & photos".  Not sure how I gave them the wrong content type although I've been using Emby a long time and maybe that was the best type at the time I created the libraries.  Perhaps Emby was going nuts trying to find metadata for items in a mixed content library that would never be found successfully?  In any case I removed those, and it's been a few hours and memory usage is still below 1GB and clients can actually connect.  Yay!

The scan is still running and there is a lot of content that is not processed yet and, therefore, not playable but this is a huge step in the right direction as slowly things are starting to appear that are playable as scanning progresses.  Maybe another day and it'll be ready.

One thing that appears to be missing is that I had a couple of custom collections that are not there.  I see standard collections but not my two custom collections.  I'd really like to get them back.  I'm guessing they were not included in the backups since I restored from a recent backup and it's not there.  Should they have been in the backup?  If so, where would I look in the backup folder for them and where should I copy them to?  If they are not backed up and if I manage to successfully mount the old HDD where would I look for them in the old Emby program data and were should I copy them to?

[Luke 42085]

There are improvements to photo scanning in the upcoming 4.8 release that will allow you to add the library back.

Collections are not part of the backup. They live in the metadata for each individual movie, so for example if you have movie nfo files.

[jj12345 25]

Thanks for all of your help.  I will wait to create the photos library until v4.8 is released.

I guess I should have backed up the nfo files and not just the media itself.  Seems like the custom collections are probably gone forever then.  In the past when I pulled up a custom collection it seemed to have built that list pretty quickly... it seemed faster than scanning every nfo could have allowed.  Was that just cached in memory or was there a second index somewhere that maybe would reveal the names of the titles?  Even if I had to recreate it manually having the names would be a starting point.

[Luke 42085]

7 hours ago, jj12345 said:

Thanks for all of your help.  I will wait to create the photos library until v4.8 is released.

I guess I should have backed up the nfo files and not just the media itself.  Seems like the custom collections are probably gone forever then.  In the past when I pulled up a custom collection it seemed to have built that list pretty quickly... it seemed faster than scanning every nfo could have allowed.  Was that just cached in memory or was there a second index somewhere that maybe would reveal the names of the titles?  Even if I had to recreate it manually having the names would be a starting point.

Well the info is also in the main database file, library.db.

[jj12345 25]

Thanks!