Scan media library hangs, memory usage ramps to max

[ak96ss 10]

For several days now, when running a Scheduled Task to scan the media library (or just starting that scheduled task), the process hangs at 92.9%, and uses all available memory on the server. I let it run overnight, during the day, whichever, it eventually hangs, and then never lets go of all that memory.

If I select a specific library (movies, TV, whichever) it seems to run just fine, doesn't eat up all the memory, and completes without issue.

embyserver (17).txt

[Luke 42078]

Hi, please try removing these plugins:

2023-03-22 09:14:22.778 Info App: Loading playback_reporting, Version=2.0.0.2, Culture=neutral, PublicKeyToken=null from C:\Users\John_Admin\AppData\Roaming\Emby-Server\programdata\plugins\playback_reporting.dll
2023-03-22 09:14:22.778 Info App: Loading statistics, Version=3.0.7.5, Culture=neutral, PublicKeyToken=null from C:\Users\John_Admin\AppData\Roaming\Emby-Server\programdata\plugins\Statistics.dll

Then restart the server and see how things compare. Thanks.

[ak96ss 10]

Removed them, restarted the server.

Currently at 92.9%, memory usage is ramping up, we're at 35GB and climbing...

embyserver (18).txt

[Happy2Play 9780]

Unless debug logging shows more there really is nothing in this log but getting metadata.

Nothing is showing in the log but could the custom Cache/Metadata folder have an affect here?

[ak96ss 10]

That's what I was wondering, I wasn't seeing errors that pointed at anything.

I hit cancel, it currently says it is Stopping but RAM is at 40GB and going up.

 

embyserver (19).txt

[ak96ss 10]

OK, I removed the custom cache folder so it would use the default, restarted the server, tried again.

Currently holding at 92.9% and ram is back up to 35GB and climbing.

I'm going to move that last TV series (390028) - the one with two entries in the log, see if that makes a difference.

embyserver (20).txt

[Happy2Play 9780]

Can you enable debug logging also.  App Setting-Logs

[ak96ss 10]

I will.

Currently I am copying all of the metadata from the custom location back to the default location. When that is done, I am going to leave the custom location as is, turn on debug logging, and try again. If the problem is that drive, I'd like to see if this will tell me that...

If it fails at that point, then I will remove the custom metadata location and let it use the default.

[ak96ss 10]

Brief update - it's still running, at 92.9%...  but:

With debug logging on, and watching the log running live, I was able to see that there was one particular .JPG that it was hanging on. I removed that file, it then seemed to run fine, until it found another copy of that picture. Hung on that. I deleted it, started again...  and it is cranking through the pictures now. Memory usage is remaining low, so I am hopeful that it was just that one file.

Why that file, I have no idea. It opens fine, nothing looks out of the ordinary, but it was definitely hanging on that picture.

Hopefully it will finish soon and I can call this done - my SO just moved a LOT of pictures from Shutterfly onto the server...

[ak96ss 10]

And an hour later...  we've made it to 93.2%, so I'll call that a win. It is still cranking through pictures, but memory usage has remained nominal, so I am confident (knock on wood) that it was that file, for whatever reason.

Thanks for the speedy support!

[ak96ss 10]

And done.

Thanks again!

[Happy2Play 9780]

Yes there are some issues discovered with adding lots of photos to photo library.  Don't know the details but should be improved in 4.8.

[ak96ss 10]

Had I not enabled debug logging and watched it, I would never have known that was the issue - the 'normal' log gave no indication that it was hanging on a specific file. Not saying that's a problem, obviously that isn't something that comes up frequently, but still frustrating to look at the logs and see no indication of a problem.

I knew it would take a while to chunk through the pictures, so I didn't sweat it until I saw it was also chunking through all the memory...

Anywho, thanks.

 

[lightsout 156]

I am having a similar problem, connected remotely Anydesk was crashing due to memory, two times now I have caught Emby using 10gb of ram. Had to kill it to make the PC usable. I don't have logs as I am remote and needed to kill it to get some things done.

[Luke 42078]

On 3/22/2023 at 8:37 PM, ak96ss said:

Had I not enabled debug logging and watched it, I would never have known that was the issue - the 'normal' log gave no indication that it was hanging on a specific file. Not saying that's a problem, obviously that isn't something that comes up frequently, but still frustrating to look at the logs and see no indication of a problem.

I knew it would take a while to chunk through the pictures, so I didn't sweat it until I saw it was also chunking through all the memory...

Anywho, thanks.

 

Hi, this is resolved in the upcoming 4.8 server release. Thanks.

[lightsout 156]

5 hours ago, Luke said:

Hi, this is resolved in the upcoming 4.8 server release. Thanks.

Is there anything I can do for now to help? I removed the libraries that had home videos and photos as I read that could be part of the problem. But after a few hours I am having the problem again.

[ak96ss 10]

I'm also remote (well, it's in a rack in the basement and I was working on my desktop upstairs), but I was able to watch the debug logs via RDP to see that it was hanging on that file.

[Luke 42078]

2 hours ago, lightsout said:

Is there anything I can do for now to help? I removed the libraries that had home videos and photos as I read that could be part of the problem. But after a few hours I am having the problem again.

Server log?

[lightsout 156]

3 hours ago, Luke said:

Server log?

I just pm'd one that I captured earlier. Let me know if you need me to do something specific, thank you.

[lightsout 156]

16 hours ago, Luke said:

Server log?

Seems to just keep doing it now, emby using 11gb of ram, system at 95% ram usage.

[Trevor68 70]

Same Same, attaching my log. 

embyserver-63815419390.txt

[Trevor68 70]

23 hours ago, lightsout said:

Is there anything I can do for now to help? I removed the libraries that had home videos and photos as I read that could be part of the problem. But after a few hours I am having the problem again.

For me my Photos library is causing the problem, if I edit that library and untick "Enable Photos" the problem goes away 

[lightsout 156]

8 minutes ago, Trevor68 said:

For me my Photos library is causing the problem, if I edit that library and untick "Enable Photos" the problem goes away 

Hmmm. I don't even think I have it enabled any more. Are you talking about the camera upload thing? Or an actual library.?

[Trevor68 70]

this one. 

[lightsout 156]

1 minute ago, Trevor68 said:

this one. 

I don't have that enabled, I did have one but I disabled it. After a few restarts at this time it looks to be holding without the ram going out of control. Hopefully things stay the same.