Emby server unusable during library scan

[nikephorosthe1 0]

Hello all ,

On recently deployed emby server I've came across a problem. The scanning takes forever, even with nfo turned off, no "live scanning on aswell" library have 28k movies - 25k 108p and 3k uhd.

Scan seems to be now stuck on 90% has not moved a long time now.  Playback during scan Is practically  impossible.

I would greatly appreciate any tips and tweaks for this matter.

Emby runs in docker - 64gb ram,14770k, nvme ssd, premier license on. All covered in unraid. Other apps are lighting fast compared to emby.

 

Including log as per instructions in the post "how to report a problem"

embyserver.txt

[Luke 42077]

Hi, please try removing these plugins:

	Addic7ed 1.1.1.0
	Strm Extract 1.0.0.0

Then restart the server and see how things compare. Thanks.

[nikephorosthe1 0]

both plugins deleted, scan is little bit faster, no playback after 5 mins. so it is unusable.

any tweaks i can do to make it work ? it cant be everytime there is a scan its gone and done for .... its running on excelent hardware , i dont understand it .... 

 

 

edit1> isnt there a way to force the server to scan faster ? alocate all the hw available to it ? or something like that ?

 

Edited May 14, 2025 by nikephorosthe1

[Luke 42077]

31 minutes ago, nikephorosthe1 said:

both plugins deleted, scan is little bit faster, no playback after 5 mins. so it is unusable.

any tweaks i can do to make it work ? it cant be everytime there is a scan its gone and done for .... its running on excelent hardware , i dont understand it .... 

 

 

edit1> isnt there a way to force the server to scan faster ? alocate all the hw available to it ? or something like that ?

 

Can you please attach a new server log? Thanks.

[nikephorosthe1 0]

new one

 

embyserver (3).txt

Edited May 14, 2025 by nikephorosthe1

[nikephorosthe1 0]

embyserver (4).txt

[nikephorosthe1 0]

embyserver (5).txt

[Luke 42077]

Quote

2025-05-14 18:59:49.068 Info TaskManager: Executing Scan Metadata Folder

Why are you running this? did you read the help text explaining the very specific circumstance in which you would need to run it?

[nikephorosthe1 0]

That was a miss click I thought I hit the scan media... I canceled the job and restarted the container and the I run the clean media scan...

So zero relevance to my problem. Any advices then? Because it's really impossible to use it....

To me it seems that is it just programmed that way and it's bottleneck no matter what?  

 

Edit1: what seems to help is a divided libraries not everything in the one library. Also I changed database size in the settings from 128mb to 3g.

Edited May 15, 2025 by nikephorosthe1

[Luke 42077]

It looks like you might have set it on a schedule though because I see it in multiple logs. I would remove the schedule for it.

[nikephorosthe1 0]

2 hours ago, Luke said:

It looks like you might have set it on a schedule though because I see it in multiple logs. I would remove the schedule for it.

Okay, apart from that (which is not part of the problem)

Edit: the occasion  I started metadáta scan - this was by mistake and I did reboot server before running lib scan. (Mentioned in the previous post)

 

anything that comes in mind as how to actually improve performance? It's running top tier hardware and it's slow like a 486 on a bad night...

Edited May 15, 2025 by nikephorosthe1

[marriedman 85]

Just spit-balling here, you said you recently deployed this? This scan of your movies, is this the first initial pass? If so, it's going to take a long time with 28K movies.  Besides determining the mediainfo for all of those files, do you have chapter creation enabled? Chapter thumbnail generation too? Are you scraping metadata from the internet? Is your media fast hard drives or slow? Also, is the storage on the same hardware as emby or is it on SMB/NFS shares? If so, how it the network speed? All of these things will take time on the first scan. If you expand to TV Shows, the intro skip will also take time. You don't really need to answer any of these questions, they are just there for information and consideration. 

I believe I have a pretty substantial library:

• 41,398 Episodes
• 2,294 Movies
• 104 Music Videos
• <100 Home Videos
• 50,315 Songs

That took well over a day, could have been two. On trick I literally just learned was that you can tail the log file and see in real time what emby is doing. So I ended up just tailing the log and checked on it every once in a while. Once that initial scan is done, you can set emby to watch your library for changes or schedule the scan for the middle of the night. I have mine set to watch an it's very fast in my opinion and there is no impact to performance on my much older hardware. 

I've attached an example of all the mediainfo that emby is scanning. That coupled with the genre, actors, studio, years, etc... makes for some pretty powerful filtering capabilities. Stick with it and I bet you will be thoroughly impressed with emby's performance.

 

[nikephorosthe1 0]

On 5/15/2025 at 9:12 AM, nikephorosthe1 said:

previous

Nice reply but the main issue I had was that emby gets unresponsive when scanning either initial or any other after that.. No playback whatsoever. 

[marriedman 85]

It's been a while since your last post. Any update?

[Luke 42077]

@nikephorosthe1?