Library scans taking very long

[AJV_20 39]

Every time I scan the library it takes forever, which isn’t a huge issue but while it scans all the movies and shows lose their images and metadata so it looks like a mess while scanning.

embyserver.txt

[AJV_20 39]

It finished scanning the library but a lot of movies have no images and it won’t identify new movies. All those movies have their images so I’m not sure what’s wrong

embyserver.txt

Edited October 15, 2024 by AJV_20

[kysdaddy 0]

I have a very similar issue, although not exact. I recently setup Emby on an Unraid server in hopes of moving away from Plex.

Unfortunately, Emby seems to want me to continue using Plex. 

Last Friday, today is Tuesday. I set up Emby; I purchased the premier package to use my digital antenna. I love Emby's look and feel.

That being said, I am not thrilled with the operation. I have been trying to scan files and add intro skip for days. 

I have set up each Library to use only one metadata provider.

I click on Scan Library files for TV, and after some time, I see Scan Media Library in running tasks. This starts out moving fairly well but hits a wall at 40.6%

When I go to Library page I see 91% with a green circle almost complete. But right above that is Scan Library Files with progress bar about half way green.

If I let this run for several hrs, it will complete.

However even though it says it is done, it only adds a few series, it is far from complete.

Somehow it sees all of the folders but reports the majority as empty, they are not empty. 

Even when the folder scans, I can see it working in the logs, not all information get adopted, for example the system just finished a while ago, the last series added was The Resident. if I go to the resident it shows (Example) season 4 with green 13 implying 13 unwatched episodes but when I open the folder there are 14 unwatched episodes.

Also over the past several days, when my arrs download a file it does not get included, I am guessing that this is because the system is still trying to do it's original scan. 

However Plex sees the newly added files immediately.

Is there something that I should do, change or pray to?

Any help or assistance is greatly appreciated

Chas

 

 

[AJV_20 39]

4 hours ago, AJV_20 said:

It finished scanning the library but a lot of movies have no images and it won’t identify new movies. All those movies have their images so I’m not sure what’s wrong

embyserver.txt 171.89 kB · 2 downloads

One more thing, movies show up with different versions although there’s only one version, it’s basically the same but repeated

[AJV_20 39]

3 hours ago, kysdaddy said:

I have a very similar issue, although not exact. I recently setup Emby on an Unraid server in hopes of moving away from Plex.

Unfortunately, Emby seems to want me to continue using Plex. 

Last Friday, today is Tuesday. I set up Emby; I purchased the premier package to use my digital antenna. I love Emby's look and feel.

That being said, I am not thrilled with the operation. I have been trying to scan files and add intro skip for days. 

I have set up each Library to use only one metadata provider.

I click on Scan Library files for TV, and after some time, I see Scan Media Library in running tasks. This starts out moving fairly well but hits a wall at 40.6%

When I go to Library page I see 91% with a green circle almost complete. But right above that is Scan Library Files with progress bar about half way green.

If I let this run for several hrs, it will complete.

However even though it says it is done, it only adds a few series, it is far from complete.

Somehow it sees all of the folders but reports the majority as empty, they are not empty. 

Even when the folder scans, I can see it working in the logs, not all information get adopted, for example the system just finished a while ago, the last series added was The Resident. if I go to the resident it shows (Example) season 4 with green 13 implying 13 unwatched episodes but when I open the folder there are 14 unwatched episodes.

Also over the past several days, when my arrs download a file it does not get included, I am guessing that this is because the system is still trying to do it's original scan. 

However Plex sees the newly added files immediately.

Is there something that I should do, change or pray to?

Any help or assistance is greatly appreciated

Chas

 

 

I would suggest making your own thread, they usually respond

[Carlo 4552]

Hi, the library scan could be taking a long time if you have Index or Skip Intro selected to take place during Library scanning.
If you have anything like that enabled, I'd turn them off until your library completes the initial scan. You can then turn them on for new media.
In scheduled tasks you'll see specific jobs that also get ran that can do these processes nightly.

I didn't see any duplicate movies in the picture.  What movies were duplicated?

Looking at your server log it is busy building your library.  I am seeing entries where it's also removing things like:
2024-10-15 09:18:37.451 Info App: Removing item from database, Type: Movie, Name: Gravity, Path: /Volumes/Emby/media/Movies/Gravity.2013.Diamond.Luxe.Edition.BluRay.1080p.TrueHD.Atmos.7.1.AVC.REMUX-FraMeSToR/Gravity.2013.Diamond.Luxe.Edition.BluRay.1080p.TrueHD.Atmos.7.1.AVC.REMUX-FraMeSToR.mkv, Id: 894084
2024-10-15 09:18:37.458 Info App: Deleting path /Users/abdiel/.config/emby-server/metadata/library/f5/f52a8b9f9b913f79e394188f4fdf096b

Are you moving files around on the system?

I would also suggest you take a look at our knowledge base article:
https://emby.media/support/articles/Library-Setup.html

Click the links for Movies & TV Naming to see the recommended folder structure as you really want each movie to be in its own subdirectory.

[AJV_20 39]

16 minutes ago, Carlo said:

Hi, the library scan could be taking a long time if you have Index or Skip Intro selected to take place during Library scanning.
If you have anything like that enabled, I'd turn them off until your library completes the initial scan. You can then turn them on for new media.
In scheduled tasks you'll see specific jobs that also get ran that can do these processes nightly.

I didn't see any duplicate movies in the picture.  What movies were duplicated?

Looking at your server log it is busy building your library.  I am seeing entries where it's also removing things like:
2024-10-15 09:18:37.451 Info App: Removing item from database, Type: Movie, Name: Gravity, Path: /Volumes/Emby/media/Movies/Gravity.2013.Diamond.Luxe.Edition.BluRay.1080p.TrueHD.Atmos.7.1.AVC.REMUX-FraMeSToR/Gravity.2013.Diamond.Luxe.Edition.BluRay.1080p.TrueHD.Atmos.7.1.AVC.REMUX-FraMeSToR.mkv, Id: 894084
2024-10-15 09:18:37.458 Info App: Deleting path /Users/abdiel/.config/emby-server/metadata/library/f5/f52a8b9f9b913f79e394188f4fdf096b

Are you moving files around on the system?

I would also suggest you take a look at our knowledge base article:
https://emby.media/support/articles/Library-Setup.html

Click the links for Movies & TV Naming to see the recommended folder structure as you really want each movie to be in its own subdirectory.

Got it I’ll take a look at that. By duplicates I mean in the version section. I’m not sure why is removing anything, I haven’t deleted or moved any movies

Edited October 16, 2024 by AJV_20

[Carlo 4552]

Hi, is it possible you have this same movie in two different locations?

[AJV_20 39]

1 hour ago, Carlo said:

Hi, is it possible you have this same movie in two different locations?

There's only one location. It even shows twice in this example but same location

[Carlo 4552]

What happens if you split them apart?
Are you able to delete one of them?

[AJV_20 39]

1 hour ago, Carlo said:

What happens if you split them apart?
Are you able to delete one of them?

Nothing happens when I tap on the button to split.

[Carlo 4552]

@LukeAny idea how multiple entries get added to the same library?
I see this on one of my systems as well and can't spit this either.

Shouldn't we have a foreign key constraint to keep this from happening.

[Luke 40096]

It is likely due to a defect in an older server version. Now the tough part comes cleaning it out.

@AJV_20can you try removing the library altogether, waiting for the library scan to finish, and then adding it back?

[AJV_20 39]

1 hour ago, Luke said:

It is likely due to a defect in an older server version. Now the tough part comes cleaning it out.

@AJV_20can you try removing the library altogether, waiting for the library scan to finish, and then adding it back?

Sure I’ll try it out

[AJV_20 39]

10 hours ago, AJV_20 said:

Sure I’ll try it out

It fixed some of them but others didn’t work

embyserver.txt

[Luke 40096]

On 10/22/2024 at 7:23 AM, AJV_20 said:

It fixed some of them but others didn’t work

ScreenRecording_10-22-2024 07-20-53_1.mov

embyserver.txt 1.4 MB · 1 download

HI, can you please provide an example? Thanks !