Jump to content

Library scan not finding all movies

AJV_20

By AJV_20
in MacOS

 Share

Recommended Posts

AJV_20

AJV_20 57

Posted
Posted

When a library scan is ran, it doesn’t find all movies. I have to manually run it again until it finds them all. I’m not sure if is because I have a lot of movies or because there’s a bug. Currently I have around 1007 movies

embyserver.txt

Luke Emby Team

Luke 42077

Posted
Posted

Hi there, can you please provide a specific example? How are your files named and organized?

sa2000

sa2000 674

Posted
Posted (edited)

Just after media scan started, we logged this erorr relating to "@eaDir" - could it be what is stopping the scan? 

2024-10-20 19:30:31.124 Error App: Error in validateChildren for 64880 /Users/abdiel/.config/emby-server/root/default/Movies/@eaDir

and more detail 

2024-10-20 19:30:31.118 Info TaskManager: Executing Scan media library

2024-10-20 19:30:31.118 Info Server: http/1.1 Response 204 to host1. Time: 6ms. POST http://192.168.7.149:8096/emby/ScheduledTasks/Running/6330ee8fb4a957f33981f89aa78b030f?X-Emby-Client=Emby for iOS&X-Emby-Device-Name=iPhone&X-Emby-Device-Id=6C540EAC-4466-4881-8CE0-453031E57D87&X-Emby-Client-Version=2.2.31&X-Emby-Token=x_secret3_x&X-Emby-Language=en-us

2024-10-20 19:30:31.124 Error App: Error in validateChildren for 64880 /Users/abdiel/.config/emby-server/root/default/Movies/@eaDir
	*** Error Report ***
	Version: 4.8.10.0
	Command line: /Applications/EmbyServer.app/Contents/MacOS/EmbyServer.dll -noautorunwebapp
	Operating system: Darwin 24.1.0 Darwin Kernel Version 24.1.0: Thu Oct 10 22:07:33 PDT 2024; root:xnu-11215.41.3~5/RELEASE_ARM64_T6020
	Framework: .NET 6.0.31
	OS/Process: arm64/arm64
	Runtime: Applications/EmbyServer.app/Contents/MacOS/System.Private.CoreLib.dll
	Processor count: 10
	Data path: /Users/abdiel/.config/emby-server
	Application path: /Applications/EmbyServer.app/Contents/MacOS
	System.IO.DirectoryNotFoundException: System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/abdiel/.config/emby-server/root/default/Movies/@eaDir'.
	   at System.IO.Enumeration.FileSystemEnumerator`1.CreateDirectoryHandle(String path, Boolean ignoreNotFound)
	   at System.IO.Enumeration.FileSystemEnumerator`1.Init()
	   at System.IO.Enumeration.FileSystemEnumerable`1..ctor(String directory, FindTransform transform, EnumerationOptions options, Boolean isNormalized)
	   at System.IO.Enumeration.FileSystemEnumerableFactory.FileSystemInfos(String directory, String expression, EnumerationOptions options, Boolean isNormalized)
	   at System.IO.DirectoryInfo.InternalEnumerateInfos(String path, String searchPattern, SearchTarget searchTarget, EnumerationOptions options)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.EnumerateFileSystemInfos(DirectoryInfo dir, Boolean recursive)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.GetFileSystemEntries(String path, Boolean recursive, FileSystemCredentials credentials)
	   at MediaBrowser.Controller.Providers.DirectoryService.GetFileSystemEntriesInternal(String path)
	   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
	   at MediaBrowser.Controller.Entities.Folder.GetNonCachedChildren(IDirectoryService directoryService, LibraryOptions libraryOptions)
	   at MediaBrowser.Controller.Entities.BaseItem.ValidateChildrenInternal(IProgress`1 progress, CancellationToken cancellationToken, Boolean recursive, Boolean refreshChildMetadata, BaseItem[] collectionFolders, LibraryOptions libraryOptions, Dictionary`2 newItemIds, MetadataRefreshOptions refreshOptions, IDirectoryService directoryService)
	   at Emby.Server.Implementations.Library.LibraryManager.ValidatePhysicalRoots(IProgress`1 progress, IDirectoryService directoryService, CancellationToken cancellationToken)
	Source: System.Private.CoreLib
	TargetSite: IntPtr CreateDirectoryHandle(System.String, Boolean)

This is on 4.8.10.0 on MacOS

 

Edited by sa2000
AJV_20

AJV_20 57

Posted
  • Author
Posted
10 hours ago, Luke said:

Hi there, can you please provide a specific example? How are your files named and organized?

I don’t think that’s the issue, it does detect them but not all the time

 

27 minutes ago, sa2000 said:

Just after media scan started, we logged this erorr relating to "@eaDir" - could it be what is stopping the scan? 

2024-10-20 19:30:31.124 Error App: Error in validateChildren for 64880 /Users/abdiel/.config/emby-server/root/default/Movies/@eaDir

and more detail 

2024-10-20 19:30:31.118 Info TaskManager: Executing Scan media library

2024-10-20 19:30:31.118 Info Server: http/1.1 Response 204 to host1. Time: 6ms. POST http://192.168.7.149:8096/emby/ScheduledTasks/Running/6330ee8fb4a957f33981f89aa78b030f?X-Emby-Client=Emby for iOS&X-Emby-Device-Name=iPhone&X-Emby-Device-Id=6C540EAC-4466-4881-8CE0-453031E57D87&X-Emby-Client-Version=2.2.31&X-Emby-Token=x_secret3_x&X-Emby-Language=en-us

2024-10-20 19:30:31.124 Error App: Error in validateChildren for 64880 /Users/abdiel/.config/emby-server/root/default/Movies/@eaDir
	*** Error Report ***
	Version: 4.8.10.0
	Command line: /Applications/EmbyServer.app/Contents/MacOS/EmbyServer.dll -noautorunwebapp
	Operating system: Darwin 24.1.0 Darwin Kernel Version 24.1.0: Thu Oct 10 22:07:33 PDT 2024; root:xnu-11215.41.3~5/RELEASE_ARM64_T6020
	Framework: .NET 6.0.31
	OS/Process: arm64/arm64
	Runtime: Applications/EmbyServer.app/Contents/MacOS/System.Private.CoreLib.dll
	Processor count: 10
	Data path: /Users/abdiel/.config/emby-server
	Application path: /Applications/EmbyServer.app/Contents/MacOS
	System.IO.DirectoryNotFoundException: System.IO.DirectoryNotFoundException: Could not find a part of the path '/Users/abdiel/.config/emby-server/root/default/Movies/@eaDir'.
	   at System.IO.Enumeration.FileSystemEnumerator`1.CreateDirectoryHandle(String path, Boolean ignoreNotFound)
	   at System.IO.Enumeration.FileSystemEnumerator`1.Init()
	   at System.IO.Enumeration.FileSystemEnumerable`1..ctor(String directory, FindTransform transform, EnumerationOptions options, Boolean isNormalized)
	   at System.IO.Enumeration.FileSystemEnumerableFactory.FileSystemInfos(String directory, String expression, EnumerationOptions options, Boolean isNormalized)
	   at System.IO.DirectoryInfo.InternalEnumerateInfos(String path, String searchPattern, SearchTarget searchTarget, EnumerationOptions options)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.EnumerateFileSystemInfos(DirectoryInfo dir, Boolean recursive)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.GetFileSystemEntries(String path, Boolean recursive, FileSystemCredentials credentials)
	   at MediaBrowser.Controller.Providers.DirectoryService.GetFileSystemEntriesInternal(String path)
	   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
	   at MediaBrowser.Controller.Entities.Folder.GetNonCachedChildren(IDirectoryService directoryService, LibraryOptions libraryOptions)
	   at MediaBrowser.Controller.Entities.BaseItem.ValidateChildrenInternal(IProgress`1 progress, CancellationToken cancellationToken, Boolean recursive, Boolean refreshChildMetadata, BaseItem[] collectionFolders, LibraryOptions libraryOptions, Dictionary`2 newItemIds, MetadataRefreshOptions refreshOptions, IDirectoryService directoryService)
	   at Emby.Server.Implementations.Library.LibraryManager.ValidatePhysicalRoots(IProgress`1 progress, IDirectoryService directoryService, CancellationToken cancellationToken)
	Source: System.Private.CoreLib
	TargetSite: IntPtr CreateDirectoryHandle(System.String, Boolean)

This is on 4.8.10.0 on MacOS

 

Maybe, what does this mean?

sa2000

sa2000 674

Posted
Posted (edited)
23 hours ago, AJV_20 said:

don’t think that’s the issue, it does detect them but not all the time

Lets try enabling debug logging on the server settings for logs 

Then restart the server and start a media scan. And give examples of media paths that are not being detected and which library. Please get screenshots of the media folder paths for the libraries that are affected - server sttings dashboards and then selecting library view

Then add a movie giving details of the file name/folder names and do a scan of the library and feedback if that is added and also capture the server logs covering both tests

Thanks

 

 

Edited by sa2000
Carlo

Carlo 4560

Posted
Posted

Use at your own risk::
This is how I fixed Synology index scanning:

Control Panel > Task Scheduler, click Create, and select Triggered Task.
User-defined script
Create task

General Settings:
Task: Disable indexing
User: Root
Event: Startup

Task Settings

Paste in the below commands.

sleep 60
systemctl stop pkg-SynoFinder-fileindexd.service
systemctl stop synoindexd.service
systemctl stop synoindex-workerd.service
systemctl stop synoindex-mediad.service

Ok
Ok (accepting the warning)

------------------------------------------------------

To remove existing entries:
https://community.nethserver.org/t/synology-nas-problems-with-hidden-folder-eadir-with-solution/21166

AJV_20

AJV_20 57

Posted
  • Author
Posted
4 hours ago, Luke said:

@AJV_20 has this helped?

I’m not sure, I deleted the library and added it again to troubleshoot the other issue and it hasn’t done it since

  • Thanks 3
AJV_20

AJV_20 57

Posted
  • Author
Posted
4 minutes ago, Luke said:

OK what example are we focusing on here?

Every time it scans for media, it finds a different number of movies. There should be 1015 but some times it finds something in the 900s sometimes in the 800s.

IMG_0872.png

IMG_0873.png

sa2000

sa2000 674

Posted
Posted
On 21/10/2024 at 12:38, sa2000 said:

And give examples of media paths that are not being detected and which library. Please get screenshots of the media folder paths for the libraries that are affected - server sttings dashboards and then selecting library view

Then add a movie giving details of the file name/folder names and do a scan of the library and feedback if that is added and also capture the server logs covering both tests

That was my earlier suggestion. Can you give examples of paths that should have been found that were not and also the actual folder names/filenames for these examples

Are you moving media around or renaming files ? I see a lot of items logged as being removed. In the log you attached, 96 movies show as being removed from the database 

This is one example of the 96. All are in "/Volumes/Emby/media/Movies/" 

2024-10-31 12:10:54.371 Info App: Removing item from database, Type: Movie, Name: The Woman King, Path: /Volumes/Emby/media/Movies/The.Woman.King.2022.2160p.WEB-DL.DDP5.1.Atmos.HDR.H.265-EVO/The.Woman.King.2022.2160p.WEB-DL.DDP5.1.Atmos.HDR.H.265-EVO.mkv, Id: 943264

Can you check your naming against what is in this article for Movies https://emby.media/support/articles/Movie-Naming.html

I see file names that do not look right - eg "1994 - Only You.mkv" which I would put in as "Only You (1994).mkv"

 

Looking at the media scan showing in the log, it started at 11:49 and completed at 12:34

So your movies are mainly in "/Volumes/Emby/media/Movies" directory, I can see 400 movies within this path (including featurette files) being detected in this scan.

Can you explain to me where this directory path is specified in your server settings for the Libraries:

"/Users/abdiel/.config/emby-server/root/default/Movies"

The media scan hit an error on this path with an "@eaDir" in that path.

So go through all your library settings and see what folder paths you have defined and remove incorrect ones and see if that has an impact

So to summarize:

- need actual real examples of media file names/paths/folders that are not being found

- need libraries folder paths checked out as being correct - you can share the folder paths for the libraries concerned - go to server settings dashboard and select Library and for each library, select edit to see what the folder paths are

 

  • Agree 1
  • 2 weeks later...
AJV_20

AJV_20 57

Posted
  • Author
Posted

I haven’t had a chance to troubleshoot, I’ll try in a day or two

  • Thanks 1

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...