Emby keeps re-scanning the same library

[CharleyVarrick 283]

Yes loads of errors to do with Moviedb lookup

 

Does this path exist even if the file does not?

 

Could not find a part of the path 'C:\Users\jlr\AppData\Roaming\Emby-Server\programdata\cache\tmdb-movies2\394144\all-en.json'

folder 394144 does not exist (but theres over 14k other numerical folders within tmdb-movies2

Edited May 10, 2019 by jlr19

[PenkethBoy 2068]

you have plenty of free space on c: ?

 

Not sure why the dir is not created by Emby to save the json file to? @@Luke

 

Are all your plugins - TheMovieDB and NFO Metadata upto date? Might be worth as a test removing them - rebooting Emby and adding them back etc - JIC

 

Is you OS upto date - Win7 i think?

Edited May 10, 2019 by PenkethBoy

[CBers 7450]

There seems to be a ton of errors in my Emby log, but I have no idea how to interpret them.

Recent log attached, in case it could help...

 

Just 817 of those messages 

 

Have you tried creating that folder ?

C:\Users\jlr\AppData\Roaming\Emby-Server\programdata\cache\tmdb-movies2\119286

[Carlo 4560]

It sounds like a possible source of problem was already found with a meta-data provider.  It's quite possible the scan keeps running in order to fix meta-data.

 

But in general a few simple steps I would do.

 

Since you're using a drive pooling software I would manually check each drive (chkdsk) that makes up the pool.

 

Since this is a pool, this next step will be really easy.  What you want to do is look at the pooled drive in File Explorer.  Click on the date column to sort by date.

Do you see any directories with newer dates than you would expect?  If something is "touching" the files/directories in any way, this could continually kick off Emby scanning.

[rhodges 49]

To add what @@cayars said, are you storing metadata in the library folder? Is something updating the nfo files which is causing a change, thus a scan? Take a look at last modified dates on nfo and other files to see if they are changing a lot.

[CharleyVarrick 283]

1) you have plenty of free space on c: ?

 

2) Are all your plugins - TheMovieDB and NFO Metadata upto date? Might be worth as a test removing them - rebooting Emby and adding them back etc - JIC

 

3) Is you OS upto date - Win7 i think?

 

1) 82% free space on C

2) I would assume they are all up to date, as I did a full Emby reinstall 5 days ago

3) Windows 7 fully updated

[CharleyVarrick 283]

 

Just 817 of those messages 

 

Have you tried creating that folder ?

C:\Users\jlr\AppData\Roaming\Emby-Server\programdata\cache\tmdb-movies2\119286

If you want, I can do it, but at best, I'll have 816 errors left

 

[CBers 7450]

If you want, I can do it, but at best, I'll have 816 errors left

There were 817 errors relating to that one folder in the server log you posted earlier

 

Have you tried disabling the "TheMovieDB" metadata downloader in the library settings ?

[CharleyVarrick 283]

 What you want to do is look at the pooled drive in File Explorer.  Click on the date column to sort by date.

Do you see any directories with newer dates than you would expect?  If something is "touching" the files/directories in any way, this could continually kick off Emby scanning.

Last Modified show 10 movies folders I've had for a while,  with yesterday's date, which I'm certain I did not update/modify myself. The only thing that touches/updates  those folders is Emby, period.

[CharleyVarrick 283]

There were 817 errors relating to that one folder in the server log you posted earlier

 

Oups, that makes more sense, I just created it

[CharleyVarrick 283]

Have you tried disabling the "TheMovieDB" metadata downloader in the library settings ?

Now done, for now continuous scan loop still occurring

[CBers 7450]

Now done, for now continuous scan loop still occurring

Did you restart Emby?

[CharleyVarrick 283]

Did you restart Emby?

I just did, and everytime I restart Emby it stops the loop scan issue but only until a scheduled scan occurs.

[CBers 7450]

How often is that scheduled for?

[CharleyVarrick 283]

 

 

Have you tried disabling the "TheMovieDB" metadata downloader in the library settings ?

TheMovieDB is disabled, but I still have The Open Movie Database checked.

[CharleyVarrick 283]

How often is that scheduled for?

Not a clue, its not listed in scheduled tasks. Emby manages that by itself I guess

I'm going blind, yes its listed as every 12 hours

Edited May 10, 2019 by jlr19

[Luke 42077]

There seems to be a ton of errors in my Emby log, but I have no idea how to interpret them.

Recent log attached, in case it could help...

Just looking at one example:

 

2019-05-10 07:11:24.809 Info HttpClient: GET https://api.themoviedb.org/3/movie/152426?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers&language=en&include_image_language=en,null
2019-05-10 07:11:24.950 Error App: Error in TheMovieDb
	*** Error Report ***
	Version: 4.1.1.0
	Command line: C:\Users\jlr\AppData\Roaming\Emby-Server\system\EmbyServer.dll -noautorunwebapp
	Operating system: Microsoft Windows NT 6.1.7601 Service Pack 1
	64-Bit OS: True
	64-Bit Process: True
	User Interactive: True
	Runtime: file:///C:/Users/jlr/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll
	Processor count: 4
	Program data path: C:\Users\jlr\AppData\Roaming\Emby-Server\programdata
	Application directory: C:\Users\jlr\AppData\Roaming\Emby-Server\system
	System.IO.DirectoryNotFoundException: System.IO.DirectoryNotFoundException: Could not find a part of the path 'C:\Users\jlr\AppData\Roaming\Emby-Server\programdata\cache\tmdb-movies2\152426\all-en.json'.
	   at System.IO.FileStream.ValidateFileHandle(SafeFileHandle fileHandle)
	   at System.IO.FileStream.CreateFileOpenHandle(FileMode mode, FileShare share, FileOptions options)
	   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options)
	   at Emby.Common.Implementations.Serialization.JsonSerializer.DeserializeFromFile[T](String file)
	   at MovieDb.GenericMovieDbInfo`1.FetchMovieData(String tmdbId, String imdbId, String language, String preferredCountryCode, CancellationToken cancellationToken)
	   at MovieDb.GenericMovieDbInfo`1.GetMetadata(ItemLookupInfo itemId, CancellationToken cancellationToken)
	   at MediaBrowser.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, String logName, TIdType id, IEnumerable`1 providers, CancellationToken cancellationToken)
	Source: System.Private.CoreLib
	TargetSite: Microsoft.Win32.SafeHandles.SafeFileHandle ValidateFileHandle(Microsoft.Win32.SafeHandles.SafeFileHandle)
	

You have a movie with a MovieDb id of 152426, and apparently that Id doesn't exist anymore on MovieDb.

[CharleyVarrick 283]

Just looking at one example:

 

2019-05-10 07:11:24.809 Info HttpClient: GET https://api.themoviedb.org/3/movie/152426?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers&language=en&include_image_language=en,null
2019-05-10 07:11:24.950 Error App: Error in TheMovieDb
	*** Error Report ***
	Version: 4.1.1.0
	Command line: C:\Users\jlr\AppData\Roaming\Emby-Server\system\EmbyServer.dll -noautorunwebapp
	Operating system: Microsoft Windows NT 6.1.7601 Service Pack 1
	64-Bit OS: True
	64-Bit Process: True
	User Interactive: True
	Runtime: file:///C:/Users/jlr/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll
	Processor count: 4
	Program data path: C:\Users\jlr\AppData\Roaming\Emby-Server\programdata
	Application directory: C:\Users\jlr\AppData\Roaming\Emby-Server\system
	System.IO.DirectoryNotFoundException: System.IO.DirectoryNotFoundException: Could not find a part of the path 'C:\Users\jlr\AppData\Roaming\Emby-Server\programdata\cache\tmdb-movies2\152426\all-en.json'.
	   at System.IO.FileStream.ValidateFileHandle(SafeFileHandle fileHandle)
	   at System.IO.FileStream.CreateFileOpenHandle(FileMode mode, FileShare share, FileOptions options)
	   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options)
	   at Emby.Common.Implementations.Serialization.JsonSerializer.DeserializeFromFile[T](String file)
	   at MovieDb.GenericMovieDbInfo`1.FetchMovieData(String tmdbId, String imdbId, String language, String preferredCountryCode, CancellationToken cancellationToken)
	   at MovieDb.GenericMovieDbInfo`1.GetMetadata(ItemLookupInfo itemId, CancellationToken cancellationToken)
	   at MediaBrowser.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, String logName, TIdType id, IEnumerable`1 providers, CancellationToken cancellationToken)
	Source: System.Private.CoreLib
	TargetSite: Microsoft.Win32.SafeHandles.SafeFileHandle ValidateFileHandle(Microsoft.Win32.SafeHandles.SafeFileHandle)
	

You have a movie with a MovieDb id of 152426, and apparently that Id doesn't exist anymore on MovieDb.

 

Look at this 6 month old similar thread: https://emby.media/community/index.php?/topic/64449-unchanged-movie-libraries-constantly-updating-failing-to-update-modified-tv-show-libraries/

 

Something very similar happened already, I asked on their support page for a reverse lookup (getting a movie name from its ID#.

The mods and admin at moviedb were willing and able to help me, and I've just asked them again for this new case.

They will sometime wipe clean an entry in their listing because its a duplicate or some other usual reasons.

 

Considering that it already happened in the past, now my present case, its more than likely to happen again, so I'm thinking aloud Emby should just "log it and move on."

Edited May 10, 2019 by jlr19

[CharleyVarrick 283]

I am at wit's end, loop scan has resumed.

 

EDIT:

30 minutes later, all quiet no loop scan.

Edited May 10, 2019 by jlr19

[CBers 7450]

You have a movie with a MovieDb id of 152426, and apparently that Id doesn't exist anymore on MovieDb.

@jlr19 - if you download and install DB Browser for SQLite, you should be able to open the library.db file (shutdown Emby server and take a copy of the file beforehand) and see what movie has the id of 152426.

[CBers 7450]

Oh look, @@cayars had a similar issue in September last year:

 

https://emby.media/community/index.php?/topic/62980-044-error-the-open-movie-database/

 

Same movie id as well - 152426.

[CBers 7450]

Is it THE LANGOLIERS ??

 

https://fanart.tv/movie/152426/the-langoliers/

[Luke 42077]

But that's not going to be the answer to this topic. The answer is that the realtime monitor is reacting to file changes.

[CBers 7450]

But that's not going to be the answer to this topic. The answer is that the realtime monitor is reacting to file changes.

 

Seems to be the same TheMovidDB id all the time though, which you high-lighted.

[Happy2Play 9780]

Do your TMDB failed queries correspond with the media listed above it?
 
example Is "314294" the external tmdbid for "Merry Christmas Mr Bean" in UI.  To me you have a lot of media with the wrong/changed tmdbids.

2019-05-10 00:02:55.470 Debug MediaEncoder: Ffprobe -i file:"D:\Movies\Merry Christmas Mr Bean (1992)\Merry Christmas Mr Bean (1992).avi" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data

2019-05-10 00:02:55.548 Info HttpClient: GET https://api.themoviedb.org/3/movie/314294?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers&language=en&include_image_language=en,null

System.IO.DirectoryNotFoundException: System.IO.DirectoryNotFoundException: Could not find a part of the path 'C:\Users\jlr\AppData\Roaming\Emby-Server\programdata\cache\tmdb-movies2\314294\all-en.json'.[b]
[/b]

But these should have nothing to do with RTM issue.