TV library constantly scanning in a loop

[seanbuff 1316]

3 minutes ago, Happy2Play said:

What plugin version do you have as there have been updates.

Latest versions.

    MovieDb 1.5.5.0
    TheTVDB 1.2.1.0

The server is restarted almost daily, and these scanning issues have been going on for weeks now.

[Happy2Play 9780]

1 hour ago, seanbuff said:

Latest versions.

    MovieDb 1.5.5.0
    TheTVDB 1.2.1.0

The server is restarted almost daily, and these scanning issues have been going on for weeks now.

Minus bad cached data, I am not sure as I added Man v. Food Season 5 episodes 1-10 to a test machine and has no issue.  Only TVDB has Season 5.  Tested with Season 3 also.

But your TMDB query does not look correct.  As you can see the Language query is incomplete, so file is not found.@Luke Would look like a configuration issue in reference to TMDB language queries specific to seanbuff's setup

Quote

2022-03-31 16:34:45.072 Info HttpClient: GET https://api.themoviedb.org/3/tv/8519/season/1?api_key=x_secret1_x&append_to_response=images,keywords,external_ids,credits,videos&language=
  &include_image_language=
  ,null,en

    System.IO.IOException: System.IO.IOException: The filename, directory name, or volume label syntax is incorrect. : 'C:\Users\<username_obfuscated>\AppData\Roaming\Emby-Server\programdata\cache\tmdb-tv\8519\season-1-
  .json'

But I am not getting the broken language query

Quote

&append_to_response=images,keywords,external_ids,credits,videos&language=en&include_image_language=en,null

But your log does suggest a library monitor loop.

Only suggestions I have would be go to cache folder and delete the TVDB series id folder and TMDB-TV id folder.  Worst case would be removing the series, scanning, then readding.

Note seanbuff in on beta server vs OP charleyvarrick being on stable server.

Edited April 5, 2022 by Happy2Play

[seanbuff 1316]

Clean log from a restart, almost started scanning again immediately, looping for 20 mins.

20220405_embyserver.txt

 

7 minutes ago, Happy2Play said:

Only suggestions I have would be go to cache folder and delete the TVDB series id folder and TMDB-TV id folder.  Worst case would be removing the series, scanning, then readding.

Thanks I'll give this a go.

[Happy2Play 9780]

5 minutes ago, seanbuff said:

Clean log from a restart, almost started scanning again immediately, looping for 20 mins.

20220405_embyserver.txt 489.43 kB · 0 downloads

 

Thanks I'll give this a go.

Okay there is a language issue somewhere on your setup as the TVDB queries have the same issue.  But do not know if that is related to the loop as librarymonitor should be detecting change.  But I guess this broke metadata may be relevant.

Yours

Quote

2022-04-05 10:54:07.031 Info HttpClient: GET https://api4.thetvdb.com/v4/series/84006/episodes/official/  ?page=0

Mine

Quote

2022-04-04 17:16:02.274 Info HttpClient: GET https://api4.thetvdb.com/v4/series/84006/episodes/official/eng?page=0

Not sure where the disconnect is though.  @Lukewill have to comment.

[Happy2Play 9780]

@seanbuffcan you verify "Preferred Metadata Language" on Settings-Library, Advanced tab.  As that is the Global setting, then you have the optional per library and per series options (but they should/will inherit the global setting if they are blank).

To me somehow your global setting is no longer set.

Edited April 5, 2022 by Happy2Play

[seanbuff 1316]

2 minutes ago, Happy2Play said:

@seanbuffcan you verify "Preferred Metadata Language" on Settings-Library, Advanced tab.  As that is the Global setting, then you have the optional per library and per series options.

Global Setting:

Library Setting for TV Shows:

Series Level (Man v. Food):

What stands out to me is my "global" country is set to Australia, but my "library" country is set to US -- not sure if that makes a difference.

[Happy2Play 9780]

21 minutes ago, seanbuff said:

What stands out to me is my "global" country is set to Australia, but my "library" country is set to US -- not sure if that makes a difference.

To my knowledge Country should only affect Parental Rating.  Everything looks correct, so we will have to wait for the man to comment as I think all the bases have been covered.

[CharleyVarrick 283]

6 hours ago, seanbuff said:

Global Setting:

Library Setting for TV Shows:

Series Level (Man v. Food):

What stands out to me is my "global" country is set to Australia, but my "library" country is set to US -- not sure if that makes a difference.

Where do I find Global Setting ?

never mind, found it in Happy's post above this one.

 

Edited April 5, 2022 by CharleyVarrick

[CharleyVarrick 283]

6 hours ago, Happy2Play said:

@seanbuffcan you verify "Preferred Metadata Language" on Settings-Library, Advanced tab.  As that is the Global setting, then you have the optional per library and per series options (but they should/will inherit the global setting if they are blank).

To me somehow your global setting is no longer set.

As you replied already that everything's ok, I am wondering how would have looked  a "no longer set" global setting.

What were you expecting to see instead? 

[seanbuff 1316]

27 minutes ago, CharleyVarrick said:

I am wondering how would have looked  a "no longer set" global setting.

I would expect blank would mean it is not set

[CharleyVarrick 283]

@seanbuff

48 hrs ago, I've switched off real time monitoring on my tv shows library and after that, a reboot of the computer (just restarting Emby from Dashboard didnt cut it). As a result, I have ceased to experience constant tv shows library scanning.

Oddly enough, I continue to benefit from RTM even though I've switched it off.

 

Can you try this on your side ? (switching off rtm for your affected library, restarting your computer, then add new content and passively monitor Latest TV Shows to see if new content appears within minutes) 

Edited April 5, 2022 by CharleyVarrick

[seanbuff 1316]

@Luke okay I can report that as of the latest TVDB plugin update (v1.2.2) - I am no longer seeing TVDB errors and scans in my log.

The only errors that remain are from TheMovieDB plugin for the same series:

	2022-04-06 11:44:41.366 Info HttpClient: GET https://api.themoviedb.org/3/tv/8519/season/3?api_key=‌f6bd687ffa63cd282b6ff2c6877f2669‌&append_to_response=images,keywords,external_ids,credits,videos&language=
  &include_image_language=
  ,null,en
2022-04-06 11:44:41.371 Error App: Error in TheMovieDb
	*** Error Report ***
	Version: 4.7.0.33
	Command line: C:\Users\<username_obfuscated>\AppData\Roaming\Emby-Server\system\EmbyServer.dll
	Operating system: Microsoft Windows 10.0.19044
	Framework: .NET 6.0.2
	OS/Process: x64/x64
	Runtime: C:/Users/<username_obfuscated>/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll
	Processor count: 16
	Data path: C:\Users\<username_obfuscated>\AppData\Roaming\Emby-Server\programdata
	Application path: C:\Users\<username_obfuscated>\AppData\Roaming\Emby-Server\system
	System.IO.IOException: System.IO.IOException: The filename, directory name, or volume label syntax is incorrect. : 'C:\Users\<username_obfuscated>\AppData\Roaming\Emby-Server\programdata\cache\tmdb-tv\8519\season-3-
  .json'
	   at Microsoft.Win32.SafeHandles.SafeFileHandle.CreateFile(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options)
	   at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize)
	   at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize)
	   at System.IO.Strategies.FileStreamHelpers.ChooseStrategy(FileStream fileStream, String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options, Int64 preallocationSize)
	   at System.IO.FileStream..ctor(String path, FileStreamOptions options)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.GetFileStream(String path, FileOpenMode mode, FileAccessMode access, FileShareMode share, Int32 bufferSize, FileOpenOptions fileOpenOptions, Int64 preAllocationSize)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.GetFileStream(String path, FileOpenMode mode, FileAccessMode access, FileOpenOptions fileOpenOptions)
	   at Emby.Common.Implementations.Serialization.JsonSerializer.SerializeToFile(Object obj, String file)
	   at MovieDb.MovieDbSeasonProvider.EnsureSeasonInfo(String tmdbId, Int32 seasonNumber, String language, String preferredMetadataCountry, IDirectoryService directoryService, CancellationToken cancellationToken)
	   at MovieDb.MovieDbSeasonProvider.GetMetadata(RemoteMetadataFetchOptions`1 options, CancellationToken cancellationToken)
	   at Emby.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, LibraryOptions libraryOptions, String logName, TIdType id, IEnumerable`1 providers, MetadataRefreshOptions options, CancellationToken cancellationToken)
	Source: System.Private.CoreLib
	TargetSite: Microsoft.Win32.SafeHandles.SafeFileHandle CreateFile(System.String, System.IO.FileMode, System.IO.FileAccess, System.IO.FileShare, System.IO.FileOptions)

I imagine the same language fix would be applied to the TMDB plugin and it may resolve these scanning loops once and for all. 

[seanbuff 1316]

@Luke this issue still exists with latest Beta and latest TMDB plugin (1.5.6) -- do you still plan to implement the language fix that resolved the TVDB errors?

Still suffering from endless scanni ng daily.

20220416_embyserver.txt

[Happy2Play 9780]

6 minutes ago, seanbuff said:

@Luke this issue still exists with latest Beta and latest TMDB plugin (1.5.6) -- do you still plan to implement the language fix that resolved the TVDB errors?

Still suffering from endless scanni ng daily.

20220416_embyserver.txt 91.53 kB · 0 downloads

Still have no idea how your system is not providing language.

&language=  &include_image_language=

But your TVDB is still broke also. @seanbuff

2022-04-16 18:38:05.285 Info HttpClient: GET https://api4.thetvdb.com/v4/series/84006/episodes/official/  ?page=0

 

Edited April 17, 2022 by Happy2Play

[seanbuff 1316]

23 minutes ago, Happy2Play said:

But your TVDB is still broke also

Interesting, however it's no longer producing the TVDB errors like it was previously. They have somehow been suppressed.

[Luke 42078]

There was no language fix made.

I think what's happening is you have an nfo file containing a custom language with a bad value in it.

[Happy2Play 9780]

Ah yes that makes since as you have other queries with language, can you post the nfo for those series. @seanbuff

\tmdb-tv\58557

\tmdb-tv\8519

But believe the fix would be applying language in the UI to these series or fixing nfo file is issue is seen.  As it appears specific to this items.

[seanbuff 1316]

1 hour ago, Happy2Play said:

Ah yes that makes since as you have other queries with language, can you post the nfo for those series.

Ah okay I see now. Yes both these series have an empty <language> tag, whereas others I have checked do not have this value at all.

  <language>
  </language>

It's interesting because I previously used the 'Identify' function to basically recreate this series, but it obviously didn't overwrite the existing NFO data from scratch.

58557_tvshow.nfo8519_tvshow.nfo

[Luke 42078]

Well regardless, identify would never change your language option.

[seanbuff 1316]

Also, I think this URL seems to be a problem too

  <episodeguide>
    <url cache="84006.xml">https://www.thetvdb.com/api/1D62F2F90030C444/series/84006/all/
  .zip</url>

 

[seanbuff 1316]

I have removed the <language> tag and fixed up the URL to include .../en.zip on one line

Let's see how that goes, as always thanks to both of you.

[Happy2Play 9780]

I remember now I had a similar issue with xml metadata from Media Center Master, but never ran into blank language.  But yes the broken <language> file should be your issue.

And with the log telling you the ids they are easy to track down.

Where these nfo files only touched/created by Emby?

[seanbuff 1316]

1 hour ago, Happy2Play said:

Where these nfo files only touched/created by Emby?

the nfo files yes, but considering they are both quite old series, they probably got converted from xml files that may have been created/touched externally

anyway, its looking good - no scans for hours now - thanks