Jump to content


Photo

TVDB Api Issues


Best Answer Luke , 19 November 2019 - 10:18 AM

Here's a patch to the tvdb plugin that works around the .zip.xml thing. Use at your own risk though because we don't know yet if the data coming back can be fully trusted at this point.

 

Edit: Tvdb plugin update 1.0.20 released.

 

See post 385

Go to the full post


  • Please log in to reply
413 replies to this topic

#1 TwIXx OFFLINE  

TwIXx

    Newbie

  • Members
  • 8 posts
  • Local time: 09:33 AM

Posted 02 August 2019 - 02:26 PM

Don't know the how much it will affect Emby but TVDB is having issues. So if you are having issues with TV Series/Episodes, this is more then likely the issue.

https://forums.thetv...p?f=122&t=60034

I know this is affecting Media Center Master. With a little testing in Emby I see Identify by TVDB id is failing here also.

#2 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 146246 posts
  • Local time: 03:33 AM

Posted 02 August 2019 - 02:29 PM

https://emby.media/c...3-tvdb-changes/



#3 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 17143 posts
  • Local time: 12:33 AM
  • LocationWashington State

Posted 14 November 2019 - 07:22 PM

Don't know the how much it will affect Emby but TVDB is having issues.  So if you are having issues with TV Series/Episodes, this is more then likely the issue.

 

https://forums.thetv...p?f=122&t=60034

 

I know this is affecting Media Center Master.  With a little testing in Emby I see Identify by TVDB id is failing here also.


Edited by Happy2Play, 14 November 2019 - 07:28 PM.


#4 Sammy OFFLINE  

Sammy

    Advanced Member

  • Members
  • 3163 posts
  • Local time: 12:33 AM

Posted 14 November 2019 - 07:25 PM

I noticed last night that the air date of all my TV Shows was yesterday's date (November 13, 2019). Related?



#5 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 17143 posts
  • Local time: 12:33 AM
  • LocationWashington State

Posted 14 November 2019 - 07:31 PM

I noticed last night that the air date of all my TV Shows was yesterday's date (November 13, 2019). Related?

??? Not sure as last night was November 13.  Unless we are referring to a time zone issue.



#6 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 17143 posts
  • Local time: 12:33 AM
  • LocationWashington State

Posted 14 November 2019 - 08:46 PM

v3 is Live!

 

Pinned this topic for a couple days.


Edited by Happy2Play, 14 November 2019 - 08:49 PM.

  • DarWun likes this

#7 DarWun OFFLINE  

DarWun

    Advanced Member

  • Members
  • 323 posts
  • Local time: 03:33 AM
  • LocationToronto, Ontario, Canada

Posted 14 November 2019 - 09:05 PM

Don't know the how much it will affect Emby but TVDB is having issues.  So if you are having issues with TV Series/Episodes, this is more then likely the issue.

 

https://forums.thetv...p?f=122&t=60034

 

I know this is affecting Media Center Master.  With a little testing in Emby I see Identify by TVDB id is failing here also.

 

Thanks for posting about this @Happy2Play. Three of the four shows that I added to my library tonight were not identified by AutoOrganize, and when I manually moved them to the proper folders no metadata was downloaded after scanning for new content. The title of an episode of one show did get identified correctly. But the metadata was incomplete and no images were downloaded. Now I know why.


Edited by DarWun, 14 November 2019 - 09:06 PM.


#8 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 17143 posts
  • Local time: 12:33 AM
  • LocationWashington State

Posted 14 November 2019 - 09:11 PM

This is just informational for anyone having issues.  Emby may have to make adjustments here but will have to wait on TVDB to resolve their issue.
 
The zip files come back broken.
 
5dcdf923887d8_test.jpg

2019-11-14 16:57:03.767 Info LibraryMonitor: The Mandalorian (2019) (C:\Users\Media\Desktop\Videos\TV Shows - nfo\The Mandalorian (2019)) will be refreshed.
2019-11-14 16:57:03.875 Info HttpClient: GET https://www.thetvdb.com/api/GetSeries.php?seriesname=The+Mandalorian+(2019)&language=en
2019-11-14 16:57:03.895 Info HttpClient: GET https://www.thetvdb.com/api/GetSeries.php?seriesname=The+Mandalorian&language=en
2019-11-14 16:57:03.914 Info HttpClient: GET https://www.thetvdb.com/api/B89CE93890E9419B/series/361753/all/en.zip
2019-11-14 16:57:03.935 Error App: Error in TheTVDB
	*** Error Report ***
	Version: 4.3.0.22
	Command line: C:\Users\Media\AppData\Roaming\Emby-Server\system\EmbyServer.dll -noautorunwebapp
	Operating system: Microsoft Windows NT 6.2.9200.0
	64-Bit OS: True
	64-Bit Process: True
	User Interactive: True
	Runtime: file:///C:/Users/Media/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll
	Processor count: 4
	Program data path: C:\Users\Media\AppData\Roaming\Emby-Server\programdata
	Application directory: C:\Users\Media\AppData\Roaming\Emby-Server\system
	System.IO.DirectoryNotFoundException: System.IO.DirectoryNotFoundException: Could not find a part of the path 'C:\Users\Media\AppData\Roaming\Emby-Server\programdata\cache\tvdb\361753'.
	   at System.IO.Enumeration.FileSystemEnumerator`1.CreateDirectoryHandle(String path, Boolean ignoreNotFound)
	   at System.IO.Enumeration.FileSystemEnumerator`1.Init()
	   at System.IO.Enumeration.FileSystemEnumerable`1..ctor(String directory, FindTransform transform, EnumerationOptions options, Boolean isNormalized)
	   at System.IO.Enumeration.FileSystemEnumerableFactory.UserFiles(String directory, String expression, EnumerationOptions options)
	   at System.IO.Directory.InternalEnumeratePaths(String path, String searchPattern, SearchTarget searchTarget, EnumerationOptions options)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.GetFilePaths(String path, String[] extensions, Boolean enableCaseSensitiveExtensions, Boolean recursive)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.GetFilePaths(String path, Boolean recursive)
	   at Tvdb.TvdbSeriesProvider.DownloadSeriesZip(String seriesId, String idType, String seriesName, Nullable`1 seriesYear, String seriesDataPath, Nullable`1 lastTvDbUpdateTime, String preferredMetadataLanguage, String saveAsMetadataLanguage, CancellationToken cancellationToken)
	   at Tvdb.TvdbSeriesProvider.DownloadSeriesZip(String seriesId, String idType, String seriesName, Nullable`1 seriesYear, String seriesDataPath, Nullable`1 lastTvDbUpdateTime, String preferredMetadataLanguage, CancellationToken cancellationToken)
	   at Tvdb.TvdbSeriesProvider.EnsureSeriesInfo(Dictionary`2 seriesProviderIds, String seriesName, Nullable`1 seriesYear, String preferredMetadataLanguage, CancellationToken cancellationToken)
	   at Tvdb.TvdbSeriesProvider.GetMetadata(SeriesInfo searchInfo, CancellationToken cancellationToken)
	   at MediaBrowser.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, String logName, TIdType id, IEnumerable`1 providers, CancellationToken cancellationToken)
	Source: System.IO.FileSystem
	TargetSite: IntPtr CreateDirectoryHandle(System.String, Boolean)

5dcdf96a57911_test2.jpg
 
 
@Luke I don't know if it really makes much difference but when when a Series is Refreshed the existing cached information is deleted (assume do the broken zips).   So all the exiting xml are deleted from "\programdata\cache\tvdb\266189\" in this example.


2019-11-14 17:08:23.544 Info HttpServer: HTTP Response 204 to ::1. Time: 2ms. http://localhost:8096/emby/Items/3278/Refresh?Recursive=true&ImageRefreshMode=FullRefresh&MetadataRefreshMode=FullRefresh&ReplaceAllImages=false&ReplaceAllMetadata=true
2019-11-14 17:08:23.651 Info HttpClient: GET https://www.thetvdb.com/api/B89CE93890E9419B/series/266189/all/en.zip
2019-11-14 17:08:24.096 Error App: Error in TheTVDB
	*** Error Report ***
	Version: 4.3.0.22
	Command line: C:\Users\Media\AppData\Roaming\Emby-Server\system\EmbyServer.dll -noautorunwebapp
	Operating system: Microsoft Windows NT 6.2.9200.0
	64-Bit OS: True
	64-Bit Process: True
	User Interactive: True
	Runtime: file:///C:/Users/Media/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll
	Processor count: 4
	Program data path: C:\Users\Media\AppData\Roaming\Emby-Server\programdata
	Application directory: C:\Users\Media\AppData\Roaming\Emby-Server\system
	System.IO.FileNotFoundException: System.IO.FileNotFoundException: Could not find file 'C:\Users\Media\AppData\Roaming\Emby-Server\programdata\cache\tvdb\266189\en.xml'.
	File name: 'C:\Users\Media\AppData\Roaming\Emby-Server\programdata\cache\tvdb\266189\en.xml'
	   at System.IO.FileStream.ValidateFileHandle(SafeFileHandle fileHandle)
	   at System.IO.FileStream.CreateFileOpenHandle(FileMode mode, FileShare share, FileOptions options)
	   at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.GetFileStream(String path, FileOpenMode mode, FileAccessMode access, FileShareMode share, FileOpenOptions fileOpenOptions)
	   at Emby.Server.Implementations.IO.ManagedFileSystem.GetFileStream(String path, FileOpenMode mode, FileAccessMode access, FileShareMode share, Boolean isAsync)
	   at Tvdb.TvdbSeriesProvider.ExtractEpisodes(String seriesDataPath, String xmlFile, Nullable`1 lastTvDbUpdateTime)
	   at Tvdb.TvdbSeriesProvider.DownloadSeriesZip(String seriesId, String idType, String seriesName, Nullable`1 seriesYear, String seriesDataPath, Nullable`1 lastTvDbUpdateTime, String preferredMetadataLanguage, String saveAsMetadataLanguage, CancellationToken cancellationToken)
	   at Tvdb.TvdbSeriesProvider.DownloadSeriesZip(String seriesId, String idType, String seriesName, Nullable`1 seriesYear, String seriesDataPath, Nullable`1 lastTvDbUpdateTime, String preferredMetadataLanguage, CancellationToken cancellationToken)
	   at Tvdb.TvdbSeriesProvider.EnsureSeriesInfo(Dictionary`2 seriesProviderIds, String seriesName, Nullable`1 seriesYear, String preferredMetadataLanguage, CancellationToken cancellationToken)
	   at Tvdb.TvdbSeriesProvider.GetMetadata(SeriesInfo searchInfo, CancellationToken cancellationToken)
	   at MediaBrowser.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, String logName, TIdType id, IEnumerable`1 providers, CancellationToken cancellationToken)
	Source: System.Private.CoreLib
	TargetSite: Microsoft.Win32.SafeHandles.SafeFileHandle ValidateFileHandle(Microsoft.Win32.SafeHandles.SafeFileHandle)

Additional Note this testing was done with only TVDB enabled via library settings.


Edited by Happy2Play, 14 November 2019 - 09:46 PM.

  • DarWun likes this

#9 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 17143 posts
  • Local time: 12:33 AM
  • LocationWashington State

Posted 14 November 2019 - 09:16 PM

Thanks for posting about this @Happy2Play. Three of the four shows that I added to my library tonight were not identified by AutoOrganize, and when I manually moved them to the proper folders no metadata was downloaded after scanning for new content. The title of an episode of one show did get identified correctly. But the metadata was incomplete and no images were downloaded. Now I know why.

Until they work out their issues the only alternative is possibly other fetchers available for the TV Library.  Then you will need to do a Refresh Search for missing metadata on series or episode.

 

I am not positive by I believe AutoOrganize is dependant on TVDB.


Edited by Happy2Play, 14 November 2019 - 09:46 PM.


#10 DarWun OFFLINE  

DarWun

    Advanced Member

  • Members
  • 323 posts
  • Local time: 03:33 AM
  • LocationToronto, Ontario, Canada

Posted 14 November 2019 - 09:28 PM

Until they work out their issues the only alternative is possibly other fetchers available for the TV Library.  Then you will need to do a Refresh Search for missing metadata on series or episode.

 

I'm playing around with that right now. Unaired and Unwatched virtual data are slowly disappearing for all of my shows at this point and shows in the upcoming TV GUI are being removed for watched series each time a recent episode is watched.



#11 DarWun OFFLINE  

DarWun

    Advanced Member

  • Members
  • 323 posts
  • Local time: 03:33 AM
  • LocationToronto, Ontario, Canada

Posted 14 November 2019 - 09:54 PM

I'm playing around with that right now. Unaired and Unwatched virtual data are slowly disappearing for all of my shows at this point and shows in the upcoming TV GUI are being removed for watched series each time a recent episode is watched.

 

And this was a bad decision...I should have waited it out. After switching the metadata provider from TVDB to the TMDB and rescanning the Upcoming shows list is now entirely empty. Virtual unaired and missing episodes have been deleted for all series. And Next Up does not display any recent episodes that are sitting in my library. Switching back to TVDB and rescanning does not fix the issue. I should have learned my lesson after TVDB was Fubarred the last time they tried to update their api.


Edited by DarWun, 14 November 2019 - 09:55 PM.


#12 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 17143 posts
  • Local time: 12:33 AM
  • LocationWashington State

Posted 14 November 2019 - 10:01 PM

And this was a bad decision...I should have waited it out. After switching the metadata provider from TVDB to the TMDB and rescanning the Upcoming shows list is now entirely empty. Virtual unaired and missing episodes have been deleted for all series. And Next Up does not display any recent episodes that are sitting in my library. Switching back to TVDB and rescanning does not fix the issue. I should have learned my lesson after TVDB was Fubarred the last time they tried to update their api.

From what I posted above, make since as a series refresh is nuking the cached data, all the future information is lost.  Just a guess but this would show our dependency of TVDB for the this information.

 

I am just guessing as I don't know if other providers cached data is used in any way.

 

As for Next Up I don't see how that would be affected as the item is in your library.  May need its own topic.  But I have yet to have this issue.


  • DarWun likes this

#13 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 146246 posts
  • Local time: 03:33 AM

Posted 14 November 2019 - 10:05 PM

Well that's great, thanks for the info. Hopefully it doesn't last too long.


  • StLDreiling and DarWun like this

#14 DarWun OFFLINE  

DarWun

    Advanced Member

  • Members
  • 323 posts
  • Local time: 03:33 AM
  • LocationToronto, Ontario, Canada

Posted 14 November 2019 - 10:19 PM

From what I posted above, make since as a series refresh is nuking the cached data, all the future information is lost.  Just a guess but this would show our dependency of TVDB for the this information.

 

I am just guessing as I don't know if other providers cached data is used in any way.

 

As for Next Up I don't see how that would be affected as the item is in your library.  May need its own topic.  But I have yet to have this issue.

 

From my experience, next up only displays new episodes if previously watched episodes are retained in the library. For recorded episodes of currently airing shows that I watch and then immediately delete, subsequently recorded episodes don't show up in the next up list if the option to show missing and unaired episodes is not selected. I thought this was by design so I never posted about it previously. I'll start a new topic about this issue if this is not the expected behavior.


Edited by DarWun, 14 November 2019 - 10:19 PM.


#15 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 17143 posts
  • Local time: 12:33 AM
  • LocationWashington State

Posted 14 November 2019 - 10:22 PM

I can see this being a issue depending on the providerids that are available with watched statuses as they are tracked by providerids.  If one is not available it gets recorded as a database id and can be lost.



#16 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 146246 posts
  • Local time: 03:33 AM

Posted 14 November 2019 - 11:24 PM

Have they said anything about it? I was hoping to release 4.3 tomorrow. Might not be able to do that now.

#17 Happy2Play OFFLINE  

Happy2Play

    Trial and Error

  • Moderators
  • 17143 posts
  • Local time: 12:33 AM
  • LocationWashington State

Posted 14 November 2019 - 11:27 PM

Have they said anything about it? I was hoping to release 4.3 tomorrow. Might not be able to do that now.

 

Technically the TVDB plugin has nothing to do with the release.  Or am I wrong about that?

 

Everyone is pretty much playing the waiting game, looking at their forum.  Some what following as it affect all software.


Edited by Happy2Play, 14 November 2019 - 11:30 PM.


#18 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 146246 posts
  • Local time: 03:33 AM

Posted 14 November 2019 - 11:38 PM

Nothing to do with it, but the timing would cause many to believe it's our fault. "Ever since I updated to 4.3...". And then they'll be rolling back, creating even more problems, getting more frustrated, etc.
  • StLDreiling likes this

#19 bangis OFFLINE  

bangis

    Member

  • Members
  • 24 posts
  • Local time: 04:33 PM

Posted 14 November 2019 - 11:41 PM

Can confirm none of the new shows/episodes I've added are getting metadata pulled. Using 4.2.1 on a QNAP NAS



#20 DarWun OFFLINE  

DarWun

    Advanced Member

  • Members
  • 323 posts
  • Local time: 03:33 AM
  • LocationToronto, Ontario, Canada

Posted 15 November 2019 - 12:28 AM

Nothing to do with it, but the timing would cause many to believe it's our fault. "Ever since I updated to 4.3...". And then they'll be rolling back, creating even more problems, getting more frustrated, etc.

 

@Luke FYI AutoOrganize failed for one of the shows I recorded tonight (The Good Place - S04E08). But when I manually copied it to the right season and series folder and scanned the library, metadata was scraped from tvdb that matched the episode. Unaired, missing episodes, upcoming tv, and next up issues I reported about still persist. But metadata scraping for new episodes kind of seems to work.

 

If I understand things correctly, users are going to start seeing issues related to the recent TVDB updates on current stable and beta versions of Emby. If you push the 4.3 update, they may assume that the issue is Emby related. If you don't, they will still post to ask about issues with TVDB. Either way you are stuck having to explain that the problem is not "Emby's fault".


Edited by DarWun, 15 November 2019 - 12:54 AM.

  • Starlionblue and Spotta like this




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users