Issue with missing episodes

[HawkXP71 99]

I realize there are high level issues with the virtual missing episodes, and this bug may fall under that.

South Park has started the new season. However, my system is not showing Episode 1 or 2 as missing.

Im not sure which DB the show list comes from, whether its from themoviedb or thetvdb

But themoviedb.com has season 26 episodes 1 and 2 https://www.themoviedb.org/tv/2190-south-park/season/26

as does thetvdb.com https://thetvdb.com/series/south-park/seasons/official/26

It seems to be the only show having a problem, my other shows do show the missing episodes (though it is hard to prove its missing, unless I know the new episode is out).  

Since mid season shows are starting up, I happen to notice this for my boys from South Park.

I can attach a log, but Im not sure when the "missing" list is updated, so I wouldnt know what to run to trigger the update.

TIA

 

[GrimReaper 3330]

It can take up to 24hrs for the providers to update cache and reflect changes, maybe they just haven't been propagated yet.

[HawkXP71 99]

1 minute ago, GrimReaper said:

It can take up to 24hrs for the providers to update cache and reflect changes, maybe they just haven't been propagated yet.

Which providers are used for this?

Can you tell me what I need to do on the server (which scheduled task, if its a task) to kick off the process?

[GrimReaper 3330]

Tbh have no idea as I've never had Missing episodes enabled in my collection, maybe @Happy2Play would know more.

[HawkXP71 99]

1 minute ago, GrimReaper said:

Tbh have no idea as I've never had Missing episodes enabled in my collection, maybe @Happy2Play would know more.

Thanks!

[Happy2Play 8351]

Missing only come from TVDB and looks as the episode was created 23 Jan Emby should of gotten an update from TVDB by new for the show but you would have to check the cache folder for tvdb serieid folder with json file for series.

Normally Upcoming has everything for about a week out unless the issue is TVDB api.

Just checked my test system as I have Show on it and have this

[HawkXP71 99]

On 2/9/2023 at 1:34 PM, Happy2Play said:

Missing only come from TVDB and looks as the episode was created 23 Jan Emby should of gotten an update from TVDB by new for the show but you would have to check the cache folder for tvdb serieid folder with json file for series.

Normally Upcoming has everything for about a week out unless the issue is TVDB api.

Just checked my test system as I have Show on it and have this

So what is the best way to debug this, and figure out what is going on?  Only the video I added is showing up
 

Edited February 15, 2023 by HawkXP71

[Happy2Play 8351]

7 minutes ago, HawkXP71 said:

So what is the best way to debug this, and figure out what is going on?  Only the video I added is showing up

There are two setting one in library setup and one in User Display.

Display missing episodes within seasons
If enabled, information about missing episodes will be imported into your Emby database and displayed within seasons and series. This may cause significantly longer library scans.


Display missing episodes within seasons
This must also be enabled for TV libraries in Emby Server setup.

What are you provider setting on the library for Series and Episode?

[HawkXP71 99]

On 2/9/2023 at 3:16 PM, Happy2Play said:

There are two setting one in library setup and one in User Display.

Display missing episodes within seasons
If enabled, information about missing episodes will be imported into your Emby database and displayed within seasons and series. This may cause significantly longer library scans.


Display missing episodes within seasons
This must also be enabled for TV libraries in Emby Server setup.

What are you provider setting on the library for Series and Episode?

Both are enabled.

 

 

 

Edited February 15, 2023 by HawkXP71

[Happy2Play 8351]

And you provider setting?

[HawkXP71 99]

On 2/9/2023 at 3:16 PM, Happy2Play said:

There are two setting one in library setup and one in User Display.

Display missing episodes within seasons
If enabled, information about missing episodes will be imported into your Emby database and displayed within seasons and series. This may cause significantly longer library scans.


Display missing episodes within seasons
This must also be enabled for TV libraries in Emby Server setup.

What are you provider setting on the library for Series and Episode?

Im not quite sure what you mean by provider settings.

for the library the episode and series metadata downloaders are here

Edited February 15, 2023 by HawkXP71

[HawkXP71 99]

Though it does look strange that th Season MetaData Downloaders only has TheMovieDB and no other options

[Happy2Play 8351]

2 minutes ago, HawkXP71 said:

Though it does look strange that th Season MetaData Downloaders only has TheMovieDB and no other options

Originally they were the only provider, but Luke needs to update TVDB plugin as they have them also occasionally.

But minus errors in your log there is nothing else to do.  I guess you can try a Refresh Search for missing the Show.

Depends on how many shows you follow does you Upcoming Section show the 15th?

 

[HawkXP71 99]

2 minutes ago, Happy2Play said:

Originally they were the only provider, but Luke needs to update TVDB plugin as they have them also occasionally.

But minus errors in your log there is nothing else to do.  I guess you can try a Refresh Search for missing the Show.

Depends on how many shows you follow does you Upcoming Section show the 15th?

 

It does not.  It only showing Star Wars - The Bad Batch, so its definitely working (unless it stopped working and everything I am seeing is from a cache).

How do I "refresh search for the missing show"?    

I did have a server crash about 2 weeks ago, so its possible something didnt restore properly.

I saw one error that looks possible
 

023-02-08 23:01:20.504 Info Server: http/1.1 POST http://host1:18069/emby/Users/authenticatebyname?X-Emby-Client=Emby%20Web&X-Emby-Device-Name=Chrome%20Windows&X-Emby-Device-Id=0772a268-03ba-409b-8c40-3aa2d9062505&X-Emby-Client-Version=4.7.11.0&X-Emby-Language=en-us. Accept=application/json, Connection=keep-alive, Host=mediabox:18069, User-Agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/110.0.0.0 Safari/537.36, Accept-Encoding=gzip, deflate, Accept-Language=en-US,en;q=0.9, Content-Type=application/x-www-form-urlencoded; charset=UTF-8, Origin=http://mediabox:18069, Referer=http://mediabox:18069/web/index.html, Content-Length=14, DNT=1
2023-02-08 23:01:20.535 Error UserManager: Error authenticating with provider Default
	*** Error Report ***
	Version: 4.7.11.0
	Command line: /volume2/@appstore/EmbyServer/system/EmbyServer.dll -programdata /var/packages/EmbyServer/var -ffdetect /var/packages/EmbyServer/target/bin/ffdetect -ffmpeg /var/packages/EmbyServer/target/bin/ffmpeg -ffprobe /var/packages/EmbyServer/target/bin/ffprobe -nolocalportconfig -ignore_vaapi_enabled_flag -pidfile /var/packages/EmbyServer/var/EmbyServer.pid -defaultdirectory /volume1/Public -updatepackage emby-server-synology7_{version}_x86_64.spk -noautorunwebapp
	Operating system: Linux version 4.4.180+ (root@build2) (gcc version 8.5.0 (GCC) ) #42962 SMP Tue Oct 18 15:07:03 CST 2022
	Framework: .NET 6.0.8
	OS/Process: x64/x64
	Runtime: volume2/@appstore/EmbyServer/system/System.Private.CoreLib.dll
	Processor count: 4
	Data path: /var/packages/EmbyServer/var
	Application path: /volume2/@appstore/EmbyServer/system
	System.Exception: System.Exception: Invalid username or password..
	   at Emby.Server.Implementations.Library.DefaultAuthenticationProvider.Authenticate(String username, String password, User resolvedUser)
	   at Emby.Server.Implementations.Library.UserManager.AuthenticateWithProvider(IAuthenticationProvider provider, String username, String password, User resolvedUser, CancellationToken cancellationToken)
	Source: Emby.Server.Implementations
	TargetSite: System.Threading.Tasks.Task`1[MediaBrowser.Controller.Authentication.ProviderAuthenticationResult] Authenticate(System.String, System.String, MediaBrowser.Controller.Entities.User)
	

Only because of the "program data" switch does it look interesting to me...

[Happy2Play 8351]

3 minutes ago, HawkXP71 said:

How do I "refresh search for the missing show"? 

Click on South Park series and Refresh / Search for Missing.

User authentication should be irrelevant.

When you click on an Upcoming episode does it show all future/unaired episode?

Only guess would be do you have LOCKED metadata on the Series?

[HawkXP71 99]

16 minutes ago, Happy2Play said:

Click on South Park series and Refresh / Search for Missing.

User authentication should be irrelevant.

When you click on an Upcoming episode does it show all future/unaired episode?

 

Only guess would be do you have LOCKED metadata on the Series?

I assume you mean the following?  If so, I just kicked it off. I rotated the log before hand, so once it finishes, Ill update the log to see if there is anything of concern.

[Happy2Play 8351]

1 minute ago, HawkXP71 said:

I assume you mean the following?

Yes

Can you look in your Emby cache\tvdb\75897 folder at the episode json file at the bottom.

beatified the flattened json file.

        }, {
            "id": 9573976,
            "seriesId": 75897,
            "name": "Cupid Ye",
            "aired": "2023-02-08",
            "runtime": 22,
            "overview": "Cartman is jealous of the friendship that’s developed between Kyle and Tolkien and decides to do something about it.",
            "image": "/banners/v4/episode/9573976/screencap/63e440e4e3ab5.jpg",
            "imageType": 11,
            "isMovie": 0,
            "number": 1,
            "seasonNumber": 26,
            "lastUpdated": "2023-02-09 17:46:52"
        }, {
            "id": 9600695,
            "seriesId": 75897,
            "name": "TBA ",
            "aired": "2023-02-15",
            "runtime": 22,
            "isMovie": 0,
            "number": 2,
            "seasonNumber": 26,
            "lastUpdated": "2023-02-09 17:47:50"
        }

 

[Happy2Play 8351]

But this could be an api cache issue as they have a lastupdated of today.

[Happy2Play 8351]

Last resort would be deleting the \cache\tvdb folder and do a library scan to get cache files again.  But if their api is not returning updated info for you then it may be a matter of waiting. 

But pulling directly from their Swagger returns correct info, same as what I get in Emby.  Would assume you get the same cache as I do here in the Northwest.

 

[HawkXP71 99]

Just now, Happy2Play said:

But this could be an api cache issue as they have a lastupdated of today.

 

5 minutes ago, Happy2Play said:

Yes

Can you look in your Emby cache\tvdb\75897 folder at the episode json file at the bottom.

beatified the flattened json file.

        }, {
            "id": 9573976,
            "seriesId": 75897,
            "name": "Cupid Ye",
            "aired": "2023-02-08",
            "runtime": 22,
            "overview": "Cartman is jealous of the friendship that’s developed between Kyle and Tolkien and decides to do something about it.",
            "image": "/banners/v4/episode/9573976/screencap/63e440e4e3ab5.jpg",
            "imageType": 11,
            "isMovie": 0,
            "number": 1,
            "seasonNumber": 26,
            "lastUpdated": "2023-02-09 17:46:52"
        }, {
            "id": 9600695,
            "seriesId": 75897,
            "name": "TBA ",
            "aired": "2023-02-15",
            "runtime": 22,
            "isMovie": 0,
            "number": 2,
            "seasonNumber": 26,
            "lastUpdated": "2023-02-09 17:47:50"
        }

 

 

3 minutes ago, Happy2Play said:

But this could be an api cache issue as they have a lastupdated of today.

I dont have an episodes.json, I do have episodes-official.json, episodes-official-eng.json and seasons.json

Season 26 is showing up in the seasons.json

        {
            "id": 2043040,
            "seriesId": 75897,
            "type": {
                "id": 1,
                "name": "Aired Order",
                "type": "official"
            },
            "number": 26,
            "nameTranslations": [],
            "overviewTranslations": [],
            "image": "https://artworks.thetvdb.com/banners/v4/season/2043040/posters/63d4a430131fb.jpg",
            "imageType": 7,
            "companies": [
                {
                    "id": 0,
                    "primaryCompanyType": 0
                }
            ]
        },

And interesting enough, the episodes-official-eng.json and episodes-official.json both include the missing episode, 

        {
            "id": 9573976,
            "seriesId": 75897,
            "name": "Cupid Ye",
            "aired": "2023-02-08",
            "runtime": 22,
            "overview": "Cartman is jealous of the friendship that’s developed between Kyle and Tolkien and decides to do something about it.",
            "image": "/banners/v4/episode/9573976/screencap/63e440e4e3ab5.jpg",
            "imageType": 11,
            "isMovie": 0,
            "number": 1,
            "seasonNumber": 26,
            "lastUpdated": "2023-02-09 09:37:39"
        },
        {
            "id": 9600695,
            "seriesId": 75897,
            "name": "TBA ",
            "aired": "2023-02-15",
            "runtime": 22,
            "isMovie": 0,
            "number": 2,
            "seasonNumber": 26,
            "lastUpdated": "2023-02-09 09:37:54"
        }

The only difference between the official and official-eng is the location of the image

 

[HawkXP71 99]

And Im still waiting on the refresh to finish. no errors so far, and only 2 calls to the thetvdb.com 

2023-02-09 16:06:40.565 Info HttpClient: POST https://api4.thetvdb.com/v4/login
2023-02-09 16:06:40.712 Info HttpClient: GET https://api4.thetvdb.com/v4/series/75897/extended?meta=translations

No response information at all

[HawkXP71 99]

One thing I just noticed.

For season 25, the metainfo contains a TVDB id, but Season 26 does not

[Happy2Play 8351]

You won't see anything else as Emby gets everything in one pull and process everything from that json file behind the scenes.

But everything appears to be correct so I am not sure why you are not seeing this info in the UI especially if it is only on one show.

4 minutes ago, HawkXP71 said:

One thing I just noticed.

For season 25, the metainfo contains a TVDB id, but Season 26 does not

I can say I am seeing the same thing for season number.

[HawkXP71 99]

It finished, even putting in the thetvdb.com tvdbid explicitly, no joy

 

Ive attached 2 log files, the first was the refresh on the series, then explicitly editing in the tvdbid

The second is just a refresh of the season. with debug info turned on

embyserver - Including Edit.txt embyserver - post, refresh debug.txt

[HawkXP71 99]

3 minutes ago, Happy2Play said:

You won't see anything else as Emby gets everything in one pull and process everything from that json file behind the scenes.

But everything appears to be correct so I am not sure why you are not seeing this info in the UI especially if it is only on one show.

I can say I am seeing the same thing for season number.

Hmm. so it almost sounds like we are stuck   BTW, Im seeing this on two different servers.
Im running 4.7.11.0 (not the beta) in case that matters