What to do when IMDB/themoviedb/thetvdb have different metadata?

[Roger Graham 6]

Hi all, like many people I am struggling with Money Heist, and it seems that the answer is just to manually create the metadata and lock it down.

But in getting to this stage, I see that IMDB, themoviedb and thetvdb have different metadata for this series.  IMDB has a five-season structure (presumably, soon to be six seasons), whereas the other two have the "correct"/original three-season structure.

I tried to change the metadata at the series level to only use one provider, and then set up my folders/episodes to match that provider's season/episode structure.  However, Emby just re-populates the other two providers, which presumably contributes to it not being able to interpret the folder structure properly (which seems to be an additional issue to the Original-vs-Netflix mess with this series).  So, I can't solve the Money Heist problem by matching my season/episode structure to that of a single metadata provider.

Am I missing something?  *Is* there a way to choose just one metadata provider for a specific series?  

[GrimReaper 4740]

Yep, that one's always gona be messy (Thanks, Netflix!).

Emby does not scrape anything from IMDB, so that one's out of the picture. 

As for the other two (TVDB, TMDB), they list several episode orders:

https://thetvdb.com/series/la-casa-de-papel

https://www.themoviedb.org/tv/71446-la-casa-de-papel/episode_groups

On either of them you can get only default, Aired order (i.e. original one), as there is no support for TVDB Netflix order (albeit have no idea how is it now with TVDB v4 API) and TMDB Episode Groups are not supported. 

Not knowing your folder structure nor which order you actually have nor your preferred scraper, hard to estimate further. 

To go back to your query:

1 hour ago, Roger Graham said:

*Is* there a way to choose just one metadata provider for a specific series?

Yes, in your Library settings leave enabled only one meta-scraper of your choice and Refresh Metadata, that will prevent Emby to scrape missing info from the others. Once scraped, lock the item and revert settings to desired fetcher order. 

[Roger Graham 6]

Thank you, I should have thought of that! 

So, I restricted my TV Shows library to just thetvdb, which displays the as-aired structure of Season1 (15 episodes) / Season 2 (16 episodes) / Season 3 (to be 10 episodes), which matches my files.  Emby seems to get Season 1 right, but it gets stuck after Episode 6 in Season 2.  That makes me think that it is somehow referencing the 6-episode Part 2 of Season 1, even though thetvdb doesn't reflect that.  I have previously tried splitting Season 1's 15 episodes into Season 1 (9 episodes) and Season 2 (6 episodes), but that doesn't work either.  So, I guess I will be manually updating everything!

You note that thetvdb and themoviedb have several episode orders, but that we can only get the default Aired order; do you know how that works? 

I guess a related question is, what does the Aired/Absolute/DVD "Display order" metadata setting do - is it merely a display thing, or does it also affect the scraping somehow?

[Roger Graham 6]

Also, sorry:

Do you know why there are choices of Series and Episode metadata providers, but not for Season metadata, which only allows TheMovieDB?   

Will that cause problems if I choose TheTVDB for Series and Episode metadata, whilst only TheMovieDB is available for Season metadata?  Can that be contributing to the confusion with this series?

TheMovieDB shows Exhibition Order, Original Parts, Parts (edited version) and Season (edited version).  Do you know how I can tell which one of these options Emby is scraping?
 

 

[GrimReaper 4740]

6 minutes ago, Roger Graham said:

Emby seems to get Season 1 right, but it gets stuck after Episode 6 in Season 2.  That makes me think that it is somehow referencing the 6-episode Part 2 of Season 1, even though thetvdb doesn't reflect that.  I have previously tried splitting Season 1's 15 episodes into Season 1 (9 episodes) and Season 2 (6 episodes), but that doesn't work either.  So, I guess I will be manually updating everything!

Hm, it should not, as Aired order is the only one you'll get from TVDB, if you have your files named accordingly it should scrape them all. Can we have a look at your folder structure?

Alternatively, leave only TMDB meta-fetcher (disable TVDB) and Re-scrape. 

7 minutes ago, Roger Graham said:

You note that thetvdb and themoviedb have several episode orders, but that we can only get the default Aired order; do you know how that works? 

Exactly as said, you'll get those by default. 

 

8 minutes ago, Roger Graham said:

I guess a related question is, what does the Aired/Absolute/DVD "Display order" metadata setting do - is it merely a display thing, or does it also affect the scraping somehow?

If TVDB has those orders listed, like here:

https://thetvdb.com/series/battlestar-galactica-2003

and if your files are named accordingly, once you change that and Refresh Metadata, you'll get that order scraped. 

[GrimReaper 4740]

7 minutes ago, Roger Graham said:

Do you know why there are choices of Series and Episode metadata providers, but not for Season metadata, which only allows TheMovieDB?

Scrapers offer different capabilities, some have this, some have that, they don't necessarily provide same data. 

 

7 minutes ago, Roger Graham said:

Will that cause problems if I choose TheTVDB for Series and Episode metadata, whilst only TheMovieDB is available for Season metadata?  Can that be contributing to the confusion with this series?

Nope, it should not, and I reckon that is the most common setup amongst users. 

 

7 minutes ago, Roger Graham said:

TheMovieDB shows Exhibition Order, Original Parts, Parts (edited version) and Season (edited version).  Do you know how I can tell which one of these options Emby is scraping?

TMDB Episode Groups are not supported (there's an open FR for that) hence you always get default one, which in case of Money Heist is Original Air Date, as visible on main page. 

Edited October 6, 2021 by GrimReaper
Typo

[Roger Graham 6]

Thanks you for the replies.  Here's my folder structure (before refreshing), the Emby library settings, and what I see in Season 2 (after refreshing):

[Roger Graham 6]

I should add that for Season 2, ep1-6 seem OK, ep7 is blank, ep8-9 look OK again, then ep10-16 are blank.  

[GrimReaper 4740]

OK, two things to test, first:

Disable NFO Metadata reader, Refresh Metadata>Replace all. 

[Roger Graham 6]

I made that change, then (unnecessary belts and braces I guess) manually deleted all of the .nfo and .jpg files in the various folders, then did a Refresh Metadata > Replace all metadata / Replace existing images, and... got the same result!  It seems a bit strange that ep8-9 populate, but the rest don't.

If you're running out of ideas, then I thank you for the help!  I'm happy to just fill the remaining data in manually.

[Roger Graham 6]

Hmm... I see that it has created .nfo files for those "missing" episodes, but is not showing the data.  For exampl e, for ep10:

Money Heist S02E10 Berlin's Wedding.nfo

[GrimReaper 4740]

Might be a TVDB API quirk, let's do one more thing, you can always revert and fill manually later:

Untick TVDB and tick TMDB in Library settings, with NFO reader still disabled, Refresh>Replace all. 

 

[GrimReaper 4740]

1 minute ago, Roger Graham said:

Hmm... I see that it has created .nfo files for those "missing" episodes, but is not showing the data.  For exampl e, for ep10:

Money Heist S02E10 Berlin's Wedding.nfo 1.97 kB · 0 downloads

Yeah, as you have NFO saver enabled, doesn't make a difference with reader disabled, leave it for now. 

[Roger Graham 6]

OK, the Series/Season/Episode metadata downloaders are all set to TheMovieDb. 

It seems to be a Season 02 issue.  After making that change, it is showing the much-more extensive episode notes for Season 1 from TheMovieDB, but everything is the same as it was for Season 02, even though I again physically deleted all nfo/jpg files before the refresh-all.  It's odd, because even though TMDB splits the first season into the 9episode-Part1 and the 6episode-Part2, but it has correctly updated all of my 15episode-Season 01. And yet, again, it only gets the episodes 1-6,8-9 correct for season 02.  Which kinda-sorta implies that it's a problem on the Emby side? 

Just on a whim, I left Season 01 as it is, but re-structured the 16-episode Season 02 to match the TMDB structure as 8-episode Part 3 (in a folder "Season 03") and 8-episode Part 4 (in a folder "Season 04"), but that was even worse!

[GrimReaper 4740]

7 minutes ago, Roger Graham said:

Just on a whim, I left Season 01 as it is, but re-structured the 16-episode Season 02 to match the TMDB structure as 8-episode Part 3 (in a folder "Season 03") and 8-episode Part 4 (in a folder "Season 04"), but that was even worse!

Nah, this is the order that should've been returned, no split-seasons:

https://www.themoviedb.org/tv/71446-la-casa-de-papel/seasons

Rename back to original. Maybe the db is holding onto some data, you can try removing that folder from your TV Shows parent, run Scan media library task (to clear db), put it back, Scan media library again, all with current settings as you have them now, see what gives. 

[Roger Graham 6]

No worries.  Earlier, I tried moving the folder / deleting the series in Emby / moving the folder back / scanning again, to no avail.

Thanks for the help, and worst case I'll just manually fill in the missing details.

[GrimReaper 4740]

Yeah, you can always fill those few episodes metadata manually, I'm just curious why it ain't scraping correctly, as your folder structure and naming convention appear in order, I have them named exactly the same (except folder with single year), except scraped externally via 3rd-party app. 

@Happy2Play, any ideas? 

[Roger Graham 6]

Even after completely deleting that folder and recreating it then refreshing etc, my Season 02 still only recognises episodes 1-6 and 8-9, even though the reconstructed nfo files for the "missing" episodes look exactly the same as the not-missing episodes, and have at least some correct episode-specific information such as the <plot> data.

Then again, the Season2 nfos look different from the Season 1 nfos.  The Season 1 nfos have lots of extra tags like director, rating, year, imbdib, tvdbid, runtime, episode, season, aired, fileinfo/streamdetails/video-audio-subtitle-embeddedimage.  I've attached a Season 1 nfo and a few Season 2 nfos, including a mix of "working" and "missing" Season 2 episodes.

So:

1. something odd is happening with the Season 2 nfos, but...
2. even so, why would only some of those episodes be displayed as "missing", given that the Season 2 nfos all seem to have the same structure as each other?  It seems noteworthy that it's the same Season 2 episodes that aren't being recognised, even after completely deleting/reinstating the series folders

I know Money Heist is an odd duck, but I wonder if the behaviour I'm seeing may be pointing to an issue with Emby's scraping/storing/displaying of episode data?
 

Money Heist S02E08 Astray.nfo Money Heist S02E09 Game Over.nfo Money Heist S02E10 Berlin's Wedding.nfo Money Heist S02E06 Everything Seemed Insignificant.nfo Money Heist S02E07 A Quick Vacation.nfo Money Heist S01E01.nfo

[GrimReaper 4740]

No, all those nfos are okay, those "missing" ones also have all the necessary data, just checked E07 and E10. 

Do you maybe have some of those locked (although they shouldn't be if they're new items), Edit Metadata on any missing episode and check are there green-backgrounded padlocks or Lock item (scroll all the way down) is enabled? 

 

[GrimReaper 4740]

Next test:

DON'T delete any NFOs. Disable all meta-fetchers and reenable only NFO reader. Refresh metadata>Replace all on Season 2.

[Happy2Play 9780]

Did not ready everything, but currently there is only one order for this series that Emby gets, Aired.  The Netflix/Alternate order is only available in v4 api but has not been added yet as it requires a server core update to add the addition options.  Display order only applies to TVDB at this time.  And there is only one order available, Aired, currently.

So manual editing is required for anything besides aired order at this time.

But Missing usually means a conflict with the virtual missing and the added real item.  As there are many quirks in this Missing Episode option that Luke would like to get rid of.

If you enter the item that show Missings is it playable?  Does it have a Split apart option in Media Info section?

Have you tried removing the entire series, doing a library scan and re-adding?

[rbjtech 5284]

Yep - Money Heist is a pig to get correct - as none of the metadata providers appear to have got this correct ..

Part 1 & Part 2 (in 'Netflix' terms) are the tricky ones - as Netflix have actually sliced the original episodes.  

Part 3,4 & 5 should not be an issue.

I ended up creating Parts 1 & 2 manually, using the metadata and images directly from Netflix themselves - and then lock the entire thing !

 

 

 

[GrimReaper 4740]

1 minute ago, rbjtech said:

Yep - Money Heist is a pig to get correct - as none of the metadata providers appear to have got this correct ..

Part 1 & Part 2 (in 'Netflix' terms) are the tricky ones - as Netflix have actually sliced the original episodes.  

Part 3,4 & 5 should not be an issue.

I ended up creating Parts 1 & 2 manually, using the metadata and images directly from Netflix themselves - and then lock the entire thing !

 

 

 

Nah, OP has them in Original Air Order, it's all ok, his folder structure is correct, they DO scrape correctly but DO NOT display correctly for several Season 2 episodes. Emby-created NFO had all the correct data written - but not displayed in the UI. 

[rbjtech 5284]

I bet they are NAMED in the original order, but I'd put money on it (no pun intended) that they are actually the NETFLIX versions - in which case, what the file names say is INCORRECT - and this is the root of the problems ...

[GrimReaper 4740]

18 minutes ago, Happy2Play said:

Have you tried removing the entire series, doing a library scan and re-adding?

Yep, he did:

10 hours ago, GrimReaper said:

try removing that folder from your TV Shows parent, run Scan media library task (to clear db), put it back, Scan media library again

Also, tried with TVDB only, then with TMDB only, now we'll see result with NFO only, reading back, all meta-scrapers disabled. 

Same Seadon 2 episodes are in question ij every variation: S02E07 and S02E10+. Might have something with virtual episodes ss you've said, althought that should've been cleared.