Refresh all metadata with Emby 4.x

[Bazzu85 21]

2 minutes ago, rodainas said:

I assume you changed it back to show the configuration where the problem originated, I know you are aware that if you do a scan to add the anime again with tvdb as first priority, the problem will probably repeat (as no imdb id by provider), unless you are trying to reproduce the problem and trying to fix again changing provider and refreshing.

I reverted back the configuration to the start situation: Show with episode grabbed from tvdb and without imdb id.

When I reported the problem in post 

the configuration differed only in the provider order.

themoviedb was putted on top of themoviedb.

I tested that the info after that was grabbed from themoviedb because the episode title was different, but the external id section was not touched.

to test in every environment:

- add to the library the episode 4x19 of seven deadly sins grabbing the info from thetvdb

- check the external id metadata to be sure that there's only thetvdb id and not imdb

- change the provider order in library

- identify the show pulling the info from themoviedb

- check that the external id section is not changed

try yourself..

[Carlo 4330]

Hi, but isn't the meta-data providers only going to be used for new media (after changing settings)?  If it has already been IDed by one provider in the past that is what it will use moving forward?

I would try removing this media from the library and doing a rescan.  Then remove any NFO file if present and add back to the library so it will be found as new media.

Now, how does it look?

Edited July 19, 2021 by cayars

[rodainas 188]

Thats what I am thinking too, it looks like it is already id at database level, the easier thing to do is a rescan to reset it.

[Bazzu85 21]

7 minutes ago, cayars said:

Hi, but isn't the meta-data providers only going to be used for new media?  If it has already been IDed by one provider in the past that is what it will use moving forward?

I would try removing this media from the library and doing a rescan.  Then remove any NFO file if present and add back to the library so it will be found as new media.

Now, how does it look?

I can follow your arguments, but what you say about the episode title?

Identifying with a different provider order, grabbed the correct title from the new top position provider.. why this thing is not happening for the external id's?

 

Edited July 19, 2021 by Bazzu85

[rodainas 188]

We assume you dont use nfo files right?

[rodainas 188]

I could reproduce the problem from scratch.

Using tvdb as the first provider, S04E19, then using themoviedb as first and only provider for series, season and episode data.

Results:

Episode metadata doesnt change, no imdb id.

 

Doing an scan from scratch with the moviedb, and no imdb id, the problem appears to be coming from the provider and not an emby matter.

 

 

And this is one of the reasons I prefer to scrape my library with a third party program before adding to emby (more control on the information am getting, customizables languages by field, different ratings including imdb, etc.).

 

 

 

Edited July 19, 2021 by rodainas

[Bazzu85 21]

2 hours ago, rodainas said:

We assume you dont use nfo files right?

Correct..

[Bazzu85 21]

2 hours ago, rodainas said:

I could reproduce the problem from scratch.

Using tvdb as the first provider, S04E19, then using themoviedb as first and only provider for series, season and episode data.

Results:

Episode metadata doesnt change, no imdb id.

 

Doing an scan from scratch with the moviedb, and no imdb id, the problem appears to be coming from the provider and not an emby matter.

 

 

And this is one of the reasons I prefer to scrape my library with a third party program before adding to emby (more control on the information am getting, customizables languages by field, different ratings including imdb, etc.).

 

 

 

Thx for taking time testing this situation.

Assuming the last situation (scrap from scratch). How can we be sure that's a api problem (themoviedb so) or emby side?

How can I test the api with this episode? Checking the json content can tell who is bugging..

[rodainas 188]

1 minute ago, Bazzu85 said:

Thx for taking time testing this situation.

Assuming the last situation (scrap from scratch). How can we be sure that's a api problem (themoviedb so) or emby side?

How can I test the api with this episode? Checking the json content can tell who is bugging..

To be as sure as possible,

Use a third party scraper like Tiny Media Manager and use themoviedb as default scraper for TVShows.

[rodainas 188]

Tried myself.

Still not getting imdb id for episode using TMM and themoviedb as provider

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<!--created on 2021-07-19 11:07:48 - tinyMediaManager 3.1.15-->
<episodedetails>
  <title>The Struggle</title>
  <originaltitle/>
  <showtitle>The Seven Deadly Sins</showtitle>
  <season>4</season>
  <episode>19</episode>
  <displayseason>-1</displayseason>
  <displayepisode>-1</displayepisode>
  <id/>
  <uniqueid default="true" type="tmdb">2907410</uniqueid>
  <ratings>
    <rating default="true" max="10" name="tmdb">
      <value>8.0</value>
      <votes>1</votes>
    </rating>
  </ratings>

 

 

It only appears as tvshow level:

 

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<!--created on 2021-07-19 10:57:26 - tinyMediaManager 3.1.15-->
<tvshow>
  <title>The Seven Deadly Sins</title>
  <originaltitle>七つの大罪</originaltitle>
  <showtitle>The Seven Deadly Sins</showtitle>
  <sorttitle/>
  <year>2014</year>
  <ratings>
    <rating default="true" max="10" name="tmdb">
      <value>8.6</value>
      <votes>3725</votes>
    </rating>
  </ratings>
  <userrating>0.0</userrating>
  <outline/>
  <plot>The “Seven Deadly Sins”—a group of evil knights who conspired to overthrow the kingdom of Britannia—were said to have been eradicated by the Holy Knights, although some claim that they still live. Ten years later, the Holy Knights have staged a Coup d'état and assassinated the king, becoming the new, tyrannical rulers of the kingdom. Elizabeth, the king's only daughter, sets out on a journey to find the “Seven Deadly Sins,” and to enlist their help in taking back the kingdom.</plot>
  <tagline/>
  <runtime>24</runtime>
  <namedseason number="0">Specials</namedseason>
  <namedseason number="1">The Seven Deadly Sins</namedseason>
  <namedseason number="2">Revival of the Commandments</namedseason>
  <namedseason number="3">Wrath of the Gods</namedseason>
  <namedseason number="4">Dragon’s Judgement</namedseason>
  <fanart/>
  <mpaa>TV-14</mpaa>
  <certification>US:TV-14</certification>
  <episodeguide>
    <url cache="auth.json" post="yes">https://api.thetvdb.com/login?{"apikey":"439DFEBA9D3059C6","id":284131}|Content-Type=application/json</url>
  </episodeguide>
  <id>284131</id>
  <imdbid>tt3909224</imdbid>
  <uniqueid default="false" type="tmdb">62104</uniqueid>
  <uniqueid default="false" type="tvrage">44814</uniqueid>
  <uniqueid default="false" type="imdb">tt3909224</uniqueid>
  <uniqueid default="true" type="tvdb">284131</uniqueid>

 

 

Appears TMM only write the id (for episodes) belonging to tvdb or themoviedb depending which one you use.

TMM can also  scrape from IMDB so if you use that to scrape the episodes you will get that id for the episode, but only the id no other one, of course automatically. You can always manually modify the nfo within TMM adding fields or directly on the nfo file.

Episode scraped using IMDB:

<!--created on 2021-07-19 11:05:35 - tinyMediaManager 3.1.15-->
<episodedetails>
  <title>The Holy War Accord</title>
  <originaltitle/>
  <showtitle>The Seven Deadly Sins</showtitle>
  <season>4</season>
  <episode>19</episode>
  <displayseason>-1</displayseason>
  <displayepisode>-1</displayepisode>
  <id/>
  <uniqueid default="true" type="imdb">tt11767866</uniqueid>
  <ratings>
    <rating default="true" max="10" name="imdb">
      <value>7.1</value>
      <votes>171</votes>
    </rating>
  </ratings>

 

It would have to be scraped like this, if the other fields doesnt matter because you use tmdb or tvdb, you can just select the rating field and will only get that from imdb.

 

Edited July 19, 2021 by rodainas

[GrimReaper 3314]

29 minutes ago, rodainas said:

Tried myself.

Still not getting imdb id for episode using TMM and themoviedb as provider

That's strange, as I'm getting it, test-scraped it with TMDB just now.

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<!--created on 2021-07-19 18:37:55 - tinyMediaManager 4.1.6-->
<episodedetails>
  <title>The Struggle</title>
  <originaltitle/>
  <showtitle>The Seven Deadly Sins</showtitle>
  <season>4</season>
  <episode>19</episode>
  <displayseason>-1</displayseason>
  <displayepisode>-1</displayepisode>
  <id/>
  <uniqueid default="false" type="tmdb">2907410</uniqueid>
  <uniqueid default="true" type="imdb">tt14664448</uniqueid>
  <ratings>
    <rating default="false" max="10" name="themoviedb">
      <value>8.0</value>
      <votes>1</votes>
    </rating>
    <rating default="true" max="10" name="imdb">
      <value>8.7</value>
      <votes>99</votes>
    </rating>
  </ratings>
  <userrating>0.0</userrating>
  <plot>"Tenjo Tenka Yuigadokuson Goku" (Ruby: The Ultimate One), which still burns beyond noon, ──
    Escanor, who fights by converting all his vitality into magical power, approaches the Demon King.
    However, Meliodas stands in front of the deadly Escanor. It is because he realizes that he could
    lose his life. However, Escanor refuses and is willing to take his life for his companion. Meliodas
    decides to fight together in front of the dark beast that the Demon King calls further! On the other
    hand, in the spiritual world of Zeldris, the real Gelda joins and the battle with the Demon King
    continues. Finally, Zeldris pulls out his sword and confronts the Demon King!</plot>
  <runtime>24</runtime>
  <thumb>https://image.tmdb.org/t/p/original/yjW2NHQ57VAs4Tih4biVfB1XtW1.jpg</thumb>
  <mpaa/>
  <premiered>2021-05-19</premiered>
  <aired>2021-05-19</aired>
  <watched>false</watched>
  <playcount>0</playcount>
  <studio>MBS</studio>
  <actor>
    <name>Tatsuhisa Suzuki</name>
    <role>Ban (voice)</role>
    <thumb>https://image.tmdb.org/t/p/h632/foytL2OreKzQcTNftz2qMgClKKg.jpg</thumb>
    <profile>https://www.themoviedb.org/person/1154452</profile>
    <tmdbid>1154452</tmdbid>
  </actor>
  <trailer/>
  <dateadded>2021-05-24 11:34:11</dateadded>
  <epbookmark/>
  <code/>
  <fileinfo>
    <streamdetails>
      <video>
        <codec>HEVC</codec>
        <aspect>1.78</aspect>
        <width>1280</width>
        <height>720</height>
        <durationinseconds>1452</durationinseconds>
        <stereomode/>
      </video>
      <audio>
        <codec>AAC</codec>
        <language>jpn</language>
        <channels>2</channels>
      </audio>
      <subtitle>
        <language>eng</language>
      </subtitle>
    </streamdetails>
  </fileinfo>
  <!--tinyMediaManager meta data-->
  <source>UNKNOWN</source>
  <original_filename>The Seven Deadly Sins - S04E19 [720p].mkv</original_filename>
  <user_note/>
</episodedetails>

 

[rodainas 188]

1 minute ago, GrimReaper76 said:

That's strange, as I'm getting it, test-scraped it with TMDB just now.

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<!--created on 2021-07-19 18:37:55 - tinyMediaManager 4.1.6-->
<episodedetails>
  <title>The Struggle</title>
  <originaltitle/>
  <showtitle>The Seven Deadly Sins</showtitle>
  <season>4</season>
  <episode>19</episode>
  <displayseason>-1</displayseason>
  <displayepisode>-1</displayepisode>
  <id/>
  <uniqueid default="false" type="tmdb">2907410</uniqueid>
  <uniqueid default="true" type="imdb">tt14664448</uniqueid>
  <ratings>
    <rating default="false" max="10" name="themoviedb">
      <value>8.0</value>
      <votes>1</votes>
    </rating>
    <rating default="true" max="10" name="imdb">
      <value>8.7</value>
      <votes>99</votes>
    </rating>
  </ratings>
  <userrating>0.0</userrating>
  <plot>"Tenjo Tenka Yuigadokuson Goku" (Ruby: The Ultimate One), which still burns beyond noon, ──
    Escanor, who fights by converting all his vitality into magical power, approaches the Demon King.
    However, Meliodas stands in front of the deadly Escanor. It is because he realizes that he could
    lose his life. However, Escanor refuses and is willing to take his life for his companion. Meliodas
    decides to fight together in front of the dark beast that the Demon King calls further! On the other
    hand, in the spiritual world of Zeldris, the real Gelda joins and the battle with the Demon King
    continues. Finally, Zeldris pulls out his sword and confronts the Demon King!</plot>
  <runtime>24</runtime>
  <thumb>https://image.tmdb.org/t/p/original/yjW2NHQ57VAs4Tih4biVfB1XtW1.jpg</thumb>
  <mpaa/>
  <premiered>2021-05-19</premiered>
  <aired>2021-05-19</aired>
  <watched>false</watched>
  <playcount>0</playcount>
  <studio>MBS</studio>
  <actor>
    <name>Tatsuhisa Suzuki</name>
    <role>Ban (voice)</role>
    <thumb>https://image.tmdb.org/t/p/h632/foytL2OreKzQcTNftz2qMgClKKg.jpg</thumb>
    <profile>https://www.themoviedb.org/person/1154452</profile>
    <tmdbid>1154452</tmdbid>
  </actor>
  <trailer/>
  <dateadded>2021-05-24 11:34:11</dateadded>
  <epbookmark/>
  <code/>
  <fileinfo>
    <streamdetails>
      <video>
        <codec>HEVC</codec>
        <aspect>1.78</aspect>
        <width>1280</width>
        <height>720</height>
        <durationinseconds>1452</durationinseconds>
        <stereomode/>
      </video>
      <audio>
        <codec>AAC</codec>
        <language>jpn</language>
        <channels>2</channels>
      </audio>
      <subtitle>
        <language>eng</language>
      </subtitle>
    </streamdetails>
  </fileinfo>
  <!--tinyMediaManager meta data-->
  <source>UNKNOWN</source>
  <original_filename>The Seven Deadly Sins - S04E19 [720p].mkv</original_filename>
  <user_note/>
</episodedetails>

 

Yours is TMM v4 right?

[GrimReaper 3314]

Just now, rodainas said:

Yours is TMM v4 right?

 

1 minute ago, GrimReaper76 said:

<!--created on 2021-07-19 18:37:55 - tinyMediaManager 4.1.6-->

 

[rodainas 188]

1 minute ago, GrimReaper76 said:

 

 

Thats it,

Is the same that happens with movie ratings from omdb

v3, gets rottentomatoes

v4, gets tomatometerallcritics

He would have to pay for tmm v4 monthly in that case.

Edited July 19, 2021 by rodainas

[GrimReaper 3314]

Just now, rodainas said:

Thats it,

Is the same that happens with movie ratings from omdb

v3, gets rottentomatoes

v4, gets tomatometerallcritics

One would assume those ain't the only advantages of more recent, updated, builds, lotsa stuff gets added regularly.

[rodainas 188]

Just now, GrimReaper76 said:

One would assume those ain't the only advantages of more recent, updated, builds, lotsa stuff gets added regularly.

Sure, and I agree, but discussing the advantages of v4 over v3 is other topic, am just pointing it for the user as I would suspect he in case of testing would use v3 not v4 at this moment.

[GrimReaper 3314]

Just now, rodainas said:

Sure, and I agree, but discussing the advantages of v4 over v3 is other topic, am just pointing it for the user as I would suspect he in case of testing would use v3 not v4 at this moment.

AFAIR there's a (or at least there was) free tier on v4 as well, don't know the limitations, never had incentive to read, though.

[rodainas 188]

Just now, GrimReaper76 said:

AFAIR there's a (or at least there was) free tier on v4 as well, don't know the limitations, never had incentive to read, though.

That would be a interesting test, thank you.

[Bazzu85 21]

1 hour ago, rodainas said:

That would be a interesting test, thank you.

When you talk about v3 and v4, you are referring to TMM version correct?

From what I read the imdb id is returning from api in certain cases..

So who is doing wrong? Is the emby plugin that needs a fix? If TMM 4 can read the episode infos with imdb IMHO the api return that infos..

[rodainas 188]

12 minutes ago, Bazzu85 said:

When you talk about v3 and v4, you are referring to TMM version correct?

From what I read the imdb id is returning from api in certain cases..

So who is doing wrong? Is the emby plugin that needs a fix? If TMM 4 can read the episode infos with imdb IMHO the api return that infos..

First one, correct.

In both versions you can get IMDB id, 

When I tested it on V3 the only way to get IMDB is scraping through IMDB directly.

When GrimReaper76 tested in on V4, he said he tested it using TVDB and TMM picked up TVDB id and IMDB id, I dont see any imdb id indication on the episode details page on TVDB for that anime, so V4 is scraping TVDB general metadata info and IMDB id (this one from IMDB web) at the same time to get both ids.

But this doesnt prove too much when comparing to emby scraping.

The thing is emby doesnt scrap directly from IMDB, it is just only not getting the imdb id from themoviedb episode details as you posted, so the way I see it, I could still be a provider problem.

Edited July 19, 2021 by rodainas

[GrimReaper 3314]

Just now, rodainas said:

When GrimReaper76 tested in on V4, he said he tested it using TVDB and TMM picked up TVDB id and IMDB id, I dont see any imdb id indication on the episode details page on TVDB for that anime, so V4 is scraping TVDB general metadata info and IMDB id (this one from IMDB web) at the same time to get both ids.

 

1 hour ago, GrimReaper76 said:

That's strange, as I'm getting it, test-scraped it with TMDB just now.

Nope, that was pure TMDB scrape, not TVDB or Universal scraper.

[rodainas 188]

1 minute ago, GrimReaper76 said:

 

Nope, that was pure TMDB scrape, not TVDB or Universal scraper.

interesting, so I could be that emby scraper just doesnt pick that info from tmdb.

[GrimReaper 3314]

This is what TMDB's API returns for that particular episode: 

{"air_date":"2021-05-19","crew":[],"episode_number":19,"guest_stars":[],"name":"The Struggle","overview":"\"Tenjo Tenka Yuigadokuson Goku\" (Ruby: The Ultimate One), which still burns beyond noon, ── Escanor, who fights by converting all his vitality into magical power, approaches the Demon King. However, Meliodas stands in front of the deadly Escanor. It is because he realizes that he could lose his life. However, Escanor refuses and is willing to take his life for his companion. Meliodas decides to fight together in front of the dark beast that the Demon King calls further! On the other hand, in the spiritual world of Zeldris, the real Gelda joins and the battle with the Demon King continues. Finally, Zeldris pulls out his sword and confronts the Demon King!","id":2907410,"production_code":"","season_number":4,"still_path":"/dyIMgpXBLGKIawT0izKvfRPIcPc.jpg","vote_average":8.0,"vote_count":1}

 No IMDB Id there.

[rodainas 188]

10 minutes ago, GrimReaper76 said:

This is what TMDB's API returns for that particular episode: 

{"air_date":"2021-05-19","crew":[],"episode_number":19,"guest_stars":[],"name":"The Struggle","overview":"\"Tenjo Tenka Yuigadokuson Goku\" (Ruby: The Ultimate One), which still burns beyond noon, ── Escanor, who fights by converting all his vitality into magical power, approaches the Demon King. However, Meliodas stands in front of the deadly Escanor. It is because he realizes that he could lose his life. However, Escanor refuses and is willing to take his life for his companion. Meliodas decides to fight together in front of the dark beast that the Demon King calls further! On the other hand, in the spiritual world of Zeldris, the real Gelda joins and the battle with the Demon King continues. Finally, Zeldris pulls out his sword and confronts the Demon King!","id":2907410,"production_code":"","season_number":4,"still_path":"/dyIMgpXBLGKIawT0izKvfRPIcPc.jpg","vote_average":8.0,"vote_count":1}

 No IMDB Id there.

Also did a test with v4 free, scraping just from TMDB

I got

<title>The Struggle</title>
  <originaltitle/>
  <showtitle>The Seven Deadly Sins</showtitle>
  <season>4</season>
  <episode>19</episode>
  <displayseason>-1</displayseason>
  <displayepisode>-1</displayepisode>
  <id>2907410</id>
  <uniqueid default="false" type="tmdb">2907410</uniqueid>
  <uniqueid default="true" type="imdb">tt14664448</uniqueid>
  <uniqueid default="false" type="tvdb">2907410</uniqueid>
  <rating>8.1</rating>

Also got tvdb id, so TMM is getting those ids outside of tmdb.

Edited July 19, 2021 by rodainas

[GrimReaper 3314]

Yeah, looks like it's getting IMDB Id irrespectively of scraper used:

2021-07-19 18:38:10,595 INFO  [tmmpool-unnamed-task-T6-G2479] o.t.c.t.tasks.TvShowEpisodeScrapeTask:106 - ==========================
2021-07-19 18:38:10,595 INFO  [tmmpool-unnamed-task-T6-G2479] o.t.c.t.tasks.TvShowEpisodeScrapeTask:107 - Scrape metadata with scraper: tmdb
2021-07-19 18:38:10,596 INFO  [tmmpool-unnamed-task-T6-G2479] o.t.c.t.tasks.TvShowEpisodeScrapeTask:108 - TvShowEpisodeSearchAndScrapeOptions[tvShowIds={tmdb=62104, tvrage=44814, imdb=tt3909224, tvdb=284131},artworkScrapers={aniDB,fanart.tv,ffmpeg,IMDb.com,themoviedb.org,thetvdb.com},certificationCountry=US - United States,ids={tmdb=2907410, imdb=tt14664448, seasonNr=4, episodeNr=19},language=English,metadataScraper=themoviedb.org,releaseDateCountry=US,searchQuery=,searchResult=<null>,searchYear=-1,subtitleScrapers=[],trailerScrapers=[],type=TV_EPISODE]
2021-07-19 18:38:10,596 INFO  [tmmpool-unnamed-task-T6-G2479] o.t.c.t.tasks.TvShowEpisodeScrapeTask:109 - ==========================