Jump to content

Refresh all metadata with Emby 4.x

sualfred

By sualfred
in General/Windows

 Share

Recommended Posts

rodainas

rodainas   188

Posted
Posted (edited)
14 minutes ago, GrimReaper76 said:

Yeah, looks like it's getting IMDB Id irrespectively of scraper used: 




2021-07-19 18:38:10,595 INFO  [tmmpool-unnamed-task-T6-G2479] o.t.c.t.tasks.TvShowEpisodeScrapeTask:106 - ==========================
2021-07-19 18:38:10,595 INFO  [tmmpool-unnamed-task-T6-G2479] o.t.c.t.tasks.TvShowEpisodeScrapeTask:107 - Scrape metadata with scraper: tmdb
2021-07-19 18:38:10,596 INFO  [tmmpool-unnamed-task-T6-G2479] o.t.c.t.tasks.TvShowEpisodeScrapeTask:108 - TvShowEpisodeSearchAndScrapeOptions[tvShowIds={tmdb=62104, tvrage=44814, imdb=tt3909224, tvdb=284131},artworkScrapers={aniDB,fanart.tv,ffmpeg,IMDb.com,themoviedb.org,thetvdb.com},certificationCountry=US - United States,ids={tmdb=2907410, imdb=tt14664448, seasonNr=4, episodeNr=19},language=English,metadataScraper=themoviedb.org,releaseDateCountry=US,searchQuery=,searchResult=<null>,searchYear=-1,subtitleScrapers=[],trailerScrapers=[],type=TV_EPISODE]
2021-07-19 18:38:10,596 INFO  [tmmpool-unnamed-task-T6-G2479] o.t.c.t.tasks.TvShowEpisodeScrapeTask:109 - ==========================

 

Interesting thank you.

So having done this comparisons of scraping with third party TMM and emby scraper, looking at api behavior and response to the specific case of episodes, we can conclude that emby scraper is no the problem it is just taking what TMDB api is sending.

So@Bazzu85 is a TMDB api limitation not emby’s , it just doesnt send the IMDB id.

Recommendation if you want imdb related info, use TMM.

Edited by rodainas
Link to comment
Share on other sites
Bazzu85

Bazzu85   21

Posted
Posted
1 hour ago, rodainas said:

Interesting thank you.

So having done this comparisons of scraping with third party TMM and emby scraper, looking at api behavior and response to the specific case of episodes, we can conclude that emby scraper is no the problem it is just taking what TMDB api is sending.

So@Bazzu85 is a TMDB api limitation not emby’s , it just doesnt send the IMDB id.

Recommendation if you want imdb related info, use TMM.

sorry but I don't want garbage (nfo) in my hdd :D

BTW I wrote on tmdb support forum to get infos about the info lacks..

Link to comment
Share on other sites
Carlo Emby Team

Carlo   4330

Posted
Posted
1 hour ago, Bazzu85 said:

sorry but I don't want garbage (nfo) in my hdd :D

BTW I wrote on tmdb support forum to get infos about the info lacks..

Keep in mind if you don't use NFO files and have a problem with your database or every have to reload you lose all custom meta-data edits you have ever made as Emby would have not way to reload that info.  NFO files are anything but garbage but a backup to your meta-data if you ever need it. :)

  • Like 2
Link to comment
Share on other sites
Bazzu85

Bazzu85   21

Posted
Posted (edited)
35 minutes ago, cayars said:

Keep in mind if you don't use NFO files and have a problem with your database or every have to reload you lose all custom meta-data edits you have ever made as Emby would have not way to reload that info.  NFO files are anything but garbage but a backup to your meta-data if you ever need it. :)

I know I know..

btw I received a reply on tmdb forum and the api CAN get the external id's. but have to be requested.

I remembered that time ago I had requested an api key so i could test

base example:

https://api.themoviedb.org/3/tv/62104-nanatsu-no-taizai/season/4/episode/19?api_key=xxxxxxxxxxxxxxxxxxxxxxxx

here's the result: 

{"air_date":"2021-05-19","crew":[],"episode_number":19,"guest_stars":[],"name":"The Struggle","overview":"\"Tenjo Tenka Yuigadokuson Goku\" (Ruby: The Ultimate One), which still burns beyond noon, ── Escanor, who fights by converting all his vitality into magical power, approaches the Demon King. However, Meliodas stands in front of the deadly Escanor. It is because he realizes that he could lose his life. However, Escanor refuses and is willing to take his life for his companion. Meliodas decides to fight together in front of the dark beast that the Demon King calls further! On the other hand, in the spiritual world of Zeldris, the real Gelda joins and the battle with the Demon King continues. Finally, Zeldris pulls out his sword and confronts the Demon King!","id":2907410,"production_code":"","season_number":4,"still_path":"/dyIMgpXBLGKIawT0izKvfRPIcPc.jpg","vote_average":8.0,"vote_count":1}

example requesting external id's

you have to append the string: &append_to_response=external_ids

https://api.themoviedb.org/3/tv/62104-nanatsu-no-taizai/season/4/episode/19?api_key=xxxxxxxxxxxxxxxxxxxxxxxxxxxxx&append_to_response=external_ids

here's the result: 

{"air_date":"2021-05-19","crew":[],"episode_number":19,"guest_stars":[],"name":"The Struggle","overview":"\"Tenjo Tenka Yuigadokuson Goku\" (Ruby: The Ultimate One), which still burns beyond noon, ── Escanor, who fights by converting all his vitality into magical power, approaches the Demon King. However, Meliodas stands in front of the deadly Escanor. It is because he realizes that he could lose his life. However, Escanor refuses and is willing to take his life for his companion. Meliodas decides to fight together in front of the dark beast that the Demon King calls further! On the other hand, in the spiritual world of Zeldris, the real Gelda joins and the battle with the Demon King continues. Finally, Zeldris pulls out his sword and confronts the Demon King!","id":2907410,"production_code":"","season_number":4,"still_path":"/dyIMgpXBLGKIawT0izKvfRPIcPc.jpg","vote_average":8.0,"vote_count":1,"external_ids":{"imdb_id":"tt14664448","freebase_mid":null,"freebase_id":null,"tvdb_id":null,"tvrage_id":null}}

 

so.....I think that in emby plugin is missinn the append to response section..

Edited by Bazzu85
Link to comment
Share on other sites
Happy2Play

Happy2Play   8317

Posted
Posted (edited)
2 hours ago, cayars said:

@Luke Can you check that out and possibly add this if possible?

Per the cache folder and log the externalid is already gotten.

Quote

2021-07-19 15:55:09.015 Info HttpClient: GET https://api.themoviedb.org/3/tv/62104/season/4?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=images,keywords,external_ids,credits,videos&language=en&include_image_language=en,null 

{
    "air_date": "2021-05-19T00:00:00.0000000Z",
    "episode_number": 19,
    "name": "The Struggle",
    "overview": "\"Tenjo Tenka Yuigadokuson Goku\" (Ruby: The Ultimate One), which still burns beyond noon, ── Escanor, who fights by converting all his vitality into magical power, approaches the Demon King. However, Meliodas stands in front of the deadly Escanor. It is because he realizes that he could lose his life. However, Escanor refuses and is willing to take his life for his companion. Meliodas decides to fight together in front of the dark beast that the Demon King calls further! On the other hand, in the spiritual world of Zeldris, the real Gelda joins and the battle with the Demon King continues. Finally, Zeldris pulls out his sword and confronts the Demon King!",
    "id": 2907410,
    "production_code": "",
    "season_number": 4,
    "still_path": "/dyIMgpXBLGKIawT0izKvfRPIcPc.jpg",
    "vote_average": 8,
    "vote_count": 1,
    "images": {
        "stills": [{
                "aspect_ratio": 1.778,
                "file_path": "/dyIMgpXBLGKIawT0izKvfRPIcPc.jpg",
                "height": 1080,
                "vote_average": 0,
                "vote_count": 0,
                "width": 1920
            }
        ]
    },
    "external_ids": {
        "imdb_id": "tt14664448",
        "tvdb_id": 0,
        "tvrage_id": 0
    },
    "credits": {
        "cast": [{
                "character": "Meliodas (voice)",
                "credit_id": "54f0b834925141796e008619",
                "id": 149894,
                "name": "Yuki Kaji",
                "profile_path": "/8wKdPV11IwowfwoqGqMMNt9hmp6.jpg",
                "order": 1
            }, {
                "character": "Diane (voice)",
                "credit_id": "54f0b862c3a3686d580083b6",
                "id": 936275,
                "name": "Aoi Yuki",
                "profile_path": "/cIFTJFbPhN55T9WW2P064Wh8qty.jpg",
                "order": 2
            }, {
                "character": "Ban (voice)",
                "credit_id": "54f0b87e925141795f0090d0",
                "id": 1154452,
                "name": "Tatsuhisa Suzuki",
                "profile_path": "/foytL2OreKzQcTNftz2qMgClKKg.jpg",
                "order": 3
            }, {
                "character": "King (voice)",
                "credit_id": "54f0b8b3c3a3686d580083c0",
                "id": 131563,
                "name": "Jun Fukuyama",
                "profile_path": "/aadtVXCUS1oPqWraYW3ErO1Ajcg.jpg",
                "order": 4
            }, {
                "character": "Hawk (voice)",
                "credit_id": "54f0b8c4c3a3686b9a006442",
                "id": 151182,
                "name": "Misaki Kuno",
                "profile_path": "/6qslBrgao1mthGJK3M9keUYyMIw.jpg",
                "order": 5
            }
        ],
        "crew": [],
        "guest_stars": []
    },
    "videos": {
        "results": []
    }
}

@Luke But yes it is true episode level is not reading this already known metadata from TMDB.  Yes it is true this info is missing from TVDB do to no one adding it, but v3 api metadata does not appear to contain it.

Edited by Happy2Play
Link to comment
Share on other sites
Luke Emby Team

Luke   37129

Posted
Posted

Yes we can update Moviedb to start capturing the imdb id for episodes. Thanks.

Link to comment
Share on other sites
Bazzu85

Bazzu85   21

Posted
Posted
7 hours ago, Happy2Play said:

Per the cache folder and log the externalid is already gotten. 


{
    "air_date": "2021-05-19T00:00:00.0000000Z",
    "episode_number": 19,
    "name": "The Struggle",
    "overview": "\"Tenjo Tenka Yuigadokuson Goku\" (Ruby: The Ultimate One), which still burns beyond noon, ── Escanor, who fights by converting all his vitality into magical power, approaches the Demon King. However, Meliodas stands in front of the deadly Escanor. It is because he realizes that he could lose his life. However, Escanor refuses and is willing to take his life for his companion. Meliodas decides to fight together in front of the dark beast that the Demon King calls further! On the other hand, in the spiritual world of Zeldris, the real Gelda joins and the battle with the Demon King continues. Finally, Zeldris pulls out his sword and confronts the Demon King!",
    "id": 2907410,
    "production_code": "",
    "season_number": 4,
    "still_path": "/dyIMgpXBLGKIawT0izKvfRPIcPc.jpg",
    "vote_average": 8,
    "vote_count": 1,
    "images": {
        "stills": [{
                "aspect_ratio": 1.778,
                "file_path": "/dyIMgpXBLGKIawT0izKvfRPIcPc.jpg",
                "height": 1080,
                "vote_average": 0,
                "vote_count": 0,
                "width": 1920
            }
        ]
    },
    "external_ids": {
        "imdb_id": "tt14664448",
        "tvdb_id": 0,
        "tvrage_id": 0
    },
    "credits": {
        "cast": [{
                "character": "Meliodas (voice)",
                "credit_id": "54f0b834925141796e008619",
                "id": 149894,
                "name": "Yuki Kaji",
                "profile_path": "/8wKdPV11IwowfwoqGqMMNt9hmp6.jpg",
                "order": 1
            }, {
                "character": "Diane (voice)",
                "credit_id": "54f0b862c3a3686d580083b6",
                "id": 936275,
                "name": "Aoi Yuki",
                "profile_path": "/cIFTJFbPhN55T9WW2P064Wh8qty.jpg",
                "order": 2
            }, {
                "character": "Ban (voice)",
                "credit_id": "54f0b87e925141795f0090d0",
                "id": 1154452,
                "name": "Tatsuhisa Suzuki",
                "profile_path": "/foytL2OreKzQcTNftz2qMgClKKg.jpg",
                "order": 3
            }, {
                "character": "King (voice)",
                "credit_id": "54f0b8b3c3a3686d580083c0",
                "id": 131563,
                "name": "Jun Fukuyama",
                "profile_path": "/aadtVXCUS1oPqWraYW3ErO1Ajcg.jpg",
                "order": 4
            }, {
                "character": "Hawk (voice)",
                "credit_id": "54f0b8c4c3a3686b9a006442",
                "id": 151182,
                "name": "Misaki Kuno",
                "profile_path": "/6qslBrgao1mthGJK3M9keUYyMIw.jpg",
                "order": 5
            }
        ],
        "crew": [],
        "guest_stars": []
    },
    "videos": {
        "results": []
    }
}

@Luke But yes it is true episode level is not reading this already known metadata from TMDB.  Yes it is true this info is missing from TVDB do to no one adding it, but v3 api metadata does not appear to contain it.

Question: where do you found that request url? I searched the logs for reproduce it by myself but I didn't found it..

Link to comment
Share on other sites
Happy2Play

Happy2Play   8317

Posted
Posted
30 minutes ago, Bazzu85 said:

Question: where do you found that request url? I searched the logs for reproduce it by myself but I didn't found it..

The was the url in my server log when I added that test episode.

Looks like @Lukepushed a plugin update that resolves the issue.  But looks like you have to Refresh Metadata to populate the filed (at least in my testing). 

  <uniqueid type="Tvdb">8397876</uniqueid>
  <uniqueid type="Imdb">tt14664448</uniqueid>

 

Link to comment
Share on other sites
Bazzu85

Bazzu85   21

Posted
Posted
1 hour ago, Happy2Play said:

The was the url in my server log when I added that test episode.

Looks like @Lukepushed a plugin update that resolves the issue.  But looks like you have to Refresh Metadata to populate the filed (at least in my testing). 


  <uniqueid type="Tvdb">8397876</uniqueid>
  <uniqueid type="Imdb">tt14664448</uniqueid>

 

Just updated the plugin and refreshed the metadata for the show.

This is the configuration:

- Primary scraper: tvdb (no imdb id)

- Secondary scraper: tmdb (yes imdb id)

The infos was taken now correctly from tvdb. The missing one (imdb id in this case) from tmdb

image.png.e901d772330f461465f373707a71abbb.png

thx @Luke to update the plugin..

now I check if there are other missing data..

  • Like 1
Link to comment
Share on other sites
Bazzu85

Bazzu85   21

Posted
Posted

question: why don't track additionally the tmdb id?

talking about the next tvdb paying subscription many user will migrate to tmdb..so I think is time to invest in this provider a little more..

  • Like 2
Link to comment
Share on other sites
Bazzu85

Bazzu85   21

Posted
Posted (edited)
23 minutes ago, Luke said:

We do track the tmdb id

For movies and shows main page, yes..

But not for single episodes.. only imdb e tvdb is showed in metadata

Edit: ok I'll see that the tmdb id is unique for all season episodes.

Example:

https://www.themoviedb.org/tv/62104/season/4/episode/1

My starting question was because in the episodes page the related tmdb link was missing. Why don't generate it at this point?

 

 

Edited by Bazzu85
Link to comment
Share on other sites
Luke Emby Team

Luke   37129

Posted
Posted
Quote

Why don't generate it at this point?

I guess it's just never been looked at before, but it can always be added.

Link to comment
Share on other sites
Bazzu85

Bazzu85   21

Posted
Posted (edited)
2 hours ago, Luke said:

I guess it's just never been looked at before, but it can always be added.

can be a great implementation..

users now see only this:

image.png.52a1c4c214780262f8d670c33f3d563d.png

even if the episode is scraped from tmdb..

for not-english users that want to add translations, now have to go to main show  page, click on tmdb link and search the episode page again..

and what about episodes group?

example:

image.thumb.png.9320c475e142a84b1138847a60fb2666.png

are there a way to use it in emby?

thx

Edited by Bazzu85
Link to comment
Share on other sites
GrimReaper

GrimReaper   3314

Posted
Posted
1 minute ago, cayars said:

This is what I have for The Big Bang Theory
image.png.a5ea5ac0133b2e73855eff7497023b36.png

He's referring to TMDB links on episode level, which atm are not scraped (or, at least, not displayed). 

  • Like 1
  • Thanks 1
Link to comment
Share on other sites
Carlo Emby Team

Carlo   4330

Posted
Posted

OK, should have read that closer!  Thanks for the heads up.

  • Like 1
Link to comment
Share on other sites
GrimReaper

GrimReaper   3314

Posted
Posted
2 hours ago, Bazzu85 said:

and what about episodes group?

example:

image.thumb.png.9320c475e142a84b1138847a60fb2666.png

are there a way to use it in emby?

Lend your support here:

 

Link to comment
Share on other sites
  • 1 year later...
shona_emby_plex

shona_emby_plex   0

Posted
Posted

how can  refresh ALL metadata from ALL libraries at the same time? i have too many libraries to refresh each library one at a time.

Link to comment
Share on other sites
GrimReaper

GrimReaper   3314

Posted
Posted (edited)
2 minutes ago, shona_emby_plex said:

how can  refresh ALL metadata from ALL libraries at the same time? i have too many libraries to refresh each library one at a time.

Multi-select all libraries (hover top-left on the library thumb on Home Screen)>three-dot menu top-right of the screen>Refresh Metadata

Edited by GrimReaper
Link to comment
Share on other sites
shona_emby_plex

shona_emby_plex   0

Posted
Posted
3 minutes ago, GrimReaper said:

Multi-select all libraries (hover top-left on the library thumb on Home Screen)>three-dot menu top-right of the screen>Refresh Metadata

i dont see it

 

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...