Metadata system not picking up [tmdbid=XXXX] in folder name

[HawkXP71 112]

I have a number of movies where the metadata search system was failing to pick the correct movie.  No big deal, I followed the instructions and added both the year and tmdbid to the folder the file is in.

The one that is showing the real problem for me is Manhunter.  Initially the file was in the following directory structure

Manhunter/Manhunter.mkv

And it couldnt determine the correct movie, fair enough, so I renamed the directory to 

Manhunter (1986) [tmdbid=11454]/Manhunter.mkv

I can use the "Identify" functionality and it works fine.  But after the rename, shouldnt it find the correct one?

I delete all the meta file (I have the images, nfo etc store in the folder) and rescan, no difference
I do a refresh metadata, no differerence

If I do an identify, and select it, it works great.  But what am I doing wrong?

 

 

[Happy2Play 9781]

Sorry can you post the server log for this and what is your library provider order?

I had no issue with this "Manhunter (1986) [tmdbid=11454]\abcdefghik.strm" as it identified by the tmdb id.

2021-10-08 12:43:47.432 Debug App: Running FFProbeProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.437 Debug App: Running MovieXmlProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.439 Debug App: MovieXmlProvider will fetch xml from C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.xml
2021-10-08 12:43:47.443 Debug App: MovieXmlProvider returned no metadata for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.443 Debug App: Running MovieNfoProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.444 Debug App: MovieNfoProvider returned no metadata for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.445 Debug App: Running MovieDbProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.452 Info HttpClient: GET https://api.themoviedb.org/3/movie/11454?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers&language=en&include_image_language=en,null
2021-10-08 12:43:47.674 Debug App: Throttling Tmdb by 78 ms
2021-10-08 12:43:47.765 Info HttpClient: GET https://api.themoviedb.org/3/configuration?api_key=f6bd687ffa63cd282b6ff2c6877f2669
2021-10-08 12:43:47.784 Info App: MovieDb settings: {"images":{"base_url":"http://image.tmdb.org/t/p/","secure_base_url":"https://image.tmdb.org/t/p/","backdrop_sizes":["w300","w780","w1280","original"],"logo_sizes":["w45","w92","w154","w185","w300","w500","original"],"poster_sizes":["w92","w154","w185","w342","w500","w780","original"],"profile_sizes":["w45","w185","h632","original"],"still_sizes":["w92","w185","w300","original"]},"change_keys":["adult","air_date","also_known_as","alternative_titles","biography","birthday","budget","cast","certifications","character_names","created_by","crew","deathday","episode","episode_number","episode_run_time","freebase_id","freebase_mid","general","genres","guest_stars","homepage","images","imdb_id","languages","name","network","origin_country","original_name","original_title","overview","parts","place_of_birth","plot_keywords","production_code","production_companies","production_countries","releases","revenue","runtime","season","season_number","season_regular","spoken_languages","status","tagline","title","translations","tvdb_id","tvrage_id","type","video","videos"]}
2021-10-08 12:43:47.798 Debug App: Running OmdbItemProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.804 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&i=tt0091474&plot=short&tomatoes=true&r=json

 

Edited October 8, 2021 by Happy2Play

[HawkXP71 112]

1 minute ago, Happy2Play said:

Sorry can you post the server log for this and what is your library provider order?

I had no issue with this "Manhunter (1986) [tmdbid=11454]\abcdefghik.strm" as it identified by the tmdb id.

2021-10-08 12:43:47.432 Debug App: Running FFProbeProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.437 Debug App: Running MovieXmlProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.439 Debug App: MovieXmlProvider will fetch xml from C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.xml
2021-10-08 12:43:47.443 Debug App: MovieXmlProvider returned no metadata for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.443 Debug App: Running MovieNfoProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.444 Debug App: MovieNfoProvider returned no metadata for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.445 Debug App: Running MovieDbProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.452 Info HttpClient: GET https://api.themoviedb.org/3/movie/11454?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers&language=en&include_image_language=en,null
2021-10-08 12:43:47.674 Debug App: Throttling Tmdb by 78 ms
2021-10-08 12:43:47.765 Info HttpClient: GET https://api.themoviedb.org/3/configuration?api_key=f6bd687ffa63cd282b6ff2c6877f2669
2021-10-08 12:43:47.784 Info App: MovieDb settings: {"images":{"base_url":"http://image.tmdb.org/t/p/","secure_base_url":"https://image.tmdb.org/t/p/","backdrop_sizes":["w300","w780","w1280","original"],"logo_sizes":["w45","w92","w154","w185","w300","w500","original"],"poster_sizes":["w92","w154","w185","w342","w500","w780","original"],"profile_sizes":["w45","w185","h632","original"],"still_sizes":["w92","w185","w300","original"]},"change_keys":["adult","air_date","also_known_as","alternative_titles","biography","birthday","budget","cast","certifications","character_names","created_by","crew","deathday","episode","episode_number","episode_run_time","freebase_id","freebase_mid","general","genres","guest_stars","homepage","images","imdb_id","languages","name","network","origin_country","original_name","original_title","overview","parts","place_of_birth","plot_keywords","production_code","production_companies","production_countries","releases","revenue","runtime","season","season_number","season_regular","spoken_languages","status","tagline","title","translations","tvdb_id","tvrage_id","type","video","videos"]}
2021-10-08 12:43:47.798 Debug App: Running OmdbItemProvider for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.804 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&i=tt0091474&plot=short&tomatoes=true&r=json
2021-10-08 12:43:47.967 Debug App: Running BaseGenreCleaner for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm
2021-10-08 12:43:47.992 Debug App: Running BaseStudioCleaner for C:\Users\Media\Desktop\Videos\Movies - DB\Manhunter (1986) [tmdbid=11454]\abcdefghik.strm

 

I certainly can   what steps would you like me to do? and Ill follow with the logs of those steps.

[Happy2Play 9781]

Just now, HawkXP71 said:

I certainly can   what steps would you like me to do? and Ill follow with the logs of those steps.

First what is your library provider order, but posting a server log would show that also as you can see in my log snippet it queried TMDB then OMDB.

[HawkXP71 112]

20 minutes ago, Happy2Play said:

First what is your library provider order, but posting a server log would show that also as you can see in my log snippet it queried TMDB then OMDB.

Im not sure where that setting is, but looking at my log, it looks to be TMDB then OMDB

Please try this..

Create a folder 
Manhunter/Manhunter.strm

The system "should" pick up a movie from 1974 with a tmdb of 14311

Then rename the folder to Manhunter (1986) [tmdbid=11454]

My logs show it removing the first from the system, then adding the second.  But it never updates the metadata.

Then I force a "rescan the metadata" and nothing changes. 

Do you want the log from my side of every step I just did?

[Happy2Play 9781]

And is there metadata in this renamed folder? 

But the steps you took would be helpful as all I did was add the folder with id on it and it worked, no renaming involved.

[HawkXP71 112]

Just now, Happy2Play said:

And is there metadata in this renamed folder? 

But the steps you took would be helpful as all I did was add the folder with id on it and it worked, no renaming involved.

Yes, the original metadata is there.

 

I have attached a log with the following steps, the directory was already properly renamed to include the tmdbid
1) restart emby

2) Select the movie

3) Refresh Metadata

I have also attached the nfo file, which has the correct IMDB but incorrect tmdb

Manhunter.nfo

embyserver.txt

[Happy2Play 9781]

The issue is Emby will always reused metadata so folder is not going to override existing metadata.

So you need to remove existing metadata or just use Identify to replace existing metadata. 

Edited October 8, 2021 by Happy2Play

[Happy2Play 9781]

@Lukein a scenario where folder tmdb id is different then nfo file and one does a Refresh, what should happen?  Will the refresh use folder or reuse nfo?

[HawkXP71 112]

Ok.. I removed the .nfo and the poster.jpg 

1) rm -rf poster.jpg Manhunter.nfo

2) Select Movie (you will see a couple of missing file errors in the log)

3) Rescan Metadata (all data and replace existing checked, which was used before)

Log attached, but it downloaded the same exact jpg and nfo using the same urls.. meaning its not using the tmdb from the directory to find the metadata even on a rescan.

 

 

embyserver (2).txt

[ebr 16184]

NFO will always take priority.  However a refresh->replace all metadata should re-do it.

[HawkXP71 112]

2 minutes ago, Happy2Play said:

@Lukein a scenario where folder tmdb id is different then nfo file and one does a Refresh, what should happen?  Will the refresh use folder or reuse nfo?

@Luke also, what if you delete the nfo, and rescan?

[HawkXP71 112]

Just now, ebr said:

NFO will always take priority.  However a refresh->replace all metadata should re-do it.

That appears to not be happening

[HawkXP71 112]

1 minute ago, ebr said:

NFO will always take priority.  However a refresh->replace all metadata should re-do it.

Ideally, I would "hope" that when a refresh->replace all, would remove/replace all downloaded meta files (nfo, jpg etc etc).  and start fresh as if the file was just added. 

 

[Happy2Play 9781]

2 minutes ago, HawkXP71 said:

@Luke also, what if you delete the nfo, and rescan?

But the info is in the database already so deleting and scan should just rewrite the nfo.

1 minute ago, HawkXP71 said:

Ideally, I would "hope" that when a refresh->replace all, would remove/replace all downloaded meta files (nfo, jpg etc etc).  and start fresh as if the file was just added. 

 

To my knowledge that has never been the case and only a Identify will do that.  Dev will have to confirm but I believe providerids are reused from nfo when present.

[ebr 16184]

Yeah, sorry.  Replace all metadata will do just that - replace the metadata for the item as it is identified.  It won't start fresh and try to re-identify it from the file name.

[HawkXP71 112]

Ok.. this makes sense.. and Im not going crazy

Is there a away to "force" a re-identify? When I see a mistake in the identification, my ideal process would be "look up the year, tmdbid and rename the folder" then the auto detect system would just handle it.  

However if instead I need to look it up, rename, then "identify" and enter the tmdib search and select... It becomes something that is really a pain.

Part of the the issue is, the filename/folder is persistent outside of emby.  Simply using "identify" is not.  So if there is a server crash with no loss of data, I would be able to easily "recreate" the emby system.  As opposed to having to go through the whole thing again if I only use "identify"

I prefer even a task that could be run.  Where it looked at the current identification of an item, and if the file/folder based id redid the identification of the media in the system. 

For someone like me, coming over to emby, I dont mind putting in the work to fix the automation, but Im still at a loss of what is the "correct" (today with no changes to the app) way to solve this

[Happy2Play 9781]

Without removing media, scanning to clear the database entry, deleting nfo files and image, renaming folder and re-adding, no.  Selecting Identify and searching name or specified is your only option.

[HawkXP71 112]

1 minute ago, Happy2Play said:

Without removing media, scanning to clear the database entry, deleting nfo files and image, renaming folder and re-adding, no.  Selecting Identify and searching name or specified is your only option.

Thanks.. thats what I was afraid you would say

[ebr 16184]

15 hours ago, HawkXP71 said:

However if instead I need to look it up, rename, then "identify" and enter the tmdib search and select... It becomes something that is really a pain.

Part of the the issue is, the filename/folder is persistent outside of emby.  Simply using "identify" is not.  So if there is a server crash with no loss of data, I would be able to easily "recreate" the emby system.  As opposed to having to go through the whole thing again if I only use "identify"

If you are saving NFO files, then - as you are encountering now - the identification will survive a re-import into Emby.

So, my suggestion would be to no longer rename the folder and just use the identify feature in Emby.

[Luke 42079]

On 10/8/2021 at 4:36 PM, Happy2Play said:

The issue is Emby will always reused metadata so folder is not going to override existing metadata.

So you need to remove existing metadata or just use Identify to replace existing metadata. 

Correct. It gets the value from the folder path first, but then it gets replaced by whatever is inside the nfo.

[HawkXP71 112]

Thanks for all the help. I decided to follow the guidance and essentially using the existing NFO information I modified the directory names.  When the tmdbid was wrong I updated the ID as necessary in the directory name.

Then I recreated the library, and now all is mostly well  

One question, 90% of the time (probably clsoier to 95%) the poster chosen is correct, sometimes the tmdb poster isnt chosen and one of the thumbnails from the movie is chosen.  Any idea how to track down the issue?

Also I do have an enhancement that Ill do some googling on and if I cant find it ill start a new thread. 

Edited October 12, 2021 by HawkXP71

[Luke 42079]

We'll help you in your other topic about that. Thanks