Identify/metadata issues

[BiTeTHeBiGG 13]

Hi, I'm also having this issue since 4.4.2.0.

As I have a huge library, is there a known workaround to fix this without creating a new library?

A new scan over all will take a big amount of time and mostly will loose the watched status, right?

Best regards

EDIT:

As noted by Happy2Play I created a new library with just two sample movies and it worked fine, then I compared the "options.xml" files and the only difference I see is that the old library have then option "CollapseSingleItemFolders" to false:

<CollapseSingleItemFolders>false</CollapseSingleItemFolders>

on the other side the new library have this option set to true:

<CollapseSingleItemFolders>true</CollapseSingleItemFolders>

Could this be a issue?

EDIT 2:

Just to let you know, I did update today to the latest version 4.4.3.0 and now on scanning my main movie db several (or all, huge log file growing) movies went deleted / removed and now it is readding all again. I'm sure this is no normal behaviour.

EDIT 3:

I think the db issue came with 4.4.2.0 and I was so lucky I was not affected. Just a release later ... (the scan took more then two hours)

Now the library is scanning with directory name. I really don't know what exactly happened but let me share another issue while I was testing.

I tested with movies I do not own. File name was "Bullitt" from 1968 and directory "Crawl" from 2019. Exact naming: \Crawl (2019)\Bullitt (1968).mkv

The funny or annoying thing is that the movie is recognized as Crawl from 2017 (https://www.themoviedb.org/movie/467357-crawl). I tried then to swap the names and the movie is recognized as Chasing Bullitt from 2018 (https://www.themoviedb.org/movie/586604-chasing-bullitt?language=de-DE). Whe I try to identify manually, the first hit was always the right one. Why the scraper took the wrong one in the list?

Edited July 26, 2020 by BiTeTHeBiGG
Info Update

[Luke 37060]

Hi, for movies that are in their own separate folders, yes we do use the folder name. I think at some point we will add an option to allow you to better control this.

Are you still having an issue with the library scan?

[BiTeTHeBiGG 13]

Hi @Luke, the library scan is over and adding new movies works now "normal".

The issue with identifying the movies is still there. I don't own these two movies, I just used those name for testing purposes and the result was unexpected.

On 7/26/2020 at 12:03 PM, BiTeTHeBiGG said:

I tested with movies I do not own. File name was "Bullitt" from 1968 and directory "Crawl" from 2019. Exact naming: \Crawl (2019)\Bullitt (1968).mkv

The funny or annoying thing is that the movie is recognized as Crawl from 2017 (https://www.themoviedb.org/movie/467357-crawl). I tried then to swap the names and the movie is recognized as Chasing Bullitt from 2018 (https://www.themoviedb.org/movie/586604-chasing-bullitt?language=de-DE). Whe I try to identify manually, the first hit was always the right one. Why the scraper took the wrong one in the list?

Best regards

[Luke 37060]

8 hours ago, BiTeTHeBiGG said:

 

I tested with movies I do not own. File name was "Bullitt" from 1968 and directory "Crawl" from 2019. Exact naming: \Crawl (2019)\Bullitt (1968).mkv

The funny or annoying thing is that the movie is recognized as Crawl from 2017 (https://www.themoviedb.org/movie/467357-crawl). I tried then to swap the names and the movie is recognized as Chasing Bullitt from 2018 (https://www.themoviedb.org/movie/586604-chasing-bullitt?language=de-DE). Whe I try to identify manually, the first hit was always the right one. Why

Can you please attach the emby server log from this attempt? Thanks.

[BiTeTHeBiGG 13]

Hi @Luke,

I used this time my old windows installation, updated to 4.4.3.0 and run a db update on movies. the result is even more different as on the synology's devices.
After that I removed the test movie, run db scan, readded movie and re-run db scan. All this with debug info. Here is the log.embyserver_20200802__anon_W01.txt
The movie will be identified by file name (not directory name --> Crawl (2019)\Bullitt (1968).mkv) and to my astonishment the right movie for the name Bullitt (1968).mkv

Secont try with swapped names and log rotation before scanning: embyserver_20200802__anon_W02.txt
Again identified by filename and again took the right movie for the file name.

I will do also again a test with the synology as the behaviour seems to be different.

EDIT: Add Synology's logs

same test as for windows.

Crawl (2019)\Bullitt (1968).mkv embyserver_20200802__anon_S01.txt
Bullitt (1968)\Crawl (2019).mkv  embyserver_20200802__anon_S02.txt

MAIN DIFFERENCE:

Windows = file name indentify
Windows = right movie for name (Bullit 1968 --> Bullit 1968 / Crawl 2019 --> Crawl 2019)

Synology = folder name indentify
Synology = wrong movie for name (Bullit 1968 --> Chasing Bullitt 2018 / Crawl 2019 --> Crawl 2017)

EDIT 2: Additional informations

The options.xml file on both systems are identical!

Edited August 2, 2020 by BiTeTHeBiGG

[Luke 37060]

Yea that's strange. It would probably require fresh installs to do a valid comparison between the two.

[Nick D_CA 0]

On 5/17/2020 at 10:21 PM, Luke said:

 

I'm not sure yet, but we're going to be putting out a 4.4.3 update that has other fixes that could potentially impact this.

Any update on this issue?

I am on version 4.6.0.1 and this issue is still occurring. 

I have created new libraries, and confirmed the options.xml has <CollapseSingleItemFolders>true</CollapseSingleItemFolders> set (as per other suggestions in this thread), but I am still experiencing the same issues. Looks like Emby is only checking for metadata based on file name and not folder name. 

Here is an excerpt from the log...

2020-10-03 15:07:12.060 Debug App: Running FolderImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)
2020-10-03 15:07:12.064 Debug App: Running FFProbeProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.064 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: C:\Users\Nick\AppData\Roaming\MediaBrowser-Server\system\ffprobe.exe -i file:"L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2020-10-03 15:07:12.070 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2020-10-03 15:07:12.204 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0
2020-10-03 15:07:12.217 Debug App: Running MovieNfoProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.218 Debug App: Running OmdbItemProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.218 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&plot=full&r=json&y=2020&t=7sw5Py0MrTEJkyef6&type=movie
2020-10-03 15:07:12.344 Debug App: OmdbItemProvider returned no metadata for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.344 Debug App: Running MovieDbProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.345 Info App: MovieDbProvider: Finding id for item: 7sw5Py0MrTEJkyef6
2020-10-03 15:07:12.345 Info HttpClient: GET https://api.themoviedb.org/3/search/movie?api_key=f6bd687ffa63cd282b6ff2c6877f2669&query=7sw5Py0MrTEJkyef6&language=en
2020-10-03 15:07:12.400 Debug App: MovieDbProvider returned no metadata for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.400 Debug App: Running BaseGenreCleaner for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.400 Debug App: Running MovieDbImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.401 Debug App: Running FanartMovieImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.401 Debug ProviderManager: Saving L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv to Nfo.

 

[Happy2Play 8281]

2 minutes ago, Nick D_CA said:

Any update on this issue?

I am on version 4.6.0.1 and this issue is still occurring. 

I have created new libraries, and confirmed the options.xml has <CollapseSingleItemFolders>true</CollapseSingleItemFolders> set (as per other suggestions in this thread), but I am still experiencing the same issues. Looks like Emby is only checking for metadata based on file name and not folder name. 

Here is an excerpt from the log...

2020-10-03 15:07:12.060 Debug App: Running FolderImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)
2020-10-03 15:07:12.064 Debug App: Running FFProbeProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.064 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: C:\Users\Nick\AppData\Roaming\MediaBrowser-Server\system\ffprobe.exe -i file:"L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2020-10-03 15:07:12.070 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2020-10-03 15:07:12.204 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0
2020-10-03 15:07:12.217 Debug App: Running MovieNfoProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.218 Debug App: Running OmdbItemProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.218 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&plot=full&r=json&y=2020&t=7sw5Py0MrTEJkyef6&type=movie
2020-10-03 15:07:12.344 Debug App: OmdbItemProvider returned no metadata for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.344 Debug App: Running MovieDbProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.345 Info App: MovieDbProvider: Finding id for item: 7sw5Py0MrTEJkyef6
2020-10-03 15:07:12.345 Info HttpClient: GET https://api.themoviedb.org/3/search/movie?api_key=f6bd687ffa63cd282b6ff2c6877f2669&query=7sw5Py0MrTEJkyef6&language=en
2020-10-03 15:07:12.400 Debug App: MovieDbProvider returned no metadata for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.400 Debug App: Running BaseGenreCleaner for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.400 Debug App: Running MovieDbImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.401 Debug App: Running FanartMovieImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:07:12.401 Debug ProviderManager: Saving L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv to Nfo.

 

I am not positive of all the variables, but did you test created a New library with a new folder path and moved/copied a few items to it, does the same thing happen?

[Luke 37060]

And check the main server config file value of CollapseVideoFolders. Make sure that is true as well.

[Nick D_CA 0]

6 minutes ago, Happy2Play said:

I am not positive of all the variables, but did you test created a New library with a new folder path and moved/copied a few items to it, does the same thing happen?

I create a new library with new folder path. I have tried move/copy a few time, but hasn't helped. Are you saying I should start from blank and copy each folder one at a time back in? (This will take days.)

[Nick D_CA 0]

1 minute ago, Luke said:

And check the main server config file value of CollapseVideoFolders. Make sure that is true as well.

Little help with path or file name please?

[Happy2Play 8281]

1 minute ago, Nick D_CA said:

I create a new library with new folder path. I have tried move/copy a few time, but hasn't helped. Are you saying I should start from blank and copy each folder one at a time back in? (This will take days.)

New library with new folder path has worked for others within this topic.  So I was just verifying you have tried the same.  So you are saying a new library and path provide the same results as a existing library?

3 minutes ago, Luke said:

And check the main server config file value of CollapseVideoFolders. Make sure that is true as well.

Thought that was irrelevant on New Libraries?

[Luke 37060]

1 minute ago, Happy2Play said:

 

Thought that was irrelevant on New Libraries?

Yes you're right.

[Nick D_CA 0]

5 minutes ago, Happy2Play said:

New library with new folder path has worked for others within this topic.  So I was just verifying you have tried the same.  So you are saying a new library and path provide the same results as a existing library?

Correct, I tried same and it wasn't working for me. 

 

9 minutes ago, Luke said:

And check the main server config file value of CollapseVideoFolders. Make sure that is true as well.

Is this the file? C:\Users\USERNAME\AppData\Roaming\MediaBrowser-Server\config\system.xml

It was set to <CollapseSingleItemFolders>false</CollapseSingleItemFolders>, so I changed it to true and restarted Emby. It now appears to be working better, new update from log...

2020-10-03 15:52:22.234 Debug App: Running FFProbeProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.234 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: C:\Users\Nick\AppData\Roaming\MediaBrowser-Server\system\ffprobe.exe -i file:"L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2020-10-03 15:52:22.240 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2020-10-03 15:52:22.392 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0
2020-10-03 15:52:22.408 Debug App: Running MovieNfoProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.409 Debug App: Running OmdbItemProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.410 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&plot=full&r=json&y=2020&t=Mulan&type=movie
2020-10-03 15:52:22.511 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&i=tt4566758&plot=short&tomatoes=true&r=json
2020-10-03 15:52:22.634 Debug App: Running MovieDbProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.635 Info HttpClient: GET https://api.themoviedb.org/3/movie/tt4566758?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers&language=en&include_image_language=en,null
2020-10-03 15:52:22.815 Debug App: Running BaseGenreCleaner for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.815 Debug App: Running MovieDbImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.816 Debug App: Throttling Tmdb by 118 ms
2020-10-03 15:52:22.937 Info HttpClient: GET https://api.themoviedb.org/3/movie/337401?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers
2020-10-03 15:52:23.004 Debug App: Running FanartMovieImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:23.005 Info HttpClient: GET https://webservice.fanart.tv/v3/movies/337401?api_key=5c6b04c68e904cfed1e6cbc9a9e683d4
2020-10-03 15:52:23.377 Debug ProviderManager: Saving L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv to Nfo.

 

[Happy2Play 8281]

15 minutes ago, Nick D_CA said:

Correct, I tried same and it wasn't working for me. 

 

Is this the file? C:\Users\USERNAME\AppData\Roaming\MediaBrowser-Server\config\system.xml

It was set to <CollapseSingleItemFolders>false</CollapseSingleItemFolders>, so I changed it to true and restarted Emby. It now appears to be working better, new update from log...

2020-10-03 15:52:22.234 Debug App: Running FFProbeProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.234 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: C:\Users\Nick\AppData\Roaming\MediaBrowser-Server\system\ffprobe.exe -i file:"L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2020-10-03 15:52:22.240 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2020-10-03 15:52:22.392 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0
2020-10-03 15:52:22.408 Debug App: Running MovieNfoProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.409 Debug App: Running OmdbItemProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.410 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&plot=full&r=json&y=2020&t=Mulan&type=movie
2020-10-03 15:52:22.511 Info HttpClient: GET https://private.omdbapi.com?apikey=fe53f97e&i=tt4566758&plot=short&tomatoes=true&r=json
2020-10-03 15:52:22.634 Debug App: Running MovieDbProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.635 Info HttpClient: GET https://api.themoviedb.org/3/movie/tt4566758?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers&language=en&include_image_language=en,null
2020-10-03 15:52:22.815 Debug App: Running BaseGenreCleaner for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.815 Debug App: Running MovieDbImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:22.816 Debug App: Throttling Tmdb by 118 ms
2020-10-03 15:52:22.937 Info HttpClient: GET https://api.themoviedb.org/3/movie/337401?api_key=f6bd687ffa63cd282b6ff2c6877f2669&append_to_response=casts,releases,images,keywords,trailers
2020-10-03 15:52:23.004 Debug App: Running FanartMovieImageProvider for L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv
2020-10-03 15:52:23.005 Info HttpClient: GET https://webservice.fanart.tv/v3/movies/337401?api_key=5c6b04c68e904cfed1e6cbc9a9e683d4
2020-10-03 15:52:23.377 Debug ProviderManager: Saving L:\Organized Media\HD+ Movies\Mulan (2020)\7sw5Py0MrTEJkyef6.mkv to Nfo.

 

Something in logic is a miss as at least on my Windows systems system that flag is a global override so it does not matter whether library is true or false.  System has to be false to allow a library to be false.  But all that matters is it is working again.

Tested with true and false and I do not get different results.  It would be interesting if you changed back to false if Emby reverted back to searching filename again.

Edited October 3, 2020 by Happy2Play