Few Movies not showing up.

[Mbppg 3]

I have a few movies in my Horror folder not showing up. Current setup is Emby version 4.5.4.0 on an Unraid docker. I was doing a hard drive swap to bigger drives a few months ago and I lost several shows, movies etc. I have most of the movies and TV shows back but I noticed a few movies missing from horror folder on Emby. The are in the folder structure and named correctly and worked fine before the data loss. Also the Emby data was on a cache drive so no loss of data there.

I have removed them from the folder and added them back to the folder and they do not show up. I have tried a few things but decided to backup and then remove the library DB. I let the discovery process run and the two of the missing movies showed back up. Until the discovery process fully completed about 24 hours later (I have over 40 TB of movies and tv shows) then they were gone again. I also do not see them in the metadata manager and they were there after the fresh DB started back up and disappeared again once the discovery process was completed. 

I think before I deleted the DB that I saw one of the missing movies "Teeth" was listed in the log file but then it looked like it was removed for some reason. But since the reboot, I no longer have that log file. I have included the latest one.

Let me know if you need any other info or have questions.

Thanks and Happy New Year (so done with 2020).

 

embyserver-63744998631.txt

Edited December 31, 2020 by Mbppg

[Carlo 4561]

An off the cuff guess is they are there but with the wrong name.  Like they matched to a different movie.

I've had this happen to me and what I did to find it was to run a SQL query against the database using the path of the file.  You could likely do this with a plugin as well to export the database or library to a CSV or excel spreadsheet format that you could look/search.

[Gilgamesh_48 1240]

I have also had this happen a few times but I took the easy way out and sorted by date added and found that the problem files were among the first. Of course that will not work if it has been some time since the files were added but I usually check my library no longer than a few days after I add files.

[Luke 42081]

Hi, how are your files named and organized?

[Mbppg 3]

Top folder is media/Horror/movie name (year)/movie name (year).mp4.

[Rec] 2 happens to be one of the movies not showing up

[Rec] 2 not showing up in metadata manger

[Mbppg 3]

12 hours ago, cayars said:

An off the cuff guess is they are there but with the wrong name.  Like they matched to a different movie.

I've had this happen to me and what I did to find it was to run a SQL query against the database using the path of the file.  You could likely do this with a plugin as well to export the database or library to a CSV or excel spreadsheet format that you could look/search.

Cayars, how would I do that? Not an SQL guy, exporting to CSV will work, just need to know how to do that. You mentioned a plugin, but I did not see one on Emby for DB plugin.

[Mbppg 3]

So I removed [Red] 2 from the horror folder, ran a scan and then put [Rec] 2 back into the horror folder and ran a scan again. Then looked at the log and it looks like it gets removed:

2021-01-01 06:39:15.173 Info Server: http/1.1 GET http://10.0.1.250:8096/emby/Items/3576/Images/Backdrop/0?tag=d3b1638b0c45dba28bfce6d31dc0aabd&maxWidth=1200&quality=70. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.101 Safari/537.36
2021-01-01 06:39:15.499 Debug BaseItem: Removed item: /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:39:15.499 Info App: Removing item from database, Type: Movie, Name: Iron Man 2, Path: /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4, Id: 211525
2021-01-01 06:39:15.499 Info App: Deleting path /config/metadata/library/ba/ba91793feaa9f6f0addc8570c8b48c27
2021-01-01 06:39:15.543 Debug ImageProcessor: Image encoding to /config/cache/images/resized-images/8/8dacb612-79b1-1c8b-a710-daf89cc6fee9.webp took 357ms for 

 

And then get put back in a couple minute later:

2021-01-01 06:41:25.731 Info LibraryMonitor: Horror (/media/Horror) will be refreshed.
2021-01-01 06:41:46.210 Debug App: Running FFProbeProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:46.210 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: /bin/ffprobe -i file:"/media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2021-01-01 06:41:46.229 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2021-01-01 06:41:46.327 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0
2021-01-01 06:41:46.349 Debug App: Running MovieNfoProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:46.353 Debug App: Running MovieDbProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:46.361 Debug App: Running OmdbItemProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:46.364 Debug App: Running FanartMovieImageProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:47.842 Debug ProviderManager: Saving /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4 to Nfo.

I have included the log file. Am I missing something. Looks like it should be there.

embyserver (1).txt

[Gilgamesh_48 1240]

I have [Rec} movies in my library and they are found and names correctly. However they have been in my library for a long time and I seem to remember that I had some trouble with their naming when first imported. What I remember is that they were named something weird and I had to do an "Identify" to get them named correctly.. Of course if you do not find the under any name then you can't "identify" them.

If I remember correctly part of the problem with [Rec] is that Emby is supposed to ignore anything in square brackets so [Rec] would be ignored.

Try naming those movies and folders just Rec to see if Emby can match them that way. I cannot guarantee that my old memory is correct or that what I suggest will work at all but it seems worth a try.

Also when matched "[Rec]" becomes the first movie (Maybe the second behind "+1" ) in my library when it is sorted alphabetically but I change the "Sort title" to "Rec" as it seems more logical to me to have it in with the "Rs"

[Carlo 4561]

1 hour ago, Mbppg said:

So I removed [Red] 2 from the horror folder, ran a scan and then put [Rec] 2 back into the horror folder and ran a scan again. Then looked at the log and it looks like it gets removed:

2021-01-01 06:39:15.173 Info Server: http/1.1 GET http://10.0.1.250:8096/emby/Items/3576/Images/Backdrop/0?tag=d3b1638b0c45dba28bfce6d31dc0aabd&maxWidth=1200&quality=70. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.101 Safari/537.36
2021-01-01 06:39:15.499 Debug BaseItem: Removed item: /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:39:15.499 Info App: Removing item from database, Type: Movie, Name: Iron Man 2, Path: /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4, Id: 211525
2021-01-01 06:39:15.499 Info App: Deleting path /config/metadata/library/ba/ba91793feaa9f6f0addc8570c8b48c27
2021-01-01 06:39:15.543 Debug ImageProcessor: Image encoding to /config/cache/images/resized-images/8/8dacb612-79b1-1c8b-a710-daf89cc6fee9.webp took 357ms for 

 

And then get put back in a couple minute later:

2021-01-01 06:41:25.731 Info LibraryMonitor: Horror (/media/Horror) will be refreshed.
2021-01-01 06:41:46.210 Debug App: Running FFProbeProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:46.210 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: /bin/ffprobe -i file:"/media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2021-01-01 06:41:46.229 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2021-01-01 06:41:46.327 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0
2021-01-01 06:41:46.349 Debug App: Running MovieNfoProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:46.353 Debug App: Running MovieDbProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:46.361 Debug App: Running OmdbItemProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:46.364 Debug App: Running FanartMovieImageProvider for /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4
2021-01-01 06:41:47.842 Debug ProviderManager: Saving /media/Horror/[Rec] 2 (2009)/[Rec] 2 (2009).mp4 to Nfo.

I have included the log file. Am I missing something. Looks like it should be there.

embyserver (1).txt 436.96 kB · 0 downloads

It shows it as being "Iron Man 2" when it was deleted so that would be a good place to look.
Also since you have the NFO you can open and look at this for clues.

If the movie won't match correctly and the NFO has bad info you may need to remove the NFO or use it to find them movie and then manually identify it from the 3 dot menu.

Edited January 1, 2021 by cayars

[ebr 16185]

What Cayars said.  Look inside that nfo file.  Dollars to doughnuts it says it is some other movie.

[Mbppg 3]

1 hour ago, Gilgamesh_48 said:

I have [Rec} movies in my library and they are found and names correctly. However they have been in my library for a long time and I seem to remember that I had some trouble with their naming when first imported. What I remember is that they were named something weird and I had to do an "Identify" to get them named correctly.. Of course if you do not find the under any name then you can't "identify" them.

If I remember correctly part of the problem with [Rec] is that Emby is supposed to ignore anything in square brackets so [Rec] would be ignored.

Try naming those movies and folders just Rec to see if Emby can match them that way. I cannot guarantee that my old memory is correct or that what I suggest will work at all but it seems worth a try.

Also when matched "[Rec]" becomes the first movie (Maybe the second behind "+1" ) in my library when it is sorted alphabetically but I change the "Sort title" to "Rec" as it seems more logical to me to have it in with the "Rs"

Thanks Gilamesh, I did try that before I posted the original post and it did not work.

[Mbppg 3]

2 hours ago, cayars said:

It shows it as being "Iron Man 2" when it was deleted so that would be a good place to look.
Also since you have the NFO you can open and look at this for clues.

If the movie won't match correctly and the NFO has bad info you may need to remove the NFO or use it to find them movie and then manually identify it from the 3 dot menu.

Okay so I opened the nfo and yes it thinks it is Iron Man. Which is funny as I have all the Iron man movies in my Movies folder and they are reporting correctly:

So learning a lot here, but how does Emby pull this info in thinking it is Iron Man? Could it be the collections as that has been acting a bit weird as well? I also checked the IMDBid and the [Rec] 2 nfo file has the ID for Iron man and not the correct ID for [Rec] 2 which is tt1245112.

Edited January 1, 2021 by Mbppg

[Mbppg 3]

Looks like other movie Teeth is suffering from the same fate:

Edited January 1, 2021 by Mbppg

[Aevaris 8]

22 hours ago, Mbppg said:

Okay so I opened the nfo and yes it thinks it is Iron Man. Which is funny as I have all the Iron man movies in my Movies folder and they are reporting correctly:

So learning a lot here, but how does Emby pull this info in thinking it is Iron Man? Could it be the collections as that has been acting a bit weird as well? I also checked the IMDBid and the [Rec] 2 nfo file has the ID for Iron man and not the correct ID for [Rec] 2 which is tt1245112.

I found that once a media item has been given an ID, it keeps that and uses that as the source of truth (performance reasons I suspect). As a result, Emby will not attempt to re-identify unless you either remove or manually change/re-identify the ID.

[Mbppg 3]

21 hours ago, Aevaris said:

I found that once a media item has been given an ID, it keeps that and uses that as the source of truth (performance reasons I suspect). As a result, Emby will not attempt to re-identify unless you either remove or manually change/re-identify the ID.

Thanks @Aevaris, I went back and did what @Gilgamesh_48 suggested. I first deleted the nfo file, then moved the folders with the movies that were not showing up to a non linked library and ran a scan. Then I renamed the movies by added a space and then a 1 behind the name of the movie and then moved in back in the the library folder and ran another scan. Once the movie popped up I quickly identified movies with the correct data (using the identify screen) and now they are working fine. Then I verified the correct info was in the nfo file. 

Problem is I have over 24,000 movies and tv shows and I am sure there are a few more missing or mismatched movies and finding a few out of 24,000 if a pretty big task. But not sure if it is easy to make a tool or run a script to find mismatched movie names etc.

Plus I would still like to know how Emby pulls the data in the first place. Esp. when I deleted the library DB completely, let a full new scan complete where the movies did pop up for a while but them later disappeared with the incorrect info. The one example I remember now is [Rec] 2 showed up in the library and metadata manager as the correct movie until the first scan after the new DB was completed then it disappeared and the nfo said it was Iron Man. I remember the log file said it was Iron Man before I deleted the DB as well so why or how did that carry over from a complete DB delete? Unless there is another file or DB I should have deleted as well????

[Carlo 4561]

The best way to avoid this is to use a naming convention that matches what it's the knowledge base.

That will give you the best match rate but with thousands of movies there will be a few to get mismatched just due to funny movie naming.  There's really no easy way to find these other than use from my experience.  Or doing an export so you can see movie name and file name.  Then you just look at several hundred each day (or whatever).  <-- that's what I've done.

[Mbppg 3]

@cayars that is what I expected and yes I am very aware of the naming convention, I have been running Plex and then Emby servers for years.

I have found kind of a work around, well at least to help me identify dupe files or possible incorrect nfo files. I found that on Plex, (yes I used this before Emby, but I find Emby much better in most ways and my main media delivery tool) that by using the duplicate files search I am able to see duplicate files and then going to the individual names and look at the nfo file data to find the incorrect one. This saves me lots of time looking thought each file. I know that may not catch all the "missing" files but it does catch most. then when there are a few files left (after the Plex search and fix) I will use the amount of reported movies vs. the amount of folders in the my individual media folders to find missing movies in Emby. Again not the best solution but but it seems to be working and saving a bunch of time.