Collections "exploded" again

[Jack Burton 98]

So I've had an issue with collections every so often, and it just happened again. First, I do have the autobox plugin, which usually works great, and run emby for kodi as my media centre, which is where I noticed things were amiss. Scrolling through movies to find something to watch, I noticed The Dark Knight Rises on it's own, right below The Dark Knight Collection. Shit. Jumped to my server and sure enough, at least 1 movie from most collections jumped out on their own. I have 112 collections and just finished re adding 1 movie (a few had 2) to 108 of the collections. 4 collections were unaffected (seemingly at random, on different drives, different naming pattern, etc). This is the third time in a month or 2 that this has happened, though it's never been this many collections. Any ideas what might cause this? I uninstalled the autobox plugin last week which broke up all my collections. Re installed and it seemed to put everything back to normal until today. I even refreshed the plugin, and it put 1 collection back to normal and left the rest alone.

[moviemadnessman 13]

This issue used to happen more frequently ... sometimes, the metadata "loses" the tmdb collection id on a movie.  When that happens, the autoboxset plugin removes it from the collection, because as far as it can see, the movie(s) do not belong there.  Typically what will fix it is to go into the metadata manager, select the top layer of movies, then refresh missing data.  After that, the missing ids usually come back, and the offending videos are readded to the proper collection.

 

Manually running the plugin refresh is sometimes needed after this, but I generally have scans happen about every 6 hours, so I don't know.  And no, I don't know if it is known why the collection id/other info gets lost at times.

[ebr 16187]

Tmdb seems to constantly add and remove items from collections.  I guess that is one hazard of being a user-contributed content site.

 

Perhaps I should just make Auto Box Sets not quite so "auto" and never remove items from collections once they have been put in there...

[Jack Burton 98]

This issue used to happen more frequently ... sometimes, the metadata "loses" the tmdb collection id on a movie.  When that happens, the autoboxset plugin removes it from the collection, because as far as it can see, the movie(s) do not belong there.  Typically what will fix it is to go into the metadata manager, select the top layer of movies, then refresh missing data.  After that, the missing ids usually come back, and the offending videos are readded to the proper collection.

 

Manually running the plugin refresh is sometimes needed after this, but I generally have scans happen about every 6 hours, so I don't know.  And no, I don't know if it is known why the collection id/other info gets lost at times.

 

Awesome that sounds way easier. Didn't realize there was a refresh for all movies. I thought it'd have something to do with metadata, so I checked the movies that moved and they all had correct collection id's. Strange. Thanks for the help

[Jack Burton 98]

Tmdb seems to constantly add and remove items from collections.  I guess that is one hazard of being a user-contributed content site.

 

Perhaps I should just make Auto Box Sets not quite so "auto" and never remove items from collections once they have been put in there...

If that's not to much of a pain I think that'd be a great feature. I put way more work into my media than I should, get kind of anal about it so keeping things where I put them would be awesome

[Erik 124]

I asked a question over on TMDB forum regarding a collection that was removed. Here is their answer:

 

"I believe the collection was removed because it likely didn't meet our valid collection criteria.

 

There is a future feature where we will allow grouping movies by "universe" but until then, we try to make sure collections only represent sequels."

 

I thought @@ebr @@Luke you would want to see this (if you didn't know already) as having collections and universes would need some thought in how to integrate in Emby/Boxset plugin in the future.

Edited February 1, 2016 by Erik

[sh0rty 718]

Tmdb seems to constantly add and remove items from collections.  I guess that is one hazard of being a user-contributed content site.

 

Perhaps I should just make Auto Box Sets not quite so "auto" and never remove items from collections once they have been put in there...

 

But it seems (at least on my side) that also collections not modified in tmdb are affected. 300, Amazing Spider-Man, Captain America, Hangover and several other Collections e.g. lose constantly a movie. Although the correct Collection Number are in the nfo/xml in movie directory.

Edited February 1, 2016 by elysium

[FrostByte 5392]

There is a future feature where we will allow grouping movies by "universe" but until then, we try to make sure collections only represent sequels."

 

 

Thanks that would explain why collections like Charlie Brown are there one day and not the next.

[Deathsquirrel 745]

Tmdb seems to constantly add and remove items from collections.  I guess that is one hazard of being a user-contributed content site.

 

Perhaps I should just make Auto Box Sets not quite so "auto" and never remove items from collections once they have been put in there...

 

Fantastic idea, it would make it a lot safer to run the plugin day to day.

 

This TMDB unreliability is what made me uninstall the plugin.  The plugin worked fine.  I disagree with the source data.  I don't agree that collections should only be used for direct sequels.

Edited February 1, 2016 by Deathsquirrel

[ebr 16187]

Please try the dev version I just put up (1.1).

 

It no longer tries to remove items from collections.  This also means that, if you delete a movie that was in a collection then it won't get removed from the collection either...

[techywarrior 689]

That should solve the problem I have as well where almost everytime I add a movie to my library specific movies are removed from their respective boxsets. It's always the exact same ones every time and every time I notice it I check the metadata and the collection_id is there/correct.

 

Running the refresh boxset task fixes the problem but since it's not in the task list I can't automate it to run every so often.

 

This seems like a good fix. Not sure what will happen if a movie is removed from the library (like will the collection page break, have an error, etc.) but since I don't remove my movies from my library I am not worried about it

[Luke 42083]

With these changes the plugin should have virtually no performance impact on emby server. It will basically just sit there silently and run a little job at the end of the library scan.

[FrostByte 5392]

Probably a little late and not relevant anymore, but I noticed that of all my collections which dropped a movie they are all ones where I set a Sort Name for the movies inside (because of prequels, etc) and sorted the collection base on sort name.  For collections which I just left at the default sort order by release date then all movies that should have been there were. 

[Jack Burton 98]

Thanx for the help. Recent changes seem to have made an impact, looks great! Of course, noticed one small thing so far, and not the biggest deal. Anyway, a few movies came out of collections again and are now back in without me doing anything, so that's perfect. However, I have one movie, Tombstone, which I have 2 copies of (one theatrical and one with additional scenes, it's really awesome btw). Since both movies are technically the same (tmdb won't differentiate), it's now put both copies together so I can only access one. The poster has a blue 2 in the top left corner.