Collections being broken up

[jsc1205 51]

I'm not entirely sure why this keeps happening or how, but every now and then, I will find that movies have jumped out of the Collections I have created.  I have both the individua movies within the collection locked, as well as the collection itself.

Any idea why this keeps happening?  Really frustrating to constantly fix things.  Thanks!

[FrostByte 5392]

Did you replace a copy of a movie within the collection with a newer/better copy?  This happens to me when I do that.

[jsc1205 51]

20 minutes ago, FrostByte said:

Did you replace a copy of a movie within the collection with a newer/better copy?  This happens to me when I do that.

Nope, thats not the case with me.  Nothing has been changed with the movies at all.  One minute they are in a collection, then later on, they are not.  Thought by locking the collection it would prevent this but evidently its hit or miss.

[GrimReaper 4740]

Do you write NFOs with your media? 

[jsc1205 51]

1 hour ago, GrimReaper said:

Do you write NFOs with your media? 

No I dont

[GrimReaper 4740]

Maybe you should think about it, as that is the only sure way to retain your custom edits and/or custom collections. In case of db corruption, that would be the only way to revert those. 

In this particular case, each of those movies NFO would contain <set> tag within, 'linking' it to that particular collection (or multiple ones).

Edited November 20, 2021 by GrimReaper
Typo

[Happy2Play 9781]

The database should retain the collection items linked.  Since you don't write nfo files with media we will have to try and figure out what is updating your database then as this should not even be possible, especially with Locked media.

Can you go over a specific example.  

Edited November 21, 2021 by Happy2Play

[jsc1205 51]

44 minutes ago, Happy2Play said:

The database should retain the collection items linked.  Since you don't write nfo files with media we will have to try and figure out what is updating your database then as this should not even be possible, especially with Locked media.

Can you go over a specific example.  

Not exactly how much more of an example I can give other that what I provided above.  For example, the Dark Knight Collection.....which consists of 3 movies.  Each separate movie the metadata has been locked.  The metadata on the actual collection has been locked as well.  This morning, one of the movies was outside of the collection.  Both the movie and collection were still locked.

Regardless of the NFO, if an movie, collection or TV show is locked, I would assume that it protects it from changes etc.  No clue as to why "locked" isn't actually locking it.

[GrimReaper 4740]

5 minutes ago, jsc1205 said:

if an movie, collection or TV show is locked, I would assume that it protects it from changes etc. 

It should, and tbh have no idea why would (or how could) it be happening, seeing no NFOs - and save any other program (like *arr apps or some metadata manager) interfering there, can't really think what could be causing it.

[Happy2Play 9781]

18 minutes ago, jsc1205 said:

Not exactly how much more of an example I can give other that what I provided above.  For example, the Dark Knight Collection.....which consists of 3 movies.  Each separate movie the metadata has been locked.  The metadata on the actual collection has been locked as well.  This morning, one of the movies was outside of the collection.  Both the movie and collection were still locked.

Regardless of the NFO, if an movie, collection or TV show is locked, I would assume that it protects it from changes etc.  No clue as to why "locked" isn't actually locking it.

And if you unlock this Collection and the items and Refresh the item that was removed does it return to the Collection.

What server version are you on?

When was the Collection made?

How was the collection made?

What metadata providers do you have enabled?

With Emby being item metadata driven for Collections all I can guess is the database no longer/does not have the information to maintain the Collection.

But without steps to reproduce the issue it many be impossible to find the cause.  But will do some testing on my database only libraries.

 

Edited November 21, 2021 by Happy2Play

[GrimReaper 4740]

4 minutes ago, Happy2Play said:

all I can guess is the database no longer/does not have the information to maintain the Collection.

Was just thinking about asking OP how big his library.db is, to upload it. But still, it should be practically impossible for db to 'lose' collection info under above setup. 

[Happy2Play 9781]

And LOCKED could be a factor in the lose of Collections if the information does not exist do to locked items not being able to be updated.

[GrimReaper 4740]

Just now, Happy2Play said:

And LOCKED could be a factor in the lose of Collections if the information does not exist do to locked items not being able to be updated.

But that is exactly the point, it was a part of collection at some point - meaning data was there - removing it from collection means it was updated i.e. reference removed, and that should not have occurred. 

[Happy2Play 9781]

Just now, GrimReaper said:

But that is exactly the point, it was a part of collection at some point - meaning data was there - removing it from collection means it was updated i.e. reference removed, and that should not have occurred. 

But with the lack of information on server version this could be complete wrong.  All we can do is guess without all information from OP.  This is one reason log files are required for issues.

[jsc1205 51]

@Happy2Play

What server version are you on?  Currently on 4.6.6.0.  I update every time a new version is released.  I did notice this time that after updating is when some of these movies jumped out of the collections

When was the Collection made?  All of the collections I have were made in 2020 with some being more recent.  

How was the collection made?  Collections were either made automatically when scraped via TMDB or manually by me.  

What metadata providers do you have enabled?  TMDB first and The Open Movie Database second

Please know that this did not happen on just ONE collection.  It happens on various ones, but not all.  Not sure why others are affected and others are not.

[Carlo 4561]

I can see this happening if the drive or path is lost.  What could happen is the item gets removed, then on another scan when the path is available again gets added back again but won't be part of the collection.

I'd turn on NFO writing, and then do a a meta-data refresh to force the NFO to get written.  At that point your problem should be solved.

[GrimReaper 4740]

5 hours ago, cayars said:

I can see this happening if the drive or path is lost.  What could happen is the item gets removed, then on another scan when the path is available again gets added back again but won't be part of the collection.

Hmm, I'd say chances for that are quite minimal without OP noticing item not only being kicked out of collection but missing alltogether, as that would be result of path/drive lost/inaccessible, between two scans. 

Aside already few-times suggested NFO writing, only thing I can append (and as already pointed by @Happy2Play) would be for the OP to - next time same is observed - upload both current and previous server logs, hoping we might catch that change there. 

As a sidenote, @jsc1205, how do you have your media stored? Do you have RTM enabled? 

[Carlo 4561]

Yes I agree we need to look at log files which should tell the story.

I don't think that's a likely reason this would happen either @GrimReaper but a USB drive, rclone mount, network path going missing could cause the items to be removed from the library then picked back up again later on a connect.  Even then it sort of depends on the file system because I'm pretty sure Luke added code to the server so that if the parent mount point isn't present it won't remove items below it.

It's all just a guess without the logs or actually seeing what happened.

[FrostByte 5392]

I can see that being possible.  Like I mentioned before I see this sometimes when I replace a 1080p version of a movie from a collection with a 4K version and rescan.  So the old one gets deleted then it gets re-added.  It's sort of like when an external drive goes missing and movies get removed/re-added

[GrimReaper 4740]

5 minutes ago, FrostByte said:

I can see that being possible.  Like I mentioned before I see this sometimes when I replace a 1080p version of a movie from a collection with a 4K version and rescan.  So the old one gets deleted then it gets re-added.  It's sort of like when an external drive goes missing and movies get removed/re-added

Sure, but we just keep guessing, as OP did not at any point hinted at that, just that movies were dropping out of a collection. Something like that, I reckon would've been worth mentioning. 

Edit: Just re-read from top, see it was already negated upon your first post. 

Edited November 22, 2021 by GrimReaper
Append

[jsc1205 51]

Thanks for everyone chiming in on this.  Next time this happens I will send the logs.  It has not happened frequently but rather just several times.  All of my files are stored on a Synology NAS and 2 external drives connected to the NAS via USB.

[Luke 42080]

13 hours ago, jsc1205 said:

Thanks for everyone chiming in on this.  Next time this happens I will send the logs.  It has not happened frequently but rather just several times.  All of my files are stored on a Synology NAS and 2 external drives connected to the NAS via USB.

That would be great, thanks.