tommy793 0 Posted October 8, 2024 Posted October 8, 2024 I use a custom collection for holiday movies. This year, I went to check out my Halloween movie collection and the 50~ movies that were in it, were reduced down to 3 since last year. I deleted the collection and recreated it, adding the movies to the new collection. A few days later, my collection of 50~ movies is down to 37. I go through my library again, re-add all the movies, bringing the total in the collection back up to 50~, and then a few days later, I've got 43 movies in the collection. Nothing has changed with the library, the movies all still exist. I'm the only one that manages collections. Any ideas?
Abobader 3464 Posted October 8, 2024 Posted October 8, 2024 Hello tommy793, ** This is an auto reply ** Please wait for someone from staff support or our members to reply to you. It's recommended to provide more info, as it explain in this thread: Thank you. Emby Team
Gilgamesh_48 1240 Posted October 8, 2024 Posted October 8, 2024 27 minutes ago, tommy793 said: I use a custom collection for holiday movies. This year, I went to check out my Halloween movie collection and the 50~ movies that were in it, were reduced down to 3 since last year. I deleted the collection and recreated it, adding the movies to the new collection. A few days later, my collection of 50~ movies is down to 37. I go through my library again, re-add all the movies, bringing the total in the collection back up to 50~, and then a few days later, I've got 43 movies in the collection. Nothing has changed with the library, the movies all still exist. I'm the only one that manages collections. Any ideas? FWIW: I use nothing else but manually created collections and i have never, at least not yet, seen any movie removed from a collection nor have I had any movie added to a collection that I did not add. I suspect that something outside of Emby or something is improperly configured in Emby. Since I do not use automatic collections at all it is possible that some interaction between automatic and manual collections might be at the root cause of the problem. If you have automatic collections turned on for any involved libraries you might want to turn that function off and watch your collections to see if any item gets removed. While that will only help if you do not use automatic collections it can be a clue about what to look for by the Emby developers and for rare intermittent problems it could be the clue that allows for Emby to fix the problem. Also Emby will, probably, want to know if the collections you are seeing it in are "mixed" type, that is has both TV and Movies. I do not see how being "mixed" or not could impact the problem but I have no "mixed" collections at all. So, if it is related to "mixed/unmixed" that test would narrow it down. To diagnose this I would first turn off automatic collections and see if the nature of the problem changes. One more thing, I can verify that having items in several different collections does not cause problems as I have a good bit of overlap in my collection structure and they all remain where they are for me.
GrimReaper 4740 Posted October 8, 2024 Posted October 8, 2024 1 hour ago, tommy793 said: I use a custom collection for holiday movies. This year, I went to check out my Halloween movie collection and the 50~ movies that were in it, were reduced down to 3 since last year. I deleted the collection and recreated it, adding the movies to the new collection. A few days later, my collection of 50~ movies is down to 37. I go through my library again, re-add all the movies, bringing the total in the collection back up to 50~, and then a few days later, I've got 43 movies in the collection. Nothing has changed with the library, the movies all still exist. I'm the only one that manages collections. Any ideas? Do you save NFOs with your media? Were you refreshing metadata on any of those items?
tommy793 0 Posted October 8, 2024 Author Posted October 8, 2024 No, I don't save NFOs, no metadata refreshes, just normal scheduled library scans. The items in the collection span two libraries, but are the same media type, movies. I do use automatic collections and I don't see issues with those. The only external app that has connection to Emby is JellySeer, but I don't think its doing anything. I have used collections like this for as long as I've used emby, 3-4 years now. I may have thought a collection was missing an item or two here or there in prior years, but nothing like this that couldn't be attributed to user error.
Happy2Play 9780 Posted October 8, 2024 Posted October 8, 2024 Since you do not write nfo file, only thing I can think of would be Emby is removing and readding your media so it will lose the DB only data as it the item gets purged from the DB and then Readded, just a guess without logs from when it happened. Has Emby every saw your media/libraries offline/inaccessible? 1
tommy793 0 Posted October 8, 2024 Author Posted October 8, 2024 No, I run Emby as a docker container on my Unraid server, and the media is hosted on Unraid. Their uptime is 1:1.
Happy2Play 9780 Posted October 8, 2024 Posted October 8, 2024 Okay but uptime and library accessibility can be completely different. Per the many topics of shares going offline and Emby seeing no library data.
Gilgamesh_48 1240 Posted October 8, 2024 Posted October 8, 2024 21 minutes ago, Happy2Play said: Okay but uptime and library accessibility can be completely different. Per the many topics of shares going offline and Emby seeing no library data. I started storing my metadata with my media about the same time as Emby began allowing that. That might just be the "cause" of the problem as i remember losing a couple of collections early on before I came to my senses and started saving the metadata with my media. My early servers were less than unreliable and I used network based storage. It turned out that the intermittent loss of access caused me to have problems when Emby detected a change but there was not one. I changed to keeping media and metadata together and I have not seen a problem since. I also have found that when I rebuild my server(s) are a bit faster and, with the last main changes, all my collections reappear after a new server install. I do not use the Emby backup utility to restore to a new server but I do use the "Legacy backup" to restore watched states. One warning to anyone trying to install a new server: wait until everything finishes before creating any new collections.
tommy793 0 Posted October 8, 2024 Author Posted October 8, 2024 1 hour ago, Happy2Play said: Okay but uptime and library accessibility can be completely different. Per the many topics of shares going offline and Emby seeing no library data. I understand what you're saying, but it isn't the case here. Emby has not been online while the shares were offline. Losses to the collection have occurred within hours of creation, not even so much as a reboot has occurred.
Luke 42078 Posted October 8, 2024 Posted October 8, 2024 Hi, can you please provide a specific example? Thanks.
tommy793 0 Posted October 8, 2024 Author Posted October 8, 2024 I'm not sure how to demonstrate an example. I put Casper (1995) in to a collection called Halloween on Sunday. Today, it and a dozens others were no longer in the collection. Same thing happened the other day. I remade the collection again just now. It has 55 movies. I grabbed a screenshot. If there's a way to dump a collection to a text list, I'll do that. I haven't kept track of it's the same films being removed, but I haven't noticed a pattern with it, I don't think it is. I do have a client using the Emby for Kodi addon. Maybe that is doing something with it, not sure if it can manage collections, wouldn't expect it to be able to, but a possibility.
tommy793 0 Posted October 9, 2024 Author Posted October 9, 2024 Actually, one thing I just notice. This is a custom collection, so where did this collection description come from? https://i.imgur.com/hWjcg4l.png
Happy2Play 9780 Posted October 9, 2024 Posted October 9, 2024 1 hour ago, tommy793 said: Actually, one thing I just notice. This is a custom collection, so where did this collection description come from? https://i.imgur.com/hWjcg4l.png TMDB in this case a Wrong by Name lookup for a Custom Collection.
Happy2Play 9780 Posted October 9, 2024 Posted October 9, 2024 But a wrong lookup will not remove said item from a custom collection as they are linked per your custom Name. Since you don't write nfo files you would need to monitor logs for items being removed.
Happy2Play 9780 Posted October 9, 2024 Posted October 9, 2024 3 minutes ago, tommy793 said: Which log contains that information? Emby server log per the How to report a problem in post two, and it rotates daily at midnight and maintained for three days. If it has been longer that the logs are gone and may need to edit the system.xml to maintain logs longer if needed.
tommy793 0 Posted October 9, 2024 Author Posted October 9, 2024 Thanks. Don't see anything relevant in the logs, but they're attached. Same collection this morning, missing 8 items. I'm going to enable debug logging and then remake the collection again. https://i.imgur.com/Rl18wm6.png embyserver-63864028799.txt embyserver.txt
Carlo 4561 Posted October 9, 2024 Posted October 9, 2024 Hi, Do you have a log that covers the time frame of your nightly library scanning? Thanks
tommy793 0 Posted October 10, 2024 Author Posted October 10, 2024 (edited) Last two log files since I remade the collection. Dropped from 55 to 50 items. And apparently I am saving NFOs. I am seeing those are getting updated at times. https://i.imgur.com/MUJKhrS.png embyserver.txt embyserver-63864115200.txt Edited October 10, 2024 by tommy793
Carlo 4561 Posted October 10, 2024 Posted October 10, 2024 You mentioned previously you don't have NFO but the log files show NFOs and the library scan is showing these NFO changing: 2024-10-09 12:09:24.123 Debug LibraryMonitor: Change detected to /data/kids movies/The Bad Guys Haunted Heist (2024)/The Bad Guys Haunted Heist (2024).nfo 2024-10-09 12:09:24.123 Debug LibraryMonitor: New file refresher created for /data/kids movies/The Bad Guys Haunted Heist (2024)/The Bad Guys Haunted Heist (2024).nfo 2024-10-09 12:09:24.124 Debug LibraryMonitor: Change detected to /data/kids movies/The Bad Guys Haunted Heist (2024) 2024-10-09 12:09:24.125 Debug LibraryMonitor: Resetting file refresher from /data/kids movies/The Bad Guys Haunted Heist (2024)/poster.jpg to /data/kids movies/The Bad Guys Haunted Heist (2024) 2024-10-09 12:09:24.133 Info App: Deleting path /config/metadata/library/4a/4ad4c4210d64a6eccc7450208a056547 2024-10-09 21:53:55.528 Debug LibraryMonitor: Change detected to /data/movies/Alien (1979)/Alien.nfo 2024-10-09 21:53:55.528 Debug LibraryMonitor: New file refresher created for /data/movies/Alien (1979)/Alien.nfo 2024-10-09 21:53:55.528 Debug LibraryMonitor: Change detected to /data/movies/Alien (1979)/Alien.nfo 2024-10-09 21:53:55.528 Debug LibraryMonitor: Change detected to /data/movies/Alien (1979)/Alien.nfo 2024-10-09 21:53:56.241 Debug LibraryMonitor: Change detected to /data/movies/Aliens (1986)/Aliens (1986).nfo 2024-10-09 21:53:56.241 Debug LibraryMonitor: New file refresher created for /data/movies/Aliens (1986)/Aliens (1986).nfo 2024-10-09 21:53:56.255 Debug LibraryMonitor: Change detected to /data/movies/Aliens (1986)/Aliens (1986).nfo 2024-10-09 21:53:56.255 Debug LibraryMonitor: Change detected to /data/movies/Aliens (1986)/Aliens (1986).nfo 2024-10-09 21:53:56.255 Debug LibraryMonitor: Change detected to /data/movies/Aliens (1986)/Aliens (1986).nfo 2024-10-09 21:53:56.655 Debug LibraryMonitor: Change detected to /data/movies/Allegiant (2016) 720p/Allegiant 2016.nfo 2024-10-09 21:53:56.655 Debug LibraryMonitor: New file refresher created for /data/movies/Allegiant (2016) 720p/Allegiant 2016.nfo 2024-10-09 21:53:56.655 Debug LibraryMonitor: Change detected to /data/movies/Allegiant (2016) 720p/Allegiant 2016.nfo 2024-10-09 21:53:56.655 Debug LibraryMonitor: Change detected to /data/movies/Allegiant (2016) 720p/Allegiant 2016.nfo 2024-10-09 21:53:57.716 Debug LibraryMonitor: Change detected to /data/movies/American Psycho (2000) 720p/American Psycho 2000.nfo 2024-10-09 21:53:57.716 Debug LibraryMonitor: New file refresher created for /data/movies/American Psycho (2000) 720p/American Psycho 2000.nfo 2024-10-09 21:53:57.717 Debug LibraryMonitor: Change detected to /data/movies/American Psycho (2000) 720p/American Psycho 2000.nfo 2024-10-09 21:53:57.717 Debug LibraryMonitor: Change detected to /data/movies/American Psycho (2000) 720p/American Psycho 2000.nfo 2024-10-09 21:53:58.374 Debug LibraryMonitor: Change detected to /data/movies/Anyone But You (2023)/Anyone But You (2023).nfo 2024-10-09 21:53:58.374 Debug LibraryMonitor: New file refresher created for /data/movies/Anyone But You (2023)/Anyone But You (2023).nfo 2024-10-09 21:53:58.374 Debug LibraryMonitor: Change detected to /data/movies/Anyone But You (2023)/Anyone But You (2023).nfo 2024-10-09 21:53:58.374 Debug LibraryMonitor: Change detected to /data/movies/Anyone But You (2023)/Anyone But You (2023).nfo 2024-10-09 21:53:58.374 Debug LibraryMonitor: Change detected to /data/movies/Anyone But You (2023)/Anyone But You (2023).nfo 2024-10-09 21:53:59.409 Debug LibraryMonitor: Change detected to /data/movies/Avengers, The (2012) 720p/The Avengers 2012.nfo 2024-10-09 21:53:59.409 Debug LibraryMonitor: New file refresher created for /data/movies/Avengers, The (2012) 720p/The Avengers 2012.nfo 2024-10-09 21:53:59.409 Debug LibraryMonitor: Change detected to /data/movies/Avengers, The (2012) 720p/The Avengers 2012.nfo 2024-10-09 21:53:59.409 Debug LibraryMonitor: Change detected to /data/movies/Avengers, The (2012) 720p/The Avengers 2012.nfo 2024-10-09 21:53:59.409 Debug LibraryMonitor: Change detected to /data/movies/Avengers, The (2012) 720p/The Avengers 2012.nfo 2024-10-09 21:53:59.734 Debug LibraryMonitor: Change detected to /data/movies/Baby Driver (2017)/Baby Driver (2017).nfo 2024-10-09 21:53:59.734 Debug LibraryMonitor: New file refresher created for /data/movies/Baby Driver (2017)/Baby Driver (2017).nfo 2024-10-09 21:53:59.734 Debug LibraryMonitor: Change detected to /data/movies/Baby Driver (2017)/Baby Driver (2017).nfo 2024-10-09 21:53:59.734 Debug LibraryMonitor: Change detected to /data/movies/Baby Driver (2017)/Baby Driver (2017).nfo 2024-10-09 21:53:59.734 Debug LibraryMonitor: Change detected to /data/movies/Baby Driver (2017)/Baby Driver (2017).nfo 2024-10-09 21:54:00.184 Debug LibraryMonitor: Change detected to /data/movies/Back to the Future (1985)/Back to the Future (1985).nfo 2024-10-09 21:54:00.184 Debug LibraryMonitor: New file refresher created for /data/movies/Back to the Future (1985)/Back to the Future (1985).nfo 2024-10-09 21:54:00.184 Debug LibraryMonitor: Change detected to /data/movies/Back to the Future (1985)/Back to the Future (1985).nfo 2024-10-09 21:54:00.184 Debug LibraryMonitor: Change detected to /data/movies/Back to the Future (1985)/Back to the Future (1985).nfo 2024-10-09 21:54:00.184 Debug LibraryMonitor: Change detected to /data/movies/Back to the Future (1985)/Back to the Future (1985).nfo 2024-10-09 21:54:01.006 Debug LibraryMonitor: Change detected to /data/movies/Back to the Future Part II (1989)/Back to the Future Part II (1989).nfo 2024-10-09 21:54:01.006 Debug LibraryMonitor: New file refresher created for /data/movies/Back to the Future Part II (1989)/Back to the Future Part II (1989).nfo 2024-10-09 21:54:01.006 Debug LibraryMonitor: Change detected to /data/movies/Back to the Future Part II (1989)/Back to the Future Part II (1989).nfo 2024-10-09 21:54:01.006 Debug LibraryMonitor: Change detected to /data/movies/Back to the Future Part II (1989)/Back to the Future Part II (1989).nfo 2024-10-09 21:54:01.006 Debug LibraryMonitor: Change detected to /data/movies/Back to the Future Part II (1989)/Back to the Future Part II (1989).nfo many others as well I'm also seeing the scan not finding files: 2024-10-10 05:00:42.595 Error Server: Error processing request *** Error Report *** Version: 4.8.8.0 Command line: /app/emby/system/EmbyServer.dll -programdata /config -ffdetect /app/emby/bin/ffdetect -ffmpeg /app/emby/bin/ffmpeg -ffprobe /app/emby/bin/ffprobe -restartexitcode 3 Operating system: Linux version 6.1.36-Unraid (root@Develop) (gcc (GCC) 12.2.0, GNU ld version 2.40-slack151) #1 SMP PREEMPT_DYNAMIC Wed Jun 28 07:51:54 PDT 2023 Framework: .NET 6.0.25 OS/Process: x64/x64 Runtime: app/emby/system/System.Private.CoreLib.dll Processor count: 8 Data path: /config Application path: /app/emby/system MediaBrowser.Common.Extensions.ResourceNotFoundException: MediaBrowser.Common.Extensions.ResourceNotFoundException: Resource not found. Type: LibraryItem, Id: 38711 at Emby.Api.UserLibrary.UserLibraryService.Get(GetItem request) at Emby.Server.Implementations.Services.ServiceController.GetTaskResult(Task task) at Emby.Server.Implementations.Services.ServiceHandler.ProcessRequestAsync(HttpListenerHost httpHost, IServerApplicationHost appHost, IRequest httpReq, IResponse httpRes, IStreamHelper streamHelper, RestPath restPath, String responseContentType, CancellationToken cancellationToken) at Emby.Server.Implementations.HttpServer.HttpListenerHost.RequestHandler(IRequest httpReq, ReadOnlyMemory`1 urlString, ReadOnlyMemory`1 localPath, CancellationToken cancellationToken) Source: Emby.Api TargetSite: Void MoveNext() 2024-10-10 05:00:42.595 Info Server: http/1.1 Response 404 to host15. Time: 1ms. GET http://emby_remote_ip/Users/fff40e8fc9924712a31c7fcd5b432a20/Items/38711 Movie 38711 /data/kids movies/The Bad Guys Haunted Heist (2024)/The Bad Guys Haunted Heist (2024).mkv
tommy793 0 Posted October 10, 2024 Author Posted October 10, 2024 Yes, as I noted in my comment, I was mistaken. I didn't think I was, I don't recall enabling that option if it isn't default. Are NFOs causing items to be removed from custom collections?
Carlo 4561 Posted October 10, 2024 Posted October 10, 2024 That I'm not sure about. Do you have any idea why so many files are changing or being touched on your system?
Luke 42078 Posted October 11, 2024 Posted October 11, 2024 Do you have other software that updates your nfo files?
tommy793 0 Posted October 11, 2024 Author Posted October 11, 2024 13 hours ago, Carlo said: That I'm not sure about. Do you have any idea why so many files are changing or being touched on your system? No idea. Haven't ever really looked at the logs, don't know what level is abnormal. 7 hours ago, Luke said: Do you have other software that updates your nfo files? I have a pretty standard stack. Radarr/Sonarr/JellySeerr. Radarr does add meta data, I'll start poking around in there.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now