Refreshing Metadata removes title from all collections

[Digitoxin1 2]

I just had the same thing happen.  I turned on Generate Video Preview thumbnails in all my libraries and started a Scan Library task and now all of my Collections are gone.  The folders still exist, but nothing is assigned to them.  I checked in the Metadata manger and they are no longer listed here.

[Digitoxin1 2]

In Emby 4.8.0, if I refresh the Metadata on a title, the title is removed from all collections it belongs to.

[Luke 42080]

Hi there, depending on your settings, sometimes this could be normal. Let's look at a specific example:

How to Report a Problem

Thanks.

[Digitoxin1 2]

How do I prevent this.  I have titles with outdated metadata.  How do I update the metadata, but keep the title in the collections I have assigned them to.   I am manually creating my collections.  I am not using a plugin to do it for me.

[Luke 42080]

Just now, Digitoxin1 said:

How do I prevent this.  I have titles with outdated metadata.  How do I update the metadata, but keep the title in the collections I have assigned them to.   I am manually creating my collections.  I am not using a plugin to do it for me.

Let's look at a specific example:

How to Report a Problem

Thanks.

[user84 46]

I'm curious, what settings in Emby would result in media being removed from collections when metadata is refreshed?

[Digitoxin1 2]

I just picked a movie, chose Add to Collection.  I created a new collection called Test.  I then chose Refresh Metadata on the movie and chose the option Replace All Metdata, and the movie was removed from the collection.

Here is a snippet of my logs from when this happened

2024-02-08 20:10:25.206 Info Server: http/1.1 POST http://192.168.0.110:8096/emby/Collections?Name=test&Ids=288314&userId=c31c724c18384a8caf498db95930f956&X-Emby-Client=Emby Web&X-Emby-Device-Name=Chrome Windows&X-Emby-Device-Id=67fb0afa-fc70-402c-98a1-a74f7cd1e942&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=en-us. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36
2024-02-08 20:10:25.234 Info Server: http/1.1 Response 200 to host1. Time: 28ms. POST http://192.168.0.110:8096/emby/Collections?Name=test&Ids=288314&userId=c31c724c18384a8caf498db95930f956&X-Emby-Client=Emby Web&X-Emby-Device-Name=Chrome Windows&X-Emby-Device-Id=67fb0afa-fc70-402c-98a1-a74f7cd1e942&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=en-us
2024-02-08 20:10:25.292 Info Server: http/1.1 POST http://192.168.0.110:8096/emby/DisplayPreferences/usersettings?userId=c31c724c18384a8caf498db95930f956&client=emby&X-Emby-Client=Emby Web&X-Emby-Device-Name=Chrome Windows&X-Emby-Device-Id=67fb0afa-fc70-402c-98a1-a74f7cd1e942&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=en-us&reqformat=json. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36
2024-02-08 20:10:25.307 Info Server: http/1.1 Response 204 to host1. Time: 15ms. POST http://192.168.0.110:8096/emby/DisplayPreferences/usersettings?userId=c31c724c18384a8caf498db95930f956&client=emby&X-Emby-Client=Emby Web&X-Emby-Device-Name=Chrome Windows&X-Emby-Device-Id=67fb0afa-fc70-402c-98a1-a74f7cd1e942&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=en-us&reqformat=json
2024-02-08 20:10:25.328 Info HttpClient: GET https://api.themoviedb.org/3/configuration?api_key=x_secret3_x
2024-02-08 20:10:25.507 Info TheMovieDb: MovieDb settings: {"images":{"base_url":"http://image.tmdb.org/t/p/","secure_base_url":"https://image.tmdb.org/t/p/","backdrop_sizes":["w300","w780","w1280","original"],"logo_sizes":["w45","w92","w154","w185","w300","w500","original"],"poster_sizes":["w92","w154","w185","w342","w500","w780","original"],"profile_sizes":["w45","w185","h632","original"],"still_sizes":["w92","w185","w300","original"]},"change_keys":["adult","air_date","also_known_as","alternative_titles","biography","birthday","budget","cast","certifications","character_names","created_by","crew","deathday","episode","episode_number","episode_run_time","freebase_id","freebase_mid","general","genres","guest_stars","homepage","images","imdb_id","languages","name","network","origin_country","original_name","original_title","overview","parts","place_of_birth","plot_keywords","production_code","production_companies","production_countries","releases","revenue","runtime","season","season_number","season_regular","spoken_languages","status","tagline","title","translations","tvdb_id","tvrage_id","type","video","videos"]}
2024-02-08 20:10:25.509 Info TheMovieDb: MovieDbProvider: Finding id for item: test
2024-02-08 20:10:25.628 Info HttpClient: GET https://api.themoviedb.org/3/configuration/primary_translations?api_key=x_secret3_x
2024-02-08 20:10:25.705 Info TheMovieDb: MovieDb languages: ["af-ZA","ar-AE","ar-BH","ar-EG","ar-IQ","ar-JO","ar-LY","ar-MA","ar-QA","ar-SA","ar-TD","ar-YE","be-BY","bg-BG","bn-BD","ca-AD","ca-ES","ch-GU","cn-CN","cs-CZ","cy-GB","da-DK","de-AT","de-CH","de-DE","el-CY","el-GR","en-AG","en-AU","en-BB","en-BZ","en-CA","en-CM","en-GB","en-GG","en-GH","en-GI","en-GY","en-IE","en-JM","en-KE","en-LC","en-MW","en-NZ","en-PG","en-TC","en-US","en-ZM","en-ZW","eo-EO","es-AR","es-CL","es-DO","es-EC","es-ES","es-GQ","es-GT","es-HN","es-MX","es-NI","es-PA","es-PE","es-PY","es-SV","es-UY","et-EE","eu-ES","fa-IR","fi-FI","fr-BF","fr-CA","fr-CD","fr-CI","fr-FR","fr-GF","fr-GP","fr-MC","fr-ML","fr-MU","fr-PF","ga-IE","gd-GB","gl-ES","he-IL","hi-IN","hr-HR","hu-HU","id-ID","it-IT","it-VA","ja-JP","ka-GE","kk-KZ","kn-IN","ko-KR","ky-KG","lt-LT","lv-LV","ml-IN","mr-IN","ms-MY","ms-SG","nb-NO","nl-BE","nl-NL","no-NO","pa-IN","pl-PL","pt-AO","pt-BR","pt-MZ","pt-PT","ro-MD","ro-RO","ru-RU","si-LK","sk-SK","sl-SI","sq-AL","sq-XK","sr-ME","sr-RS","sv-SE","sw-TZ","ta-IN","te-IN","th-TH","tl-PH","tr-TR","uk-UA","ur-PK","vi-VN","zh-CN","zh-HK","zh-SG","zh-TW","zu-ZA"]
2024-02-08 20:10:25.938 Info HttpClient: GET https://api.themoviedb.org/3/search/collection?api_key=x_secret3_x&query=test&language=en-US
2024-02-08 20:10:26.238 Info HttpClient: GET https://api.themoviedb.org/3/collection/1068174?api_key=x_secret3_x&append_to_response=images&language=en-US&include_image_language=en-US,en,null,en
2024-02-08 20:10:26.544 Info HttpClient: GET https://api.themoviedb.org/3/collection/1068174?api_key=x_secret3_x&append_to_response=images
2024-02-08 20:10:26.640 Info HttpClient: GET https://webservice.fanart.tv/v3/movies/1068174?api_key=x_secret4_x
2024-02-08 20:10:38.019 Info Server: http/1.1 POST http://192.168.0.110:8096/emby/Items/288314/Refresh?Recursive=true&ImageRefreshMode=FullRefresh&MetadataRefreshMode=FullRefresh&ReplaceAllImages=false&ReplaceAllMetadata=true&X-Emby-Client=Emby Web&X-Emby-Device-Name=Chrome Windows&X-Emby-Device-Id=67fb0afa-fc70-402c-98a1-a74f7cd1e942&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=en-us. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36
2024-02-08 20:10:38.022 Info App: Refresh metadata requested on 288314
2024-02-08 20:10:38.022 Info Server: http/1.1 Response 204 to host1. Time: 3ms. POST http://192.168.0.110:8096/emby/Items/288314/Refresh?Recursive=true&ImageRefreshMode=FullRefresh&MetadataRefreshMode=FullRefresh&ReplaceAllImages=false&ReplaceAllMetadata=true&X-Emby-Client=Emby Web&X-Emby-Device-Name=Chrome Windows&X-Emby-Device-Id=67fb0afa-fc70-402c-98a1-a74f7cd1e942&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=en-us
2024-02-08 20:10:38.094 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: C:\Users\ray\AppData\Roaming\Emby-Server\system\ffprobe.exe -i file:"J:\Media Content\Movies\(New)\Anyone But You (2023)\Anyone But You (2023) (WEBDL-1080p h264 AC3[RUS+ENG]).mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2024-02-08 20:10:38.240 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0 - Succeeded
2024-02-08 20:10:38.529 Info HttpClient: POST https://api.opensubtitles.com/api/v1/login
2024-02-08 20:10:39.629 Info HttpClient: GET https://api.opensubtitles.com/api/v1/infos/languages
2024-02-08 20:10:39.664 Info OpenSubtitleComDownloader: Open Subtitles Languages: {"data":[{"language_code":"af","language_name":"Afrikaans"},{"language_code":"be","language_name":"Belarusian"},{"language_code":"my","language_name":"Burmese"},{"language_code":"ab","language_name":"Abkhazian"},{"language_code":"ar","language_name":"Arabic"},{"language_code":"hy","language_name":"Armenian"},{"language_code":"as","language_name":"Assamese"},{"language_code":"at","language_name":"Asturian"},{"language_code":"eu","language_name":"Basque"},{"language_code":"bn","language_name":"Bengali"},{"language_code":"br","language_name":"Breton"},{"language_code":"bg","language_name":"Bulgarian"},{"language_code":"ca","language_name":"Catalan"},{"language_code":"zh-cn","language_name":"Chinese (simplified)"},{"language_code":"fr","language_name":"French"},{"language_code":"ka","language_name":"Georgian"},{"language_code":"de","language_name":"German"},{"language_code":"gd","language_name":"Gaelic"},{"language_code":"ga","language_name":"Irish"},{"language_code":"gl","language_name":"Galician"},{"language_code":"el","language_name":"Greek"},{"language_code":"he","language_name":"Hebrew"},{"language_code":"hi","language_name":"Hindi"},{"language_code":"hr","language_name":"Croatian"},{"language_code":"hu","language_name":"Hungarian"},{"language_code":"ig","language_name":"Igbo"},{"language_code":"is","language_name":"Icelandic"},{"language_code":"ia","language_name":"Interlingua"},{"language_code":"kk","language_name":"Kazakh"},{"language_code":"lv","language_name":"Latvian"},{"language_code":"lt","language_name":"Lithuanian"},{"language_code":"ml","language_name":"Malayalam"},{"language_code":"it","language_name":"Italian"},{"language_code":"ja","language_name":"Japanese"},{"language_code":"km","language_name":"Khmer"},{"language_code":"ko","language_name":"Korean"},{"language_code":"ku","language_name":"Kurdish"},{"language_code":"mk","language_name":"Macedonian"},{"language_code":"mr","language_name":"Marathi"},{"language_code":"nv","language_name":"Navajo"},{"language_code":"no","language_name":"Norwegian"},{"language_code":"oc","language_name":"Occitan"},{"language_code":"fa","language_name":"Persian"},{"language_code":"pl","language_name":"Polish"},{"language_code":"pt-pt","language_name":"Portuguese"},{"language_code":"ps","language_name":"Pushto"},{"language_code":"ru","language_name":"Russian"},{"language_code":"sr","language_name":"Serbian"},{"language_code":"sk","language_name":"Slovak"},{"language_code":"sl","language_name":"Slovenian"},{"language_code":"sy","language_name":"Syriac"},{"language_code":"ta","language_name":"Tamil"},{"language_code":"me","language_name":"Montenegrin"},{"language_code":"ze","language_name":"Chinese bilingual"},{"language_code":"sd","language_name":"Sindhi"},{"language_code":"es","language_name":"Spanish"},{"language_code":"sw","language_name":"Swahili"},{"language_code":"sv","language_name":"Swedish"},{"language_code":"tt","language_name":"Tatar"},{"language_code":"te","language_name":"Telugu"},{"language_code":"th","language_name":"Thai"},{"language_code":"tk","language_name":"Turkmen"},{"language_code":"tr","language_name":"Turkish"},{"language_code":"uk","language_name":"Ukrainian"},{"language_code":"uz","language_name":"Uzbek"},{"language_code":"vi","language_name":"Vietnamese"},{"language_code":"cy","language_name":"Welsh"},{"language_code":"ro","language_name":"Romanian"},{"language_code":"pt-br","language_name":"Portuguese (BR)"},{"language_code":"zh-tw","language_name":"Chinese (traditional)"},{"language_code":"sq","language_name":"Albanian"},{"language_code":"an","language_name":"Aragonese"},{"language_code":"az","language_name":"Azerbaijani"},{"language_code":"bs","language_name":"Bosnian"},{"language_code":"cs","language_name":"Czech"},{"language_code":"da","language_name":"Danish"},{"language_code":"nl","language_name":"Dutch"},{"language_code":"en","language_name":"English"},{"language_code":"eo","language_name":"Esperanto"},{"language_code":"et","language_name":"Estonian"},{"language_code":"fi","language_name":"Finnish"},{"language_code":"id","language_name":"Indonesian"},{"language_code":"kn","language_name":"Kannada"},{"language_code":"lb","language_name":"Luxembourgish"},{"language_code":"ms","language_name":"Malay"},{"language_code":"ma","language_name":"Manipuri"},{"language_code":"mn","language_name":"Mongolian"},{"language_code":"ne","language_name":"Nepali"},{"language_code":"or","language_name":"Odia"},{"language_code":"si","language_name":"Sinhalese"},{"language_code":"se","language_name":"Northern Sami"},{"language_code":"so","language_name":"Somali"},{"language_code":"tl","language_name":"Tagalog"},{"language_code":"ur","language_name":"Urdu"},{"language_code":"pm","language_name":"Portuguese (MZ)"},{"language_code":"ea","language_name":"Spanish (LA)"},{"language_code":"ex","language_name":"Extremaduran"},{"language_code":"pr","language_name":"Dari"},{"language_code":"sp","language_name":"Spanish (EU)"},{"language_code":"sx","language_name":"Santali"},{"language_code":"tp","language_name":"Toki Pona"},{"language_code":"nb","language_name":"Norwegian Bokmal"}]}
2024-02-08 20:10:39.920 Info HttpClient: GET https://api.opensubtitles.com/api/v1/subtitles?languages=en&moviehash=52e2081e6196f449
2024-02-08 20:10:40.439 Info HttpClient: GET https://api.themoviedb.org/3/movie/1072790?api_key=x_secret3_x&append_to_response=alternative_titles,reviews,casts,releases,images,keywords,trailers&language=en-US&include_image_language=en-US,en,null,en
2024-02-08 20:10:41.524 Info Server: http/1.1 POST http://192.168.0.110:8096/emby/Sessions/Capabilities/Full?X-Emby-Client=Emby Web&X-Emby-Device-Name=Chrome Windows&X-Emby-Device-Id=67fb0afa-fc70-402c-98a1-a74f7cd1e942&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=en-us&reqformat=json. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36
2024-02-08 20:10:41.525 Info Server: http/1.1 Response 204 to host1. Time: 3ms. POST http://192.168.0.110:8096/emby/Sessions/Capabilities/Full?X-Emby-Client=Emby Web&X-Emby-Device-Name=Chrome Windows&X-Emby-Device-Id=67fb0afa-fc70-402c-98a1-a74f7cd1e942&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=en-us&reqformat=json
2024-02-08 20:10:41.718 Info App: Sqlite: 284 - automatic index on LastWatchedEpisodes(SeriesPresentationUniqueKey)

 

[Happy2Play 9782]

One question do you write metadata with media or just to database?

[Happy2Play 9782]

@LukeIf one does not write metadata (nfo) with media a Refresh Metadata replace all will clear database only set metadata.

This does not happen if you write nfo with media in my test.

Only tested on beta.

 

[MBSki 1114]

I've never had an item get removed from a collection when choosing Replace All Metadata and I don't use nfo's. Seems like something is broken to me.

[Happy2Play 9782]

3 minutes ago, MBSki said:

I've never had an item get removed from a collection when choosing Replace All Metadata and I don't use nfo's. Seems like something is broken to me.

Yep appears to be new as just retested in 4.7.14.0 and Collection was maintained.

[Luke 42080]

18 hours ago, Happy2Play said:

@LukeIf one does not write metadata (nfo) with media a Refresh Metadata replace all will clear database only set metadata.

This does not happen if you write nfo with media in my test.

Only tested on beta.

 

Does this happen for you with tags?

[Happy2Play 9782]

3 minutes ago, Luke said:

Does this happen for you with tags?

Unlocked field yes, locked field no. (db only test on 4.9.01)

[Luke 42080]

On 2/9/2024 at 3:41 PM, Happy2Play said:

Unlocked field yes, locked field no. (db only test on 4.9.01)

Thanks. This is the general expected behavior for most fields, but Collections are one that should be an exception. Looking into it. Thanks.

[MBSki 1114]

@Luke I don't see this in release notes for 4.8.3. Is it included? 

[Luke 42080]

Yes it is.