Metadaten Scraping nur mehr in Englisch/Originalsprache

[kingom 5]

"Also since installing 4.8.0.80 i have a problem with metadata scraping."

[kingom 5]

Seit dem Update auf 4.8.0.80 habe ich das Problem das Metadaten nicht mehr nach den Vorgaben gescrapt werden.

Vorgabe ist Deutsch/Austria
Metadaten werden aber immer mit Original Titel und Englischen Infos befüllt.

Ändere ich den Titel manuel wird der beim nächsten Metadaten aktualisieren überschrieben obwohl dieser mit dem schloss gelocked sein sollte.
Ändere ich die bevorzugte sprache beim Film direkt wird das vorerst gespeichert, aktualisiere ich aber die Metadaten geht das Setting verloren. (Möglicherweise weil das Globale setting ident ist)

Habe ursprünglich alle Metadaten aktualisiert wegen dem neuen Emby Server Cache für Metadaten.
Dabei wurden viele Items die bereits auf Deutsch gescrapt waren auf Englisch umgeschrieben.

Habe jetzt testweise neue Files eingefügt diese werden auf deutsch gescrapt.
Habe auch schon versucht ein betroffenens File aus der DB zu löschen und neu einzuspielen - selbes problem

 

 

Since Upgrading to 4.8.0.80 i have problems with Metadata scraping.

Prefered language is set to German/Austria
Metadata is getting filles with Original Title and English Information.

If i do a manual change of the title this also will be overwritten even if i have selected the lock on the parameter.
If i change the prefered language withhin the Movie Item  itself, to override global settings, this settings gets deleted as soon as i refresh the metadata. (Maybe this is because the global setting is the same)

Originaly i updated all metadata so i can use the new Server metadata cache.
And whithin this a bunch of files that already where scrapt in german got replaced with Orig/English data.

Have tried to add new files and the get scraped in german how they should.
Also i tireb to delete a Item from Emby and re add it from scratch - there problem still exist and gets scraped wrong.

 

Ist zustand
this is how it currently looks

 

Jetzt bearbeite ich die Metadaten direkt ändere den titel und die Sprach settings.
Now i change the title info and prefered language.

 

ruft man das nochmal auf ist immer noch German/Austria zu sehen.
when i check again after closing, settings are shown as set.

 

lasse ich jetzt die metadaten aktualisieren mit replace all
Now i refresh metadata with replace all option

 

Bekomm ich wieder Original Titel mit Englischen Infos.
I again get the Original Title and English Info

 

Und auch die Sprach settings sind weg.
Also the prefered language settings are gone.

 

der zugehörige tmdb eintrag ist auf deutsch vorhanden
tmdb entry is in german
https://www.themoviedb.org/movie/1721-piu-forte-ragazzi?language=de

Übersehe ich irgendwas oder ist das ein Bug?
is there a settings somewhere that i'm missing or is this a bug?

[GrimReaper 3746]

Change country to Germany and Refresh metadata, as there's no de-AT translation for that movie (and likely many others) but there is de-DE:

 

 

de-AT vs de-DE

[kingom 5]

@GrimReaper

danke für die antwort.
Habe die settings geändert auf German/Germany.
nochmal gescrapt wieder Originaltitel und englische Info
dabei klang das so vielversprechend.
Es ist halt das das in der vergangenheit korrekt funktioniert hat und ich an den settings nichts verändert habe nur die neue Server version wurde installiert.

thanks for the response.
i changed settings to German/Germany
refreshed metadata - still original title and english info
but it sounded really promising already thought thats it
In the past this has all worked well with the old settings i had. I haave not changed any settings only updated the Server to current version.

 

Edited February 8 by kingom

[GrimReaper 3746]

Just now, kingom said:

i changed settings to German/Germany
refreshed metadata - still original title and english info

Have you selected "Replace all" as "Search for missing" won't change that? You can also post server log.

[kingom 5]

8 minutes ago, GrimReaper said:

Have you selected "Replace all" as "Search for missing" won't change that? You can also post server log.

ja hab ich natürlich ich ändere auch imemr den titel um zu sehen das die daten auchwirklich aktualisiert werden.
yeah sure, i always change the title upfront to see if scraping does something. and title changed.

aktivated Debug, thats all i see for the data refresh. full log attached

2024-02-08 16:33:00.055 Info App: Refresh metadata requested on 434346
2024-02-08 16:33:00.055 Info Server: http/2 Response 204 to host1. Time: 1ms. POST https://192.168.0.130:8920/emby/Items/434346/Refresh?Recursive=true&ImageRefreshMode=FullRefresh&MetadataRefreshMode=FullRefresh&ReplaceAllImages=false&ReplaceAllMetadata=true&X-Emby-Client=Emby Web&X-Emby-Device-Name=Brave Windows&X-Emby-Device-Id=3d46f48e-6a6a-4683-823a-69965f6d2c22&X-Emby-Client-Version=4.8.1.0&X-Emby-Token=x_secret1_x&X-Emby-Language=de
2024-02-08 16:33:00.055 Debug SqliteItemRepository: GetitemById Movie 434346 \\TOWER2\Movies\1080p\Zwei Himmelhunde auf dem Weg zur Hölle (1972)\Zwei Himmelhunde auf dem Weg zur Hölle (1972) 1080p h265 AC3.mkv
2024-02-08 16:33:00.129 Debug App: Running FFProbeProvider for \\TOWER2\Movies\1080p\Zwei Himmelhunde auf dem Weg zur Hölle (1972)\Zwei Himmelhunde auf dem Weg zur Hölle (1972) 1080p h265 AC3.mkv
2024-02-08 16:33:00.129 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: C:\Users\Administrator\AppData\Roaming\Emby-Server\system\ffprobe.exe -i file:"\\TOWER2\Movies\1080p\Zwei Himmelhunde auf dem Weg zur Hölle (1972)\Zwei Himmelhunde auf dem Weg zur Hölle (1972) 1080p h265 AC3.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2024-02-08 16:33:00.131 Debug MediaProbeManager: ProcessRun 'ffprobe' Started.
2024-02-08 16:33:00.187 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0 - Succeeded
2024-02-08 16:33:00.188 Debug App: Running MovieDbProvider for \\TOWER2\Movies\1080p\Zwei Himmelhunde auf dem Weg zur Hölle (1972)\Zwei Himmelhunde auf dem Weg zur Hölle (1972) 1080p h265 AC3.mkv
2024-02-08 16:33:00.189 Debug App: Running OmdbItemProvider for \\TOWER2\Movies\1080p\Zwei Himmelhunde auf dem Weg zur Hölle (1972)\Zwei Himmelhunde auf dem Weg zur Hölle (1972) 1080p h265 AC3.mkv
2024-02-08 16:33:00.189 Debug App: Running MovieNfoProvider for \\TOWER2\Movies\1080p\Zwei Himmelhunde auf dem Weg zur Hölle (1972)\Zwei Himmelhunde auf dem Weg zur Hölle (1972) 1080p h265 AC3.mkv
2024-02-08 16:33:00.199 Debug App: Running BaseGenreCleaner for \\TOWER2\Movies\1080p\Zwei Himmelhunde auf dem Weg zur Hölle (1972)\Zwei Himmelhunde auf dem Weg zur Hölle (1972) 1080p h265 AC3.mkv
2024-02-08 16:33:00.301 Debug SqliteItemRepository: GetitemById Tag 186274 diamond
2024-02-08 16:33:00.366 Debug SqliteItemRepository: GetitemById Tag 165199 airplane
2024-02-08 16:33:00.427 Debug App: CollectionDynamicImageProvider reports change to 165199 - 
2024-02-08 16:33:00.427 Debug App: Running CollectionDynamicImageProvider for airplane
2024-02-08 16:33:00.429 Debug App: Setting image url into item 165199
2024-02-08 16:33:00.429 Debug SqliteItemRepository: GetitemById Tag 263895 fistfight
2024-02-08 16:33:00.491 Debug SqliteItemRepository: GetitemById Tag 434391 thin
2024-02-08 16:33:00.553 Debug SqliteItemRepository: GetitemById Tag 340975 opal

embyserver (2).txt

[kingom 5]

vielleicht könnte mal jemand versuchen das nach zu stellen um zu sehen ob das ein Globales problem ist oder ob das nur meinen Server betrifft.

maybe someone would try reproducing this so we know if this is a global issue or if it's only a problem within my setup.

[Luke 38525]

Are any fields locked in the metadata editor?

[kingom 5]

1 minute ago, Luke said:

Are any fields locked in the metadata editor?

es macht keinen unterschied ob ich felder sperre, metadaten refresh überschreibt immer alle felder egal ob gesperrt oder nicht.
standardmässig sind alle felder entsperrt.

it doesn't make a difference. i tried locking the title field. but when i refresh metadata it replaces also the locked fields.
per default everything is unlocked

[Luke 38525]

Have you enabled saving metadata to nfo files?

[kingom 5]

1 hour ago, Luke said:

Have you enabled saving metadata to nfo files?

metadaten werden mit tmm prescrapt auf deutsch und sind für emby nur lesbar nicht schreibbar.
Emby scrapt die metadaten aber beim file import dann nochmal in die emby db und ersetzt alle info aus der bestehenden NFO.
Dadurch macht emby keine Fehler beim Fileimport und die identifizierung funktioniert zu 100%.

metadata is prescraped in german with tmm and read only for emby so it can't write the nfo files (never could).
But emby rescraps everything when importing the files into the emby db and replaces every information from the original NFO.
i do this, because so i have 100% identification success in emby.

[kingom 5]

gibt es eine möglichkeit emby zu sagen das es direkt die Info aus den vorhandenen NFO nimmt und nicht noch zusätzlich online scrapt?
oder zumindest nur fehlende Daten?

is there a way to tell emby to only use the existing nfo information and do not scrap metadata online?
Or only scrap missing data?

[GrimReaper 3746]

14 hours ago, kingom said:

metadata is prescraped in german with tmm and read only for emby so it can't write the nfo files (never could).
But emby rescraps everything when importing the files into the emby db and replaces every information from the original NFO.

If you use TMM, there's no need to have any Meta-providers or Image fetchers enabled in Emby, having Metadata Reader>NFO will suffice.

4 minutes ago, kingom said:

is there a way to tell emby to only use the existing nfo information and do not scrap metadata online?

Yes, as said above, disable/untick all meta-providers and Image fetchers; if your TMM instance is properly set-up, there's nothing that should be missing Emby-wise, and Emby will happily ingest whatever you serve.

[kingom 5]

58 minutes ago, GrimReaper said:

If you use TMM, there's no need to have any Meta-providers or Image fetchers enabled in Emby, having Metadata Reader>NFO will suffice.

Yes, as said above, disable/untick all meta-providers and Image fetchers; if your TMM instance is properly set-up, there's nothing that should be missing Emby-wise, and Emby will happily ingest whatever you serve.

danke für den Input werd ich versuchen.
Einfach in der Library die Provider disablen? oder gibt es noch wo ein globales setting?
Und danach einfach nochmal Metadaten refreshen mit replace all?

thanks for the input, i'll do that
simply disable these providers in the library? or is there sowhere else a global setting?
And then simple rescrap everything with replace all?

 

[kingom 5]

Habe jetzt die provider disabled und einen kompletten rescan gestartet.
Erste Items die einen Original titel hatten zeigen nun wieder den Deutschen Titel. Der Rest ist im queue zum scannen.

Denke das Problem ist für mich gelöst.
Aber vielleicht sollte man das doch noch nachstellen versuchen um zu sehen ob das ein generelles problem ist.

 

i unticked the providers and started a rescan.
And it appears to be working, some of the items with original titels already show german title. the rest is in queue for scanning.

So this is solved for me.
But it still think someone should check if this is a general problem.

[GrimReaper 3746]

1 hour ago, kingom said:

simply disable these providers in the library?

Yes. 

1 hour ago, kingom said:

or is there sowhere else a global setting?

Nope, it is per-library setting. 

1 hour ago, kingom said:

And then simple rescrap everything with replace all?

That might generally work, though you currently have mish-mash of metadata obtained by TMM and obtained by Emby, you might still end up with some odd/unwanted data, I'd suggest nuking that library and recreate it anew with only NFO data imported. 

[kingom 5]

everything has rescraped and everything looks nice.

I have marked it as solution even if its a workaround

BECAUSE i tried the same thing with a fresh emby installation and there this problem also appears so there definitely is an issue withhin emby itself since the mayor update (and not only my installation of it)

[Luke 38525]

Quote

If i change the prefered language withhin the Movie Item  itself, to override global settings, this settings gets deleted as soon as i refresh the metadata. (Maybe this is because the global setting is the same)

Hi, have you enabled saving metadata to nfo files?

[kingom 5]

On 2/11/2024 at 8:02 AM, Luke said:

Hi, have you enabled saving metadata to nfo files?

no, emby can't write NFO Files. Filesystem is Read Only.
But as i tested it doesn't make any difference.
 

I now have tested this through and it is DEFINITELY a problem that first occured with 4.8.0.80.

I did a fresh installation with 4.8.0.80 and the Title is in the original language (set to de-at)
i did a fresh installation with 4.7.14.0 and the Title is in the correct language (set to de-at)

In both cases i used the same dummy mkv file that i identified as the movie.

 

[kingom 5]

Is there a Bug already for this problem or how can i submit one?

[Luke 38525]

Hi, have you updated to Emby Server 4.8.1?

[kingom 5]

bug still exists in 4.8.1

But i did a test right now with the actual 4.9.0.4 beta and it looks like there it's working again  - thanks 

[Luke 38525]

On 2/18/2024 at 10:47 AM, kingom said:

bug still exists in 4.8.1

But i did a test right now with the actual 4.9.0.4 beta and it looks like there it's working again  - thanks 

HI, it's the same in both versions. It probably comes down to your metadata options.

[kingom 5]

5 hours ago, Luke said:

HI, it's the same in both versions. It probably comes down to your metadata options.

Have you tried this and can you reproduce it?

[kingom 5]

i don't get it, now it also happens when i try with 4.7.14.0
Looks like it's a me problem and I'll give up on this, i have a workaround in place, it's good for me.

Problems definetly started when updating to 4.8.0.80 and doing a full metadata rescan because of caching feature.
Maybe the problem was introduced in an earlier version and i only recognized it now when rescanning.