Jump to content


Photo

Conditions for metadata update

metadata refresh

  • Please log in to reply
18 replies to this topic

#1 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 18 March 2016 - 09:59 AM

Can anyone help me understand how exactly Emby decides whether to pull or not metadata from a provider?

 

Scenario:

- After noticing that a parental rating for a movie PG-13 was incorrect, I went to TheMovieDB and discovered that parental metadata for my country wasn't there, so it was returning the fallback English.

- In TMDB I inserted the parental rating BR-14 for Brazil, and saved.

- When trying to refresh metadata for the library or movie, it hasn't updated the rating as expected.

- Turned on "debugging log" in Emby.

- In logs, even after full refreshed, TheMovieDB wasn't being queried.

- Removed alternative providers for Movies. Didn't work.

- Reestarted server. Didn't work also.

- Erased the .nfo file in the folder. Full refreshed. Worked.

 

 

 

I began to think that if NFO exists... it would ignore Intenter provider querying....

but then I remembered that when I update some info as description in TMDB, sometimes it gets automatically, after a simple refresh.

 

So... what happended in the ratings case? What is the priority (internet, nfo)?

 

Tnx

 



#2 ebr OFFLINE  

ebr

    Chief Bottle Washer

  • Administrators
  • 45381 posts
  • Local time: 04:31 AM

Posted 18 March 2016 - 10:18 AM

Local metadata always takes priority - unless you manually tell it to replace it.

 

Also, updates in TMDb can take up to a couple of weeks to be visible to their API.  What you see on their website isn't exactly the same as what is exposed via the API.



#3 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 18 March 2016 - 10:54 AM

Local metadata always takes priority - unless you manually tell it to replace it.

 

I used the "Refresh" - "Full refresh" considering it as a manual replace action. Didnt work.

 

Also, updates in TMDb can take up to a couple of weeks to be visible to their API.  What you see on their website isn't exactly the same as what is exposed via the API.

 

As I told above... the query hasn't even been executed by Emby until I deleted the .NFO . After deleting it... the query appears in the log.

 

Browsing manually the query (API query) returned me the correct info, didn't have to wait couple of weeks this time.


Edited by anderbytes, 18 March 2016 - 12:29 PM.


#4 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 131524 posts
  • Local time: 04:31 AM

Posted 18 March 2016 - 01:03 PM

whenever you click the refresh button on an individual titles it does a full refresh - subject to your metadata settings though.



#5 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 18 March 2016 - 01:08 PM

Okay I believe you... but somehow the TheMovieDB isn't being queried every time,

 

That's why I asked if it skips TMDB in some IF's in the code



#6 Luke OFFLINE  

Luke

    System Architect

  • Administrators
  • 131524 posts
  • Local time: 04:31 AM

Posted 18 March 2016 - 01:09 PM

we cache tmdb info for up to 48 hours I believe, so that is why. it was refreshing from the cached content.


  • anderbytes likes this

#7 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 18 March 2016 - 01:20 PM

we cache tmdb info for up to 48 hours I believe, so that is why. it was refreshing from the cached content.

 

Good! Thanks for the info. That could explain what happened.

 

Shouldn't this information be visible somewhere in Emby in Metadata section?



#8 ebr OFFLINE  

ebr

    Chief Bottle Washer

  • Administrators
  • 45381 posts
  • Local time: 04:31 AM

Posted 18 March 2016 - 01:42 PM

Shouldn't this information be visible somewhere in Emby in Metadata section?

 

Which information?



#9 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 18 March 2016 - 01:48 PM

Something as "Please note that metadata is cached and old information can be visible for up to 48hs after modification in provider's DB".

 

The place: inside metadata section, in a "?" at the right of "The Movie DB" options.

 

Or if it applies to all providers... it should be a "?" tip more above, without specifying an unique provider.



#10 ebr OFFLINE  

ebr

    Chief Bottle Washer

  • Administrators
  • 45381 posts
  • Local time: 04:31 AM

Posted 18 March 2016 - 01:50 PM

Personally, I think that would just be confusing to most users.  It is also something that could be different for different providers and change over time with program logic so would be very hard to keep accurate and meaningful.



#11 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 18 March 2016 - 02:00 PM

Personally, I think that would just be confusing to most users.  It is also something that could be different for different providers and change over time with program logic so would be very hard to keep accurate and meaningful.

 

Ok, it's your call.

 

As I already know this and will always consider this variable, it won't make a difference to me.

I suggested it only to spread the explanation.



#12 softworkz OFFLINE  

softworkz

    Advanced Member

  • Developers
  • 1531 posts
  • Local time: 10:31 AM

Posted 22 March 2016 - 11:21 PM

we cache tmdb info for up to 48 hours I believe, so that is why. it was refreshing from the cached content.

 

Caching is a good thing, but I think that in such situations where a full metadata refresh is explicitly initiated by the user, the cache should be ignored and the data always be re-fetched from the remote providers.


  • anderbytes likes this

#13 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 23 March 2016 - 09:25 AM

Caching is a good thing, but I think that in such situations where a full metadata refresh is explicitly initiated by the user, the cache should be ignored and the data always be re-fetched from the remote providers.

 

Related to what I said in http://emby.media/co...adata/?p=314641



#14 ebr OFFLINE  

ebr

    Chief Bottle Washer

  • Administrators
  • 45381 posts
  • Local time: 04:31 AM

Posted 23 March 2016 - 10:30 AM

Caching is a good thing, but I think that in such situations where a full metadata refresh is explicitly initiated by the user, the cache should be ignored and the data always be re-fetched from the remote providers.

 

Except that opens up the ability for us to absolutely hammer the free metadata providers that we use for this data.



#15 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 23 March 2016 - 10:44 AM

Except that opens up the ability for us to absolutely hammer the free metadata providers that we use for this data.

 

So how to prevent that data will always be incorrect/old?

 

You understand people can just delete the cache folder and the NFO files and this will flood the entire provider, right?

 

OK... another suggestion then...

As the goal here is to correct wrong metadata... what about allowing users to only UNITARILY (item by item, as needed) rebuild it's CACHE+NFO ?

 

This way... providers won't be flooded unnecessarily with library rebuilds, wrong items will be corrected when noticed, and everybody ends winning.


Edited by anderbytes, 23 March 2016 - 10:45 AM.


#16 softworkz OFFLINE  

softworkz

    Advanced Member

  • Developers
  • 1531 posts
  • Local time: 10:31 AM

Posted 24 March 2016 - 05:00 AM

Except that opens up the ability for us to absolutely hammer the free metadata providers that we use for this data.

 

I didn't mean to make this work recursively. But explicitly refreshing an individual item should at least remote-refresh THIS items metadata.

(actually what @anderbytes described)



#17 ebr OFFLINE  

ebr

    Chief Bottle Washer

  • Administrators
  • 45381 posts
  • Local time: 04:31 AM

Posted 24 March 2016 - 08:59 AM

I didn't mean to make this work recursively. But explicitly refreshing an individual item should at least remote-refresh THIS items metadata.

(actually what @anderbytes described)

 

Yes, but, if you do that on a folder, then that manual refresh happens to everything under it.



#18 anderbytes OFFLINE  

anderbytes

    Advanced Member

  • Members
  • 1087 posts
  • Local time: 06:31 AM
  • LocationRio de Janeiro - Brazil

Posted 24 March 2016 - 09:31 AM

Yes, but, if you do that on a folder, then that manual refresh happens to everything under it.

 

Agree, that would be bad.

 

By item: good :)



#19 softworkz OFFLINE  

softworkz

    Advanced Member

  • Developers
  • 1531 posts
  • Local time: 10:31 AM

Posted 24 March 2016 - 09:35 AM

Yes, but, if you do that on a folder, then that manual refresh happens to everything under it.

 

And I wouldn't change that. Just perform a full refresh (including remote refresh) for the actual item and process subitems just like it's done today.







Also tagged with one or more of these keywords: metadata, refresh

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users