Frequent Incremental Updates Parse Same Items Over and Over.

[ChipWhisperer 5]

This will be part 2 of this problem. I originally posted it in the Kodi section of the forums, but was told incremental syncs are initiated server side, and not by the Kodi addon. After a few restarts of the server, the problem seems to have gone away, but it's back again.

 

 

Essentially, there appears to be some sort of library scanning loop. The server goes over the same 72ish items over and over again.
This can be seen in Kodi and on the server Dashboard, as it dutifully does the 90-100% of the library scan repeatedly. Once the scan reaches 100% ,Kodi incrementally updates the 72 items, and the process begins again.

 

The previous Topic is here:

https://emby.media/community/index.php?/topic/54446-incremental-sync-running-frequently-always-seems-to-be-parsing-same-items/

 

Thank you!

log1.txt

log2.txt

[Luke 42083]

Hi there, can you please discuss some examples of what exactly is  being resynced. There are some videos here that had subtitles downloaded during the library scan, so those certainly i imagine would be resynced.

[ChipWhisperer 5]

Hi there, can you please discuss some examples of what exactly is  being resynced. There are some videos here that had subtitles downloaded during the library scan, so those certainly i imagine would be resynced.

While the photos seem to suggest a scan of the TV Library, the updates that flow by in Kodi have all been movies as far as I can tell.

[ChipWhisperer 5]

Sorry. I misspoke in my previous reply. The scans are of the movie library, and the photos show that.

[Luke 42083]

ok, can you enable debug logging under the logging menu, restart the server, and then repeat the scenario? and then please attach that server log. thanks.

[ChipWhisperer 5]

ok, can you enable debug logging under the logging menu, restart the server, and then repeat the scenario? and then please attach that server log. thanks.

One of the logs attached to the original post was generated with the debug mode on, but just in case, I've attached the most recent again.

logredo.txt

[hd4fun 6]

As someone who rebuilds the library and folders all the time

 *** because they can't be edited ***

 

you probably have some naming issue

ie/  -

TV name [year]  as TV name (year)  by accident

Movie in the wrong folder ie/TV folder

 

also I moved my MB to Emby  and the library had some saved settings that were not correct

Rebuilding it folders one at a time allows you to check for issues

 

the issue is you are going out to the meta data providers a lot

which is probably not good

 

HTH

[ChipWhisperer 5]

As someone who rebuilds the library and folders all the time

 *** because they can't be edited ***

 

you probably have some naming issue

ie/  -

TV name [year]  as TV name (year)  by accident

Movie in the wrong folder ie/TV folder

 

also I moved my MB to Emby  and the library had some saved settings that were not correct

Rebuilding it folders one at a time allows you to check for issues

 

the issue is you are going out to the meta data providers a lot

which is probably not good

 

HTH

I appreciate the comment. I've gone through my files, everything is in the right place, and follows the Emby naming conventions.

[Luke 42083]

It's just odd because I don't really see and changes occurring in these logs other than a few downloaded subtitles.

[hd4fun 6]

How long have you had your libraries ?

As I mentioned - I destroyed them and rebuilt them

In perusing the logs - I occasionally seen a mention for a 2k8 server - which I haven't had in years

Non of my libraries and folders referenced it

 

And lastly - when you delete a folder - it doesn't delete the correct one from the library

So I reasoned that possibly the wrong info was still saved in the library

 

I have 80 TBs of storage - so it is a real pain

[ChipWhisperer 5]

It's just odd because I don't really see and changes occurring in these logs other than a few downloaded subtitles.

Hm, I might try a full metadata/subtitle replacement then.

Edited January 7, 2018 by ChipWhisperer

[ChipWhisperer 5]

It's just odd because I don't really see and changes occurring in these logs other than a few downloaded subtitles.

I went through and deleted all of the subtitles completely. The problem still happens, but now with 33 items instead of 72. I've been combing through, but nothing seems to make the items stand out as group, file type, size, dates, nada.

Edited January 7, 2018 by ChipWhisperer

[Luke 42083]

@@Angelblue05 it might be helpful if the sync process had a logging message for each item getting updated that would indicate what criteria was used to determine that it needed to be re-synced. Thanks.

[ChipWhisperer 5]

As far as I can tell, replacing all the metadata has solved the problem for now. I can only assume some element somewhere was corrupted.

[Angelblue05 4132]

@@Angelblue05 it might be helpful if the sync process had a logging message for each item getting updated that would indicate what criteria was used to determine that it needed to be re-synced. Thanks.

I don't know what you mean. The sync has no such knowledge. It processes whatever is sent via server event itemremoved, itemupdated, itemuserdataupdated. This is already established in the logs, but beyond that, it's not possible that would have to come from the server since nothing on the Kodi side generates update except user watching content...

 

 

Sent from my iPhone using Tapatalk