Jump to content

Keeps syncing and synching


chjohans

Recommended Posts

chjohans

I have an Emby server installation with a movie library with 300+ titles and a TV series library with about 1000 shows. I am running Kodi on a windows PC and a Raspberry Pi 2, both have the Emby for Kodi plugin installed. I have the Emby.Kodi Sync Que plugin installed on the Emby server. Kodi is v17.6 and Emby and all the plugins are the latest release versions.

 

This setup has worked mostly great for a very long time.

 

Lately I've noticed that Emby for Kodi initiates incremental syncs again and again, there is no way there has been that many changes in my libraries. It will sync again and again, several times a day, and on the Raspberry Pi it's especially bothersome since the sync process(es) will eventually hang the rpi.

 

I tried to uninstall and install the Emby.Kodi Sync Que plugin in the hope that this would reset the "change history" in case something were messed up with that, but it made no difference.

 

Any ideas on how to debug this? And is it pøossible to check/reset the "change history" the Emby.Kodi Sync Que plugin keeps? Where is this info stored?

 

Thanks in advance for any insight into this :)

Link to comment
Share on other sites

chjohans

What typically happens is that a few hundred items gets synced several times a day, typically between 600 and 1200 of my 3000+ movies and 1000+ series. On the windows PC this is reasonable fast (takes a few minutes), on my rpi it takes considerably longer and it often "hangs" unless I leave it completely alone during these syncs.

 

In my case it shows the sync message in  the upper right corner:

 

Processing updates: XXX items: YY %

Name-of-movie/show-being-processed

 

Previously this would only happen when I added titles to my library, and it would be so fast I hardly noticed since only a very few items would be updated at a time. Only very seldom would I ever see this message for more than 2-3 items at a time, until a few weeks ago that is. Now it happens all the time, every day.

Link to comment
Share on other sites

chjohans

Well, it's literally hundreds of items being sync'ed daily, no way so many items in my library changes every day. And if they do there must be something wrong. I just now saw a topic with a similar problem, maybe related?

 

It seems pretty random to me which movies/shows are getting sync'ed, but with literally hundreds being sync'ed every day my whole library must be sync'ed within 2-3 days. And this renders Emby for Kodi on my RPi pretty much not useable as it's too slow to handle the constant sync'ing.

Link to comment
Share on other sites

Can we just pick one and look at an example? If we can solve one then it might solve it for all of them. Thanks.

Link to comment
Share on other sites

chjohans

Attaching my server log for the past 24 hours. During that time the synch process has initiated more than 30 times (with 2 Emby for Kodi clients) and updated a few thousand items. There is no way I have even close to that many changes in my library in one day. This has been a "typical day", it's like this every single day and it all started a few weeks ago. Before that I only had the occational updates whenever I added something to my library or did some other change.

 

Please have a look at the attached server log and see if you can see anything suspicious.

 

Thanks! :)

server-63653385600.txt

Link to comment
Share on other sites

chjohans

Mostly everything should not be synced, but sorry my lack of knowledge of the internals of this prevents me from giving a specific example. I'm not able to translate the "ID numbers" it looks like the update task is referring to into actual media files. But if you help me with that I guess I can come up with actual examples.

Link to comment
Share on other sites

Mostly everything should not be synced, but sorry my lack of knowledge of the internals of this prevents me from giving a specific example. I'm not able to translate the "ID numbers" it looks like the update task is referring to into actual media files. But if you help me with that I guess I can come up with actual examples.

Mine does the same thing. Hundreds of items at a time, multiple times a day. I've never really thought much of it because it doesn't interfere with anything. But I can confirm mine is doing the same thing as you.

Link to comment
Share on other sites

Angelblue05

Mostly everything should not be synced, but sorry my lack of knowledge of the internals of this prevents me from giving a specific example. I'm not able to translate the "ID numbers" it looks like the update task is referring to into actual media files. But if you help me with that I guess I can come up with actual examples.

Check your Kodi log. The ids will show the titles associated in the log. Then you can track it on your server.

Edited by Angelblue05
Link to comment
Share on other sites

e123enitan

I have reported this issue before, on the server side, yesterday, I added two new movies click library scan it populated 2700 Sync between server and kodi. When I first spotted the issue the suggestion change to embycon, but that doesn't solve the issue, the question why is the server creating a new scan for items which were added many years ago. To that end I thought it could be my server has issue or glitch I did a fresh server installation rescan everything from scratch after few days the same issue begin.

I hope solution is sort to address why the server will randomly select certain movies for rescan, so far it doesn't happen for TV show that I am aware off.

Edited by e123enitan
Link to comment
Share on other sites

chjohans
Well these constant re-syncs renders Emby for Kodi on a Raspberry Pi unusable. It just can't cope with the amount of syncs, it slows down and will eventually hang. Unless it's left alone to do nothing else but synching. On my Win 10 PC it's less of a problem since it can deal with the syncs, but it's absolutely annoying!

 

In my case I've been running this same setup for at least a couple of years, and this constant sync problem only started a few weeks ago. I've done no major changes except keeping up with the latest versions of everything. My library typically increase with between 1-5 movies and 1-5 TV episodes every week.

 

My library is stored on a very fast NAS, my metadata is as it has always been managed by MCM and stored in each individual movie/TV Series folder, the Emby server is allowed top download it's own metadata (needed for "Auto Box Sets" to work) but keeps them in a separate folder, it does not and never has had write access to my movie library. I don't want it to mess with the media library itself as it is sync'ed with another location which has it's own Emby installation, and the same constant sync problem is going on there as well. The two sites are pretty much identical, except site 2 has fewer clients.

 

Since my kodi logfile has been deleted after I posted the logfile from Emby I retrieved another set of logfiles from Emby and Kody and picked *one* example (among thousands!) of a movie that should not have been synced but just did, together with way too many other movies that should not have been sync'ed either.

 

This is line 422 in the attached Kodi log:



00:53:41.615 T:872411904  NOTICE: EMBY.objects.movies -> UPDATE movie itemid: 8430d83a1285fd3d5616c3ee08cb1cb3 - Title: Gravity


 

I find the same "item id" on line 4458 in the attached Emby server log file:


2018-02-06 02:59:44.992 Info HttpServer: HTTP GET http://192.168.3.105:8096/emby/Users/314620670f7447b08059900535ba660f/Items?format=json&Fields=Path%2CGenres%2CSortName%2CStudios%2CWriter%2CProductionYear%2CTaglines%2CCommunityRating%2COfficialRating%2CCumulativeRunTimeTicks%2CMetascore%2CAirTime%2CDateCreated%2CMediaStreams%2CPeople%2COverview%2CCriticRating%2CCriticRatingSummary%2CEtag%2CShortOverview%2CProductionLocations%2CTags%2CProviderIds%2CParentId%2CRemoteTrailers%2CSpecialEpisodeNumbers%2CMediaSources%2CVoteCount&Ids=90eadb63a3a01b67955d147df8cd9961%2C2f0f985ff148b120846860dcd4b2430e%2C454ddcca36fe0f621618c722b0a252cb%2Ccc2b6b6074a281f719fdfc04096c2bf8%2Cce9713cb859267cc5d0d4936c831aa89%2C681e46e678c54dfb4e017b8245ee6880%2C62a5cf0c0924b9ccfa5f75e93aaf92d4%2C3894b7f934bd5706f9a0f2d5c5ccb3c5%2Cd4756a43cd0f9cb9df340db1fc979eaa%2C6d4a2731defd8481fae27502a560ed7e%2C05cb3b8ac524173664daa6af03eb49e9%2C1d94d01c89e0127da8847d6fa351922e%2C73b4f3e6f516bbda6aeba4b3f80ce1e1%2Ca3a405a81e0cd70622a91f0eaacb4bdb%2C8430d83a1285fd3d5616c3ee08cb1cb3. UserAgent:

 

 

Please see the attached screenshot for the file attributes in the folder for the movie above (Gravity).

 

I really like the Emby Kody integration and it's indeed "family friendly" but when it behaves like this it's pretty much unusable, too bad since it has worked pretty much without any problems for about 2 years now.

 

Please have a look at this issue devs, and if you need more info or more testing I'll help out as good as I can.

 

Thanks!

kodi.log

server-63653472002.txt

post-3090-0-86723500-1517938919_thumb.jpg

  • Like 1
Link to comment
Share on other sites

Try doing a refresh of that movie in emby, which will cause it to sync again, but then see if it continues to sync after that.

Link to comment
Share on other sites

chjohans

It's so busy sync'ing so it's kinda hard to see a 1-1 releationship between refresh and sync, even if there is one.

 

Is your theory that a "refresh" in Emby should sync that movie and stop it from synching again? If that's it, can I just refresh all the content in Emby, let it all sync once and see if it stops?

 

It can't be worse than it is and this would be a much easier test scenario.

Link to comment
Share on other sites

Angelblue05

Do you have nfos for the files?

 

What if you pick Gravity, and just delete the nfo and refresh it. Does the server syncs it infinitely?

Edited by Angelblue05
Link to comment
Share on other sites

chjohans

Yes, I have a nfo file for this and all my other media. Please see the example of my metadata file structure in my post above. My nfo files rarely change, and if they do I understand that this will initiate a sync.

 

But this test cannot be conclusive, even if that movie should not sync after I delete my .nfo file it's impossible to tell the reason, as there is no pattern to the sync (that I can find) so it just seems like any file will sync at any time totally random.

 

I can't very well delete all my .nfo files to test this as it will sync to my second location, can't do this kind of destructive testing on these two servers.

Edited by chjohans
Link to comment
Share on other sites

Angelblue05

I am not asking you to delete all the nfos, just Gravity and observe the behavior for the next days. If it stops popping up in your sync then we know the issue is regarding the nfo. That gives us something to focus on.

 

You know the id, so it's easy to search for it in your server logs on the upcoming days.

Edited by Angelblue05
Link to comment
Share on other sites

chjohans

I understand what you're asking me to do, but I would have to delete all the .nfo files for this test to be conclusive since we do not know for sure if this movie would sync the next few days even if I didn't delete the .nfo file.

 

But since there are no other suggestions I will delete that one .nfo file and monitor the log file for any sync of this particular movie.

 

Can I assume that the itemid for this movie will remain the same, or do I have to check kodi.log as well to find a new item ID for this movie in future syncs?

  • Like 1
Link to comment
Share on other sites

Angelblue05

Yes it will remain the same id. So if we don't see it in your logs for the next two days, let's say, then we know. If we do, then we know the nfos are not causing your issue. :)

 

I used to have these issues as well. In my case it was caused by nfos. I understand it's not fully conclusive. But it is something that may give us a clue where to look.

Edited by Angelblue05
Link to comment
Share on other sites

chjohans

Ok deleted the .nfo for Gravity, will monitor and see if trhis movie syncs for the next 2-3 days and then report back.

  • Like 1
Link to comment
Share on other sites

chjohans

Deleting the .nfo made no difference at all, the same movie and everything else keeps syncing and syncing and syncing.

 

How can I stop this?

Link to comment
Share on other sites

Guest
This topic is now closed to further replies.
×
×
  • Create New...