Jump to content

Sync DB Sssllloooowwwwww


Go to solution Solved by im85288,

Recommended Posts

SwanStream
Posted (edited)

After the temp fix of the special character issue yesterday I got the sync to start. Didn't really pay attention to it, just let it run. The last time it ran for a few hours (lots of shows/episodes). This time it's really, really slow. I stopped updated to the 0.0.13 deleted the db and started it again. the sync is happening, but 1 episode every few seconds. It's an i7 processor, so should be on the fast side of things, not dead-dog slow. Prior experience it zipped right along....

 

Here's the log. Let me know if I can provide any more info!

 

Edit - Forgot to put the Emby for Kodi Beta in the title! Me So Sorry.

kodi.log

Edited by bikesquid
  • Solution
im85288
Posted

Yes we are aware of the slow initial sync time, in particular with tv shows. Optimisation on this will happen in a future version.

  • Like 1
xnappo
Posted (edited)

Keep in mind you only have to do this once.  We know it is slow and are working on it.  It is never going to be 'fast' though.  We have to throttle the adding otherwise it hammers the server.

Edited by xnappo
SwanStream
Posted

Anything I can do to either speed it up or limit so I can get on with some testing? I'd like to help out the project but with a very large tv show collection this initial sync could go on for 10 days at this rate.... And to be clear it was much faster in an earlier (0.0.8 I think) release.

xnappo
Posted (edited)

Set up another Emby server and don't add as much.

 

Make sure you have logging off.

Edited by xnappo
SwanStream
Posted

Keep in mind you only have to do this once.  We know it is slow and are working on it.  It is never going to be 'fast' though.  We have to throttle the adding otherwise it hammers the server.

 

Mentioned this in the previous post, but to be clear, this is much slower than the earlier version. I'm doing 1 episode every few seconds now, overnight it was 100 shows done. In version 0.0.8 (I think) it was done with the initial sync in a couple/few hours and was working at a 'several episodes/second' rate. So dramatically slower now.

im85288
Posted

Yes see above, we are aware of this. Remember this is beta testing, as stated we know there is an issue and are working on enhancements. Thanks for your patience.

xnappo
Posted

@ - if you want to help test, replace the attached file(rename to .py) in plugin.video.emby/resources/lib - let me know if you get errors.

 

 

LibrarySync.txt

Posted

Oh, I thought it was just something with my system causing me to have a 14 hour (and counting) sync after 0.0.8 was ~2 hours, glad to see it's known. :D 

im85288
Posted

Please try again with version 0.0.14 - it is a lot faster

SwanStream
Posted

@ - if you want to help test, replace the attached file(rename to .py) in plugin.video.emby/resources/lib - let me know if you get errors.

@@xnappo - was waiting a bit for .14 but that seems... mia, so did as you suggest and it's WAY faster! Back to "many episodes/second" rather than "many seconds/episode". Very Nice!

 

It's possible its even faster than the older versions too. Hard to tell. Regardless its more gooder! Let me know if there's anything else I can test to help out.

xnappo
Posted

Hopefully 0.15 will hit the server soon :)  More speed that that even, plus TV collection support! (remember beta though, so hope we didn't break anything!)

SwanStream
Posted

So, .14 was still born?

 

I assume if I go to add-ons/check for updates that should find it/update it?

 

(I've been removing the old version, then installing the new. And removing the directory and db file in between.

 

Do you still want us to do that each update or just delete the db?

SwanStream
Posted (edited)

Well now, there's some speed! Whatever you done, it done did something good... or should that be gooder?  :)

Edited by bikesquid
roberth58
Posted

Very very happy, I started at 4 days to sync TV shows with version 12, manually loaded 15 from github and it completed in 72 minutes. Thanks for the great work.

  • Like 1
SwanStream
Posted

The morning after.... Seems like the Sync DB is in a loop... maybe? Last night, after upping to 0.15 and a mighty snappy sync, it was done. This AM it was part way through a sync again. That seemed to finish while I watched the news. But now just checked again and it's 11% through a new Sync DB (notice in upper right corner) and "checking Episode:X" where X doesn't seem to change very quickly, maybe +1 every 30 seconds or so. 

xnappo
Posted

That is weird - it is showing the dialog box again?

 

Do you have more than one TV collection?  I am about to release a new version with a fix.

SwanStream
Posted

That is weird - it is showing the dialog box again?

 

Do you have more than one TV collection?  I am about to release a new version with a fix.

Screenshot attached. This is with 0.15 btw.

post-27807-0-96264500-1428249876_thumb.png

SwanStream
Posted

Do you have more than one TV collection?  I am about to release a new version with a fix.

I'm not clear on "collection". In Emby I've got TV shows defined by 4 different locations, i.e. base directories. screenshot attached

post-27807-0-77782300-1428250131_thumb.png

xnappo
Posted

I think that is just the normal background sync.  It is throttled and does a lot more checking.  You can turn off the display.

xnappo
Posted

I'm not clear on "collection". In Emby I've got TV shows defined by 4 different locations, i.e. base directories. screenshot attached

That is just one collection with multiple paths.  Not what I was talking about.  What you are seeing is the normal background syncing.  It should be somewhat faster in 0.0.16, but in general don't worry about that guy and just hide the dialog in Kodi settings.

SwanStream
Posted

Excellent!

SwanStream
Posted

Not to beat a dead horse, but just in case this isn't intended behavior. Each time Kodi starts it goes through a Sych DB process for an hour or so.... once its done, it relaxes for a few minutes, then starts all over again. It seems to recheck all episodes of every show, then do movies and boxsets each time. Is this being triggered by something like Emby seeing new content so Kodi just polls evverything again?

xnappo
Posted

That is how it is supposed to work right now.  We have event based code too, but it isn't fully proven out yet.  Disable the progress dialog and don't worry about it for now. 

Guest
This topic is now closed to further replies.
×
×
  • Create New...