embyforkodi (next-gen) 6.X.X support

[heula 189]

33 minutes ago, quickmic said:

Same for this file:

The path seems also wrong, not sure but ""Path":"nfs://192.168.1.157/volume4/Recordings/Ik hou van Holland"" should include the complete path to the file.

is "nfs://192.168.1.157/volume4/Recordings/Ik hou van Holland" a file, and if yes, why it hasn't an extension?

 

btw, seems these are all recordings. This also explains, why it's not synced.

 

{
   "Name":"Ik hou van Holland",
   "OriginalTitle":"Ik hou van Holland",
   "ServerId":"3d3dbbfd74f34e23a4e6fa9ff4dd5461",
   "Id":"1468988",
   "Etag":"00ef11a4f25a7dd464ae3a161a608bdc",
   "DateCreated":"2019-09-07T21:50:47.0000000+00:00",
   "PresentationUniqueKey":"156921-nl-79a2726d3c50e769a8af1e4184e4fccf",
   "SortName":"Ik hou van Holland",
   "PremiereDate":"2008-03-07T23:00:00.0000000+00:00",
   "Path":"nfs://192.168.1.157/volume4/Recordings/Ik hou van Holland",
   "OfficialRating":"NL-AL",
   "Overview":"Elke week strijden 2 teams tegen elkaar om een prijs voor hun supporters vak. De teams bestaan uit 3 bekende nederlanders en worden geleid door Jeroen van Koningsbrugge en Peter Heerschop. De presentatie is in handen van Linda de Mol.",
   "Taglines":[
      
   ],
   "Genres":[
      "Game Show"
   ],
   "CommunityRating":6.1,
   "RunTimeTicks":39000000000,
   "ProductionYear":2008,
   "RemoteTrailers":[
      
   ],
   "ProviderIds":{
      "Imdb":"tt1201796",
      "Tmdb":"15817",
      "Tvdb":"156921"
   },
   "IsFolder":true,
   "ParentId":"1465587",
   "Type":"Series",
   "People":[
      {
         "Name":"Linda de Mol",
         "Id":"1469023",
         "Type":"Actor",
         "PrimaryImageTag":"1c50d5164ce8720ca52c9b282a8614df"
      },
      {
         "Name":"Leo Alkemade",
         "Id":"1469289",
         "Type":"Actor",
         "PrimaryImageTag":"9f24b7239c62ebbd0bb16e595f09a4e8"
      },
      {
         "Name":"Guus Meeuwis",
         "Id":"1469026",
         "Role":"Co-Presenter",
         "Type":"Actor",
         "PrimaryImageTag":"3e135b89518fab787940917bb0d3e931"
      },
      {
         "Name":"Jeroen van Koningsbrugge",
         "Id":"1469025",
         "Type":"Actor",
         "PrimaryImageTag":"a641b7a96675400f40501ab291345abe"
      },
      {
         "Name":"Peter Heerschop",
         "Id":"1469024",
         "Type":"Actor",
         "PrimaryImageTag":"53180f804c3b1955adbeb3a1b478c485"
      }
   ],
   "Studios":[
      {
         "Name":"SBS 6",
         "Id":140
      }
   ],
   "GenreItems":[
      {
         "Name":"Game Show",
         "Id":126
      }
   ],
   "TagItems":[
      
   ],
   "LocalTrailerCount":0,
   "UserData":{
      "UnplayedItemCount":0,
      "PlaybackPositionTicks":0,
      "PlayCount":0,
      "IsFavorite":false,
      "Played":false
   },
   "RecursiveItemCount":0,
   "Status":"Continuing",
   "AirDays":[
      
   ],
   "PrimaryImageAspectRatio":0.7222222222222222,
   "DisplayOrder":"Aired",
   "ImageTags":{
      "Primary":"92886eedcb2dff7c43e0fb3eb1fb0cb0",
      "Art":"38d15e2dd27eca02524d75937ec1c6fd",
      "Banner":"0dce6ac1b9f0c9507e17c15049e3ced6",
      "Logo":"8dafcd8540271e35d95fa63464545a68",
      "Thumb":"42005996b328700d5ac2c9a1605a1cf1"
   },
   "BackdropImageTags":[
      "5d465901104d7d0afadf98ef3a6eb35d",
      "3b986bb4c8d95e9ee42bd2a73aecd932",
      "f5aa0d4fee0a0c6bfe0e014b6336d3ee",
      "1caeca06225397b94fe0720ba7a95b1b",
      "8fdde3bfa13663dca98a4f6062161ada",
      "892683667510dd687bbf6d793431ea23"
   ]
}

 

This one has no recordings in the folder.

I will add my guide.xml. Perhaps you can see something in there. I have been asking Luke several things about the guide issues I notice for my country (The Netherlands) with Emby.

See this topic.

In Emby those missing recordings from Goede tijden, slechte tijden are visible.

TVGids2.xml

[quickmic 1355]

1 minute ago, heula said:

This one has no recordings in the folder.

I will add my guide.xml. Perhaps you can see something in there. I have been asking Luke several things about the guide issues I notice for my country (The Netherlands) with Emby.

See this topic.

In Emby those missing recordings from Goede tijden, slechte tijden are visible.

TVGids2.xml 5.2 MB · 0 downloads

Well, in your debug version, next-gen simply skips "invalid" content.

This is correct for the second file, cause you confirmed it has no content.

 

But the first one should be synced.

 

Is all your content (the regular as well) located on nfs-shares or just the recordings?

Probably it's a general issue with nfs and not related to recordings at all.

 

[heula 189]

This what I see on my other Shield TV with Kodi and next gen 5.3.4.

All recordings are visible here.

 

kodi.log

[heula 189]

12 minutes ago, quickmic said:

Well, in your debug version, next-gen simply skips "invalid" content.

This is correct for the second file, cause you confirmed it has no content.

 

But the first one should be synced.

 

Is all your content (the regular as well) located on nfs-shares or just the recordings?

Probably it's a general issue with nfs and not related to recordings at all.

 

All my libraries have the optional nfs shared filled in. All starting with "nfs://192.168.1.157/volume.."

Edited September 1, 2021 by heula

[quickmic 1355]

1 minute ago, heula said:

All my libraries have the optional nfs shared filled in. All starting with "nfs://192.168.1.157/volume.."

Ok, thanks.

Let's summerize. With the latest debug version:

Does it sync? -> no crash

Are all recordings not synced or just some of them?

[heula 189]

1 hour ago, quickmic said:

Ok, thanks.

Let's summerize. With the latest debug version:

Does it sync? -> no crash

Are all recordings not synced or just some of them?

It does sync. Those missing recordings appeared after restarting Kodi.

I did a test with an active recording. When the recording was started in Emby I saw after a minute or so at the top of the screen in Kodi the name of the recording coming along as update but did not appear in the widget or library. The active recording did appear after restarting Kodi but it was empty when I opened it.

kodi.log kodi.old.log

Edited September 1, 2021 by heula

[heula 189]

When the active recording was finisht it still did not sync. The recording image says 1 but remains empty.

When I open all recordings with one or more items in it some of them are visible but some are just empty. Weird.

So I must say now that sync does not work for my recordings. 
I have tried to repair my recordings library twice without any luck. It didn’t get stuck this time.

I have 7 recordings and only three of them have visible episodes.

 

why is the library update option removed as an option?

kodi.log kodi.old.log

Edited September 1, 2021 by heula

[quickmic 1355]

4 minutes ago, heula said:

When the active recording was finisht it still did not sync. The recording image says 1 but remains empty.

When I open all recordings with one or more items in it some of them are visible but some are just empty. Weird.

So I must say now that sync does not work for my recordings. 
I have tried to repair my recordings library twice without any luck. It didn’t get stuck this time.

I have 7 recordings and only three of them have visible episodes.

 

why is the library update option removed as an option?

kodi.log 171.18 kB · 0 downloads kodi.old.log 157.82 kB · 0 downloads

Ok, we really should go step by step.

Not syncing when Kodi running NOT EQUAL not syncing on Kodi restart NOT EQUAL content not in Kodi's list browsing NOT EQUAL what's shown on homescreen widgets.

First let's focus on sync and only on sync. If this is not working, of course it's not shown on widgets or lists etc.

If it's not synced, do you mean not synced while Kodi is running. If so, please restart Kodi and check again. Was it synced yet?

 

 

 

[heula 189]

42 minutes ago, quickmic said:

Ok, we really should go step by step.

Not syncing when Kodi running NOT EQUAL not syncing on Kodi restart NOT EQUAL content not in Kodi's list browsing NOT EQUAL what's shown on homescreen widgets.

First let's focus on sync and only on sync. If this is not working, of course it's not shown on widgets or lists etc.

If it's not synced, do you mean not synced while Kodi is running. If so, please restart Kodi and check again. Was it synced yet?

 

 

 

I mean it does not sync while Kodi is on.

After restarting Kodi those those missing episodes still won't sync. The only thing that synced after the restart was a second test recording. I did two of those today, both are visible as new recording (Folder image)but only the second one has an episode visible. 

[quickmic 1355]

Ok, general answer, cause this is really confusing me. Please try the next version, currently I'm rewriting the sync queues anyway.

Specific answer, if you can design a test case for me with paramaters which are 100% reproducable, I'll give it a shot.

Currently there are to many possibilities what causes the issue. At least one of them is solved (invalid content issue).

I assume the "older" recordings are not synced on Kodi startup, cause they were sync on last startup (and dropped out of the startup-sync) -> startup sync is timestamp based

Usually, when I perform tests: I create test-libraries on Emby server and use a stock Kodi installation (on a PC). I only sync this test-library to Kodi and perform checks with it. This an excellent way to tackle a specific issue. Additionally, I copy the complete userfolder from Kodi to a backup location (before I start Kodi and if neseccary also after Kodi stop). If I find an issue (especially sync issues), I can easily go back from backup and repeat the issue.

 

 

 

 

Edited September 1, 2021 by quickmic

[heula 189]

4 hours ago, quickmic said:

Ok, general answer, cause this is really confusing me. Please try the next version, currently I'm rewriting the sync queues anyway.

Specific answer, if you can design a test case for me with paramaters which are 100% reproducable, I'll give it a shot.

Currently there are to many possibilities what causes the issue. At least one of them is solved (invalid content issue).

I assume the "older" recordings are not synced on Kodi startup, cause they were sync on last startup (and dropped out of the startup-sync) -> startup sync is timestamp based

Usually, when I perform tests: I create test-libraries on Emby server and use a stock Kodi installation (on a PC). I only sync this test-library to Kodi and perform checks with it. This an excellent way to tackle a specific issue. Additionally, I copy the complete userfolder from Kodi to a backup location (before I start Kodi and if neseccary also after Kodi stop). If I find an issue (especially sync issues), I can easily go back from backup and repeat the issue.

 

 

 

 

I have setup a second Emby server on my PC and installed Kodi on my pc for testing.

Emby created the Recordings library and that is for now the only library I have setup because I only experience issues with my recordings.

I have recorded 6 tv shows and none of them appeared while Kodi was open. Not while recording and not after they finisht.

After a Kodi restart the images appeared in the widget and Kodi library but only one has an episode visible to play. The other 5 are all empty.

I hope this helps.

kodi.log kodi.old.log

[quickmic 1355]

11 hours ago, heula said:

I have setup a second Emby server on my PC and installed Kodi on my pc for testing.

Emby created the Recordings library and that is for now the only library I have setup because I only experience issues with my recordings.

I have recorded 6 tv shows and none of them appeared while Kodi was open. Not while recording and not after they finisht.

After a Kodi restart the images appeared in the widget and Kodi library but only one has an episode visible to play. The other 5 are all empty.

I hope this helps.

kodi.log 79.54 kB · 2 downloads kodi.old.log 106.26 kB · 2 downloads

 

In both log files shows no (realtime) updates received from Emby server. I just can see the startup sync. Realtime updates uses the websocket communication, this should be tested.

Please send a text-message from Emby-server to Kodi. If you receive the msg on Kodi, websocket communication is ok.

 

btw, thank for the screenshots, but no need at the moment. I can track the communication and updates in the logs.

Edited September 2, 2021 by quickmic

[heula 189]

2 hours ago, quickmic said:

 

In both log files shows no (realtime) updates received from Emby server. I just can see the startup sync. Realtime updates uses the websocket communication, this should be tested.

Please send a text-message from Emby-server to Kodi. If you receive the msg on Kodi, websocket communication is ok.

 

btw, thank for the screenshots, but no need at the moment. I can track the communication and updates in the logs.

I forgot to install the companion plugin on the test server. Done that now.

These are my findings so far.

Recordings do not appear while Kodi is on. Not an active recording and also not when it has finisht recording.

After restarting Kodi some of them appear but not all of them. All are empty. The widget did not show them at first, I needed to do a skin refresh to get them there visible. The widget has more items in them than the Kodi library shows. The images in the widget are not all good, some double images.

 

embyserver.txt kodi.log

[heula 189]

Perhaps to soon but this is how it looks like after the library repair.

All recordings visible but still empty.

I hope this all will help for you.

Thanks.

kodi.log

[DiscoDuck79 47]

@quickmic Since you're in progress of rewriting the syncing could you have a look at the In Progress sync?

1: I watch halfway thru an episode and stop it.

2: Resume watching from the saved position until the episode completes.

3: The episode is now marked as watched, but it's also still listed as In Progress since the resume position isn't updated once playback is finished.

4: In order to clear it from the In Progress list I have to zero set the resume position on the episode.

[quickmic 1355]

1 hour ago, DiscoDuck79 said:

@quickmic Since you're in progress of rewriting the syncing could you have a look at the In Progress sync?

1: I watch halfway thru an episode and stop it.

2: Resume watching from the saved position until the episode completes.

3: The episode is now marked as watched, but it's also still listed as In Progress since the resume position isn't updated once playback is finished.

4: In order to clear it from the In Progress list I have to zero set the resume position on the episode.

As mentioned, all sync queues (including progress queue) will be completely redesigned and I hope it fixes all those issues. I'm just performing final tests and will be available in the next days.

Beside bugfixes, the progress queue will benefit a huge performance improvement. Also I fixed several bugs, so please hold on.

[quickmic 1355]

New version available:

delta changelog:

- improve progress updates
- redesign sync
- fix trakt issue
- fix invalid content sync

Actually, there are many changes under the hood, and it's a more experimentalish version as the previous ones.

Also a complete db reset is mandatory. Please just update the plugin, the DB reset should be triggered automatically (also improvements there and it's part of the test).

Progress updates (from emby to Kodi) should now be instant without any possible overhead.

I'm still not 100% happy with progress updates from Kodi to emby server. I'm still working on it, but it's tricky. I try to migrate as many as possible commands/updates from http queries to websocket queries (Kodi -> Emby).

(Emby -> Kodi) is already using this approach since ever, but there were many unnecessary (kodi) DB queries involved. I removed all of them to a bare minimum. Actually this is were the performance upgrades came from.

Also the sync should be a little faster than before.

 

@heula Please try this version, I hope it fixes the recording issues too.

 

Edited September 4, 2021 by quickmic

[BaukeZwart 94]

Haven't really tested bit sync after dB reset is much faster. Tested on 3 different platforms , Shield, Windows 10 and Fire TV. 

Edited September 4, 2021 by BaukeZwart

[quickmic 1355]

13 minutes ago, BaukeZwart said:

Haven't really tested bit sync after dB reset is much faster. Tested on 3 different platforms , Shield, Windows 10 and Fire TV. 

Frankly, my tests shown (on initial sync with same parameters) around 5% improvement. A lot of performance can be generated by increasing the "paging" option under "sync". It's set to default 50 (yes, the text is still wrong) but it is 50. If you used lower values in the past, this might be the cause.

4.x. used 15 which was ridiculous low.

50 should be reasonable -> higher values impacts progress bar updates and also resume capabilities. I sync on a raspi pi 4 all my content (600.000 items) in 7 hours.

 

btw, this parameter is ONLY used on (initial) library syncs, not progress updates etc

Edited September 4, 2021 by quickmic

[clarkss12 296]

Been using your Emby for Kodi addon under CoreELEC for a long time.  

Just installed your latest update (plugin.video.emby-next-gen-6.0.5-build 122 (ex9)), and now all I get is "Gathering: Add Library" and "processing updates".

I uninstalled your addon, and cleaned the library.......  All your other updates have worked without many issues.

 

[quickmic 1355]

1 minute ago, clarkss12 said:

Been using your Emby for Kodi addon under CoreELEC for a long time.  

Just installed your latest update (plugin.video.emby-next-gen-6.0.5-build 122 (ex9)), and now all I get is "Gathering: Add Library" and "processing updates".

I uninstalled your addon, and cleaned the library.......  All your other updates have worked without many issues.

 

Please send me the kodi.log and I'll check.

[clarkss12 296]

I reverted back to version (plugin.video.emby-next-gen-5.3.1), everything is scanning like it should.  When it scans the recorded TV shows, it shows the episodes that are being scanned, which I really like.  Somewhere along the line this has been droppped...........

[DiscoDuck79 47]

Updated to 6.0.5

Looks like the sync for in progress is still the same and not working.

- On the Emby server, episode marked as played but also has a resume position.

- On Kodi client, same is seen, I.E. marked as played and has a resume position after the initial sync.

- On Kodi, reset resume position is triggered and the episode is removed from in progress on the Kodi client. However, this is not forwarded to the Emby server that still displays the same as before (marked as played but with a resume position). In the kodi.log there's no communication with the Emby server when it's triggered.

[quickmic 1355]

2 minutes ago, DiscoDuck79 said:

Updated to 6.0.5

Looks like the sync for in progress is still the same and not working.

- On the Emby server, episode marked as played but also has a resume position.

- On Kodi client, same is seen, I.E. marked as played and has a resume position after the initial sync.

- On Kodi, reset resume position is triggered and the episode is removed from in progress on the Kodi client. However, this is not forwarded to the Emby server that still displays the same as before (marked as played but with a resume position). In the kodi.log there's no communication with the Emby server when it's triggered.

As a test:

1. Check the websocket communication (send a message from Emby server to Kodi),

2. Use the default Kodi skin for testing

If the status is still not updated, send me a kodi.log

 

thanks

[DiscoDuck79 47]

15 minutes ago, quickmic said:

As a test:

1. Check the websocket communication (send a message from Emby server to Kodi),

2. Use the default Kodi skin for testing

If the status is still not updated, send me a kodi.log

 

thanks

1: Communication wasn't working, this has worked in the past so didn't it check it.

On second re-installation it seems to be working (tested restart of Kodi, reboot of client prior re-installing), I can now send messages and paus/stop from the server. This is my secondary setup at my other house, once I return home in the afternoon I will update at home as well.

Is there a difference using local network/VPN and FQDN with reverse proxy using websockets?