fast sync not so fast with lots of updates that shouldn't be included

March 14, 2018

Well for everyone else it seems to have resolved it, so we need to look at specific examples of content that are getting synced repeatedly. Thanks.

March 14, 2018

Well for everyone else it seems to have resolved it, so we need to look at specific examples of content that are getting synced repeatedly. Thanks.

Yes, indeed we do. So to ask a question I have been asking over and over again, how do we do that? How do we identify what is being considered a change on a given media item such that fast sync thinks it should send it as an update[1]?

In my case, it's not just a few individual items that get unnecessarily updated on fast-syncs, but it's the entire database of content! I regularly have "fast" syncs that wants to update over 600 items aside from the small numbers (single digit or low double digit) of adds and deletes.

So typically the process of a "fast" sync here is:

- Add a few (less than 20, usually less than 10 even) items...

- Update ~600 items including both episode names as well as just show names

- Delete a few items

I suspect the add and delete at the start and end are the real, actual changes of shows being added and removed and it's the over 600 updates in the middle that is unnecessarily happening.

So, how do we figure out why Emby thinks these over 600 items have something about them that is updated such that "fast" sync thinks it needs to update a client which got such a "fast" update even just a day or two ago?

Maybe what is needed here is a quick rundown of how fast sync is supposed to work. What is the high-level algorithm and what data[bases] is it looking at to decide something needs an update? Give me something to run with.

[1] I'm ready to grub around in the database if that's what it takes. I am technically capable. I am a systems software engineer very comfortable around the command line and have been working with Linux systems professionally for 30 years. What I don't know is the overall architecture and database schema behind Emby. So I am happy to dig in and fetch information. I just need to know what to fetch.

March 14, 2018

The fast sync doesn't do anything. You could safely remove the fast sync from the equation and still have the exact same problem. The fast sync only records server events.

So the logic that matters is why the server sees updates. Every time your server modifies an item entry in it's database, it triggers an update event. Once your situation is figured out, the fast sync will follow suit.

I'm not sure I understand what you said about the add remove. Are you saying your entire library is deleted then re-added?

Sent from my iPhone using Tapatalk

Edited March 14, 2018 by Angelblue05

March 14, 2018

The fast sync doesn't do anything. You could safely remove the fast sync from the equation and still have the exact same problem. The fast sync only records server events.

So the logic that matters is why the server sees updates. Every time your server modifies an item entry in it's database, it triggers an update event. Once your situation is figured out, the fast sync will follow suit.

I'm not sure I understand what you said about the add remove. Are you saying your entire library is deleted then re-added?

Sent from my iPhone using Tapatalk

~sigh~ We have been through this before. You are arguing about semantics here. You are separating the actual process/protocol of "fast sync" from the mechanisms that are behind it. I am not. Since "fast sync" is (still so far) opaque to me, "fast sync" is everything to do with how and what makes "fast sync" work(s). That includes the actual "fast sync" protocol between the client and Emby as well as all of the "update"/item modified logic behind it.

So yes, while you are pedantically correct that the "fast sync" protocol is not the actual problem here and it's the "modified" status of items in the database that are being queued up for transfer in the "fast sync" that is the problem, to and end user, the whole thing is identifiable by it's impact on "fast sync".

So yes, it's the "modified" status in the database that is the problem. So lets drill down on that. How can we look at this "modified" status to at least get a look at the data that fast sync is using? Only once we identify some specific data items that are being incorrectly marked as updated (or being unnecessarily updated) will we get any further here.

So, about add and remove... I am describing what I see in the notification popup in Kodi. It runs through 3 steps. The first step is to add new content. This part looks legit. I usually see a dozen or so items zip by that are new content that has been added to Emby in the last 24-48 hrs.

That is followed by a massive "update" of the over 600 items and includes lots of show episode names as well as (just about every, if not every) show names. This is the part that I don't believe should be happening and is the result of everything in my entire database being determined as updated in the last 24-48hrs. Not deleted/added as then it would show up in the previous and following steps. Fast sync most assuredly is seeing these as "modifications" of some sort of existing content so that it thinks it needs to resync these to the client.

That is then followed by a small number of "removed" items which usually reflects things that have been watched and deleted through various clients in the last 24-48hrs. This part I believe to be legit also.

So it's that big fat "update" of over 600 items in the middle that is the question here. How do we look at this "modified" data associated with these items?

March 15, 2018

What I would need is to go through the same process that i went through with the other user here:

https://emby.media/community/index.php?/topic/55661-keeps-syncing-and-synching/?p=544372

Thanks.

March 17, 2018

So if I have an item's uid (i.e. from a Kodi plugin debug log), how do I determine what that item is on Emby?

How do I lookup an item on Emby by it's uid?

I need to be able to do this so that I can identify items that are being included repeatedly in these massive fast sync update operations so that I can provide the information that @@Luke has requested to chase this down.

Edited March 19, 2018 by shred00

March 20, 2018

OK. So I figured out how to get an item by it's UID. So here is an item, quite old, which has shown up in 3 fast-sync updates over just the last few days:

{
   "LockData" : false,
   "ParentBackdropItemId" : "fbe4b80bec9feb07226d1f90fab3a1a6",
   "PlayAccess" : "Full",
   "ScreenshotImageTags" : [],
   "CanDownload" : true,
   "GenreItems" : [],
   "MediaStreams" : [
      {
         "IsInterlaced" : false,
         "Index" : 0,
         "Profile" : "High",
         "BitRate" : 2873297,
         "DisplayTitle" : "720P H264",
         "IsAnamorphic" : false,
         "Codec" : "h264",
         "SupportsExternalStream" : false,
         "RealFrameRate" : 23.9760246,
         "Type" : "Video",
         "Width" : 1280,
         "IsDefault" : true,
         "CodecTimeBase" : "1001/48000",
         "IsAVC" : true,
         "IsForced" : false,
         "TimeBase" : "1/1000",
         "Level" : 41,
         "AverageFrameRate" : 23.9760246,
         "NalLengthSize" : "4",
         "IsExternal" : false,
         "PixelFormat" : "yuv420p",
         "BitDepth" : 8,
         "Height" : 720,
         "AspectRatio" : "16:9",
         "RefFrames" : 1,
         "IsTextSubtitleStream" : false
      },
      {
         "SampleRate" : 48000,
         "IsAnamorphic" : false,
         "ChannelLayout" : "5.1",
         "IsDefault" : true,
         "Type" : "Audio",
         "Codec" : "ac3",
         "SupportsExternalStream" : false,
         "IsInterlaced" : false,
         "DisplayTitle" : "Dolby Digital 5.1 Default",
         "BitRate" : 384000,
         "Index" : 1,
         "IsExternal" : false,
         "Channels" : 6,
         "IsTextSubtitleStream" : false,
         "TimeBase" : "1/1000",
         "IsForced" : false,
         "CodecTimeBase" : "1/48000",
         "Level" : 0
      }
   ],
   "ParentId" : "17d546571b10ed6fabfc2617de8dbae3",
   "Taglines" : [],
   "Overview" : "Derek Morgan brings the BAU a lead in the case against serial killer and escaped convict Mr. Scratch.",
   "SeasonName" : "Season 12",
   "Id" : "82c68c127cd554266581de9b9229c440",
   "LockedFields" : [],
   "ExternalUrls" : [],
   "SeriesName" : "Criminal Minds",
   "ParentThumbItemId" : "fbe4b80bec9feb07226d1f90fab3a1a6",
   "SortName" : "012 - 0022 - Red Light",
   "LocalTrailerCount" : 0,
   "ParentIndexNumber" : 12,
   "SeriesStudio" : "CBS",
   "MediaType" : "Video",
   "Name" : "Red Light",
   "VideoType" : "VideoFile",
   "DisplayPreferencesId" : "26dd4a82b00c839c498471cdba80a99c",
   "Genres" : [],
   "People" : [
      {
         "Role" : "Derek Morgan",
         "Id" : "82ced709adcb11bf32bb20f4970c97b6",
         "Type" : "Actor",
         "Name" : "Shemar Moore",
         "PrimaryImageTag" : "92b69ff829c902056bd5803bbd017e68"
      },
      {
         "Role" : "Aaron Hotchner",
         "Id" : "622cc7ff29799c9cada90e61352aa843",
         "Type" : "Actor",
         "Name" : "Thomas Gibson",
         "PrimaryImageTag" : "b0de342230bd3dee30c2e8183ccacc8a"
      },
      {
         "Name" : "Matthew Gray Gubler",
         "PrimaryImageTag" : "355299b2779f12a580ce701c4191402b",
         "Role" : "Dr. Spencer Reid",
         "Type" : "Actor",
         "Id" : "aa34c5f12b586eb5c9a774a8679803bb"
      },
      {
         "PrimaryImageTag" : "34b668b6839f608dca48b7f1050c059a",
         "Name" : "Joe Mantegna",
         "Type" : "Actor",
         "Id" : "ed3c9c42188913cf61cf9abcaa47d622",
         "Role" : "David Rossi"
      },
      {
         "Name" : "Paget Brewster",
         "PrimaryImageTag" : "880728c26bc8855d00677e418f382457",
         "Role" : "Emily Prentiss",
         "Type" : "Actor",
         "Id" : "9ff9ab318b2f169f4346c67538f5e483"
      },
      {
         "PrimaryImageTag" : "6bb99eab93a0c4abf80d7dba858bc30a",
         "Name" : "A.J. Cook",
         "Id" : "1a719a684d6ce30334541a8569e5b53d",
         "Type" : "Actor",
         "Role" : "Jennifer Jareau"
      },
      {
         "Type" : "Actor",
         "Id" : "fd1b6b3c1ec5254bafc442daa39f43dc",
         "Role" : "Penelope Garcia",
         "PrimaryImageTag" : "a50b91282058408792737fbbef06ec06",
         "Name" : "Kirsten Vangsness"
      },
      {
         "Role" : "Elle Greenaway",
         "Type" : "Actor",
         "Id" : "de4a5c7890ccb51992c0d50c218440b5",
         "Name" : "Lola Glaudini",
         "PrimaryImageTag" : "11698ec38e944998ed6c054b400a5dd7"
      },
      {
         "Name" : "Adam Rodriguez",
         "PrimaryImageTag" : "fd42000d67618772e2fa2b875ef104d0",
         "Role" : "Luke Alvez",
         "Type" : "Actor",
         "Id" : "3260df12b231b76c1750fc8476e2ffb9"
      },
      {
         "Role" : "Dr Tara Lewis",
         "Id" : "429cc3e6c9b0c564b017d6c15fe4a54f",
         "Type" : "Actor",
         "Name" : "Aisha Tyler",
         "PrimaryImageTag" : "fc95acb351143d26ded69b561f4eb814"
      },
      {
         "PrimaryImageTag" : "5ad9099bc47f03dbaf87a17484b83481",
         "Name" : "Jeanne Tripplehorn",
         "Type" : "Actor",
         "Id" : "879d054243ce736081c6a39f69eb6b45",
         "Role" : "Alex Blake"
      },
      {
         "PrimaryImageTag" : "b988aa65c82e563215821b3d910a1593",
         "Name" : "Rachel Nichols",
         "Id" : "812d2ee34d4c8b8a8b488b68f85e1f22",
         "Type" : "Actor",
         "Role" : "Ashley Seaver"
      },
      {
         "Name" : "Glenn Kershaw",
         "Id" : "b43ff2fdca615a0047bd60ab71a842e8",
         "Type" : "Director"
      },
      {
         "Name" : "Breen Frazier",
         "Type" : "Writer",
         "Id" : "ebbfc7e8570a9808273bbc507e5e4dda"
      }
   ],
   "SupportsSync" : true,
   "IndexNumber" : 22,
   "PrimaryImageAspectRatio" : 1.77777777777778,
   "BackdropImageTags" : [],
   "ServerId" : "9be14d61c64b452eb0fe38a39d2022a8",
   "PremiereDate" : "2017-05-10T04:00:00.0000000Z",
   "LocationType" : "FileSystem",
   "SeasonId" : "17d546571b10ed6fabfc2617de8dbae3",
   "ParentBackdropImageTags" : [
      "eb94b1f5c19a09e42212f7e37dedcc9d"
   ],
   "Chapters" : [
      {
         "Name" : "Chapter 1",
         "StartPositionTicks" : 0
      },
      {
         "StartPositionTicks" : 3000000000,
         "Name" : "Chapter 2"
      },
      {
         "StartPositionTicks" : 6000000000,
         "Name" : "Chapter 3"
      },
      {
         "Name" : "Chapter 4",
         "StartPositionTicks" : 9000000000
      },
      {
         "Name" : "Chapter 5",
         "StartPositionTicks" : 12000000000
      },
      {
         "Name" : "Chapter 6",
         "StartPositionTicks" : 15000000000
      },
      {
         "Name" : "Chapter 7",
         "StartPositionTicks" : 18000000000
      },
      {
         "StartPositionTicks" : 21000000000,
         "Name" : "Chapter 8"
      },
      {
         "StartPositionTicks" : 24000000000,
         "Name" : "Chapter 9"
      }
   ],
   "ImageTags" : {
      "Primary" : "8ba65d446aa2143e3011a0808b351f32"
   },
   "CanDelete" : true,
   "ParentLogoItemId" : "fbe4b80bec9feb07226d1f90fab3a1a6",
   "SeriesId" : "fbe4b80bec9feb07226d1f90fab3a1a6",
   "ProviderIds" : {},
   "ProductionYear" : 2017,
   "Container" : "mkv,webm",
   "ParentLogoImageTag" : "9ba35d0fcda865f765dcefd9e2a68707",
   "EnableMediaSourceDisplay" : true,
   "DateCreated" : "2017-05-10T09:40:00.0000000Z",
   "Tags" : [],
   "IsFolder" : false,
   "UserData" : {
      "IsFavorite" : false,
      "Key" : "75710012022",
      "PlayCount" : 0,
      "Played" : false,
      "PlaybackPositionTicks" : 0
   },
   "Path" : "/video/mythvideo/Television/Mom & Dad/Criminal Minds/Season 12/S12E22 - Red Light.mkv",
   "IsHD" : true,
   "SeriesPrimaryImageTag" : "6176a573fffbcac09abd8f57b8e1b453",
   "Etag" : "5f09b75cee14816b85118644e657b7bf",
   "RunTimeTicks" : 25724030976,
   "RemoteTrailers" : [],
   "MediaSources" : [
      {
         "SupportsDirectStream" : true,
         "Bitrate" : 2873297,
         "GenPtsInput" : false,
         "RequiredHttpHeaders" : {},
         "MediaStreams" : [
            {
               "IsInterlaced" : false,
               "Profile" : "High",
               "Index" : 0,
               "BitRate" : 2873297,
               "DisplayTitle" : "720P H264",
               "IsAnamorphic" : false,
               "RealFrameRate" : 23.9760246,
               "SupportsExternalStream" : false,
               "Codec" : "h264",
               "Type" : "Video",
               "Width" : 1280,
               "IsDefault" : true,
               "CodecTimeBase" : "1001/48000",
               "IsAVC" : true,
               "IsForced" : false,
               "TimeBase" : "1/1000",
               "Level" : 41,
               "AverageFrameRate" : 23.9760246,
               "NalLengthSize" : "4",
               "IsExternal" : false,
               "BitDepth" : 8,
               "PixelFormat" : "yuv420p",
               "AspectRatio" : "16:9",
               "RefFrames" : 1,
               "Height" : 720,
               "IsTextSubtitleStream" : false
            },
            {
               "IsInterlaced" : false,
               "Index" : 1,
               "DisplayTitle" : "Dolby Digital 5.1 Default",
               "BitRate" : 384000,
               "ChannelLayout" : "5.1",
               "SampleRate" : 48000,
               "IsAnamorphic" : false,
               "SupportsExternalStream" : false,
               "Codec" : "ac3",
               "Type" : "Audio",
               "IsDefault" : true,
               "CodecTimeBase" : "1/48000",
               "IsForced" : false,
               "TimeBase" : "1/1000",
               "Level" : 0,
               "IsExternal" : false,
               "Channels" : 6,
               "IsTextSubtitleStream" : false
            }
         ],
         "IsRemote" : false,
         "Container" : "mkv",
         "Id" : "82c68c127cd554266581de9b9229c440",
         "SupportsDirectPlay" : true,
         "Path" : "/video/mythvideo/Television/Mom & Dad/Criminal Minds/Season 12/S12E22 - Red Light.mkv",
         "RequiresClosing" : false,
         "RequiresLooping" : false,
         "SupportsProbing" : true,
         "IgnoreDts" : false,
         "VideoType" : "VideoFile",
         "Protocol" : "File",
         "IsInfiniteStream" : false,
         "RunTimeTicks" : 25724030976,
         "ETag" : "8542a28dc37e130a82992bb56ceac649",
         "Name" : "S12E22 - Red Light.mkv",
         "Type" : "Default",
         "SupportsTranscoding" : true,
         "IgnoreIndex" : false,
         "RequiresOpening" : false,
         "DefaultAudioStreamIndex" : 1,
         "Formats" : [],
         "ReadAtNativeFramerate" : false
      }
   ],
   "Type" : "Episode",
   "Studios" : [],
   "ParentThumbImageTag" : "ea047d27ccccf9ff7260d6b28352c5cd"
}

Here is the directory the item is in:

# ls -l /video/mythvideo/Television/Mom\ \&\ Dad/Criminal\ Minds/Season\ 12/
total 18516712
-rw-rw-r-- 2 mythtv mythtv 1080208589 Sep 28  2016 S12E01 - Bully.mkv
-rw-rw-r-- 1 brian  mythtv       2356 Apr 26  2017 S12E01 - Bully.nfo
-rw-rw-r-- 1 brian  mythtv      28516 Apr 26  2017 S12E01 - Bully-thumb.jpg
-rw-rw-r-- 2 mythtv mythtv 1080208589 Sep 28  2016 S12E01 - The Crimson King.mkv
-rw-rw-r-- 1 mythtv mythtv       2476 Sep 29  2016 S12E01 - The Crimson King.nfo
-rw-rw-r-- 1 mythtv mythtv      28516 Sep 29  2016 S12E01 - The Crimson King-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv 1154140364 Oct  5  2016 S12E02 - Persuasion.mkv
-rw-rw-r-- 1 brian  mythtv       2350 Apr 26  2017 S12E02 - Persuasion.nfo
-rw-rw-r-- 1 brian  mythtv      39931 Apr 26  2017 S12E02 - Persuasion-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv       2480 Oct  6  2016 S12E02 - Sick Day.nfo
-rw-rw-r-- 1 mythtv mythtv      39931 Oct  6  2016 S12E02 - Sick Day-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv       2476 Oct 13  2016 S12E03 - Taboo.nfo
-rw-rw-r-- 1 mythtv mythtv      28089 Oct 13  2016 S12E03 - Taboo-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv 1095018814 Oct 12  2016 S12E03 - The Edge of Winter.mkv
-rw-rw-r-- 1 brian  mythtv       2331 Apr 26  2017 S12E03 - The Edge of Winter.nfo
-rw-rw-r-- 1 brian  mythtv      28089 Apr 26  2017 S12E03 - The Edge of Winter-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv       2385 Oct 26  2016 S12E04 - Keeper.nfo
-rw-rw-r-- 1 mythtv mythtv       2535 Nov  9  2016 S12E05 - The Anti-Terrorism Squad.nfo
-rw-rw-r-- 1 mythtv mythtv      24552 Nov  9  2016 S12E05 - The Anti-Terrorism Squad-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv       2535 Nov 17  2016 S12E06 - Elliott's Pond.nfo
-rw-rw-r-- 1 mythtv mythtv      34405 Nov 17  2016 S12E06 - Elliott's Pond-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv       2644 Nov 30  2016 S12E07 - Mirror Image.nfo
-rw-rw-r-- 1 mythtv mythtv 1199710945 Dec  7  2016 S12E08 - Scarecrow.mkv
-rw-rw-r-- 1 mythtv mythtv       2598 Dec  9  2016 S12E08 - Scarecrow.nfo
-rw-rw-r-- 1 mythtv mythtv      49335 Dec  9  2016 S12E08 - Scarecrow-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv  767972100 Jan  5  2017 S12E09 - Profiling 202.mkv
-rw-rw-r-- 1 mythtv mythtv       2550 Jan  5  2017 S12E09 - Profiling 202.nfo
-rw-rw-r-- 1 brian  mythtv      19982 Apr 26  2017 S12E09 - Profiling 202-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv       2354 Jan 12  2017 S12E10 - Seek and Destroy.nfo
-rw-rw-r-- 1 mythtv mythtv      32433 Jan 12  2017 S12E10 - Seek and Destroy-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv  967845490 Jan 11  2017 S12E10 - To Bear Witness.mkv
-rw-rw-r-- 1 brian  mythtv       2354 Apr 26  2017 S12E10 - To Bear Witness.nfo
-rw-rw-r-- 1 brian  mythtv      32433 Apr 26  2017 S12E10 - To Bear Witness-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv  958625380 Feb  1  2017 S12E11 - Surface Tension.mkv
-rw-rw-r-- 1 mythtv mythtv       2471 Feb  1  2017 S12E11 - Surface Tension.nfo
-rw-rw-r-- 1 brian  mythtv      92786 Apr 26  2017 S12E11 - Surface Tension-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv  960632574 Feb  9  2017 S12E12 - A Good Husband.mkv
-rw-rw-r-- 1 mythtv mythtv       2309 Feb  9  2017 S12E12 - A Good Husband.nfo
-rw-rw-r-- 1 mythtv mythtv      47776 Feb  9  2017 S12E12 - A Good Husband-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv  940817411 Feb 15  2017 S12E13 - Spencer.mkv
-rw-rw-r-- 1 mythtv mythtv       2298 Feb 16  2017 S12E13 - Spencer.nfo
-rw-rw-r-- 1 brian  mythtv      37633 Apr 26  2017 S12E13 - Spencer-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv  939241766 Feb 22  2017 S12E14 - Collision Course.mkv
-rw-rw-r-- 1 mythtv mythtv       2267 Feb 22  2017 S12E14 - Collision Course.nfo
-rw-rw-r-- 1 brian  mythtv      67593 Apr 26  2017 S12E14 - Collision Course-thumb.jpg
-rw-rw-r-- 1 mythtv mythtv 1069235322 Mar  1  2017 S12E15 - Alpha Male.mkv
-rw-rw-r-- 1 mythtv mythtv       2357 Mar  1  2017 S12E15 - Alpha Male.nfo
-rw-rw-r-- 1 mythtv mythtv      17710 Mar  1  2017 S12E15 - Alpha Male-thumb.jpg
-rw-rw-r-- 2 mythtv mythtv  936721003 Mar 16  2017 S12E16 - Assistance Is Futile.mkv
-rw-rw-r-- 1 mythtv mythtv       2408 Mar 15  2017 S12E16 - Assistance Is Futile.nfo
-rw-rw-r-- 1 mythtv mythtv      26650 Mar 15  2017 S12E16 - Assistance Is Futile-thumb.jpg
-rw-rw-r-- 2 mythtv mythtv  956585697 Mar 23  2017 S12E17 - In the Dark.mkv
-rw-rw-r-- 1 mythtv mythtv       2419 Mar 22  2017 S12E17 - In the Dark.nfo
-rw-rw-r-- 1 mythtv mythtv      19898 Mar 22  2017 S12E17 - In the Dark-thumb.jpg
-rw-rw-r-- 2 mythtv mythtv 1042313212 Mar 30  2017 S12E18 - Hell's Kitchen.mkv
-rw-rw-r-- 1 mythtv mythtv       2369 Mar 29  2017 S12E18 - Hell's Kitchen.nfo
-rw-rw-r-- 1 brian  mythtv      85194 Apr 26  2017 S12E18 - Hell's Kitchen-thumb.jpg
-rw-rw-r-- 2 mythtv mythtv  994586724 Apr  6  2017 S12E19 - True North.mkv
-rw-rw-r-- 1 mythtv mythtv       2224 Apr  5  2017 S12E19 - True North.nfo
-rw-rw-r-- 1 brian  mythtv      84375 Apr 26  2017 S12E19 - True North-thumb.jpg
-rw-rw-r-- 2 brian  mythtv  939127679 Apr 26  2017 S12E20 - Unforgettable.mkv
-rw-rw-r-- 1 brian  mythtv       2334 Apr 26  2017 S12E20 - Unforgettable.nfo
-rw-rw-r-- 1 brian  mythtv      83695 Apr 27  2017 S12E20 - Unforgettable-thumb.jpg
-rw-rw-r-- 2 brian  mythtv  952861842 May  3  2017 S12E21 - Green Light.mkv
-rw-rw-r-- 1 brian  mythtv       2242 May  3  2017 S12E21 - Green Light.nfo
-rw-rw-r-- 1 brian  mythtv      76984 May  4  2017 S12E21 - Green Light-thumb.jpg
-rw-rw-r-- 2 brian  mythtv  923910019 May 10  2017 S12E22 - Red Light.mkv
-rw-rw-r-- 1 brian  mythtv       2289 May 10  2017 S12E22 - Red Light.nfo
-rw-rw-r-- 1 brian  mythtv      67553 May 12  2017 S12E22 - Red Light-thumb.jpg

And here is the parent directory:

-rw-rw-r-- 1 mythtv mythtv   47274 Jan 28  2015 banner.jpg
-rw-rw-r-- 1 mythtv mythtv  790014 Jan 28  2015 fanart.jpg
-rw-rw-r-- 1 mythtv mythtv  161695 Jan 28  2015 poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 Jan 28  2015 season01-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  227532 Jan 28  2015 season01-poster.jpg
-rw-rw-r-- 1 mythtv mythtv   38059 Jan 28  2015 season02-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  145943 Jan 28  2015 season02-poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season03-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  250473 Jan 28  2015 season03-poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season04-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  175321 Jan 28  2015 season04-poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season05-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  238732 Jan 28  2015 season05-poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season06-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  175327 Jan 28  2015 season06-poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season07-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  162799 Jan 28  2015 season07-poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season08-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  232695 Jan 28  2015 season08-poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season09-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  257856 Jan 28  2015 season09-poster.jpg
drwxrwsr-x 2 mythtv sabnzbd   4096 Jan 12 14:46 Season 10
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season10-banner.jpg
-rw-rw-r-- 1 mythtv mythtv   79246 Jan 28  2015 season10-poster.jpg
drwxrwsr-x 2 mythtv sabnzbd   4096 Jan 26 04:14 Season 11
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season11-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  145785 Oct  2  2015 season11-poster.jpg
drwxrwsr-x 2 mythtv sabnzbd   4096 Jan 12 14:46 Season 12
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season12-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  162799 May 10  2016 season12-poster.jpg
drwsrwsr-x 2 mythtv sabnzbd   4096 Mar 15 00:45 Season 13
-rw-rw-r-- 1 brian  mythtv   84185 Sep 29 04:06 season13-banner.jpg
-rw-rw-r-- 1 brian  mythtv   87108 Sep 29 04:06 season13-poster.jpg
-rw-rw-r-- 1 mythtv mythtv   47274 Jan 28  2015 season-all-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  161695 Jan 28  2015 season-all-poster.jpg
-rw-rw-r-- 1 mythtv mythtv  121780 May 10  2016 season-specials-banner.jpg
-rw-rw-r-- 1 mythtv mythtv  162799 May 10  2016 season-specials-poster.jpg
-rw-rw-r-- 1 mythtv mythtv    2784 Mar 20 03:46 tvshow.nfo

Let me know if you need any more info.

March 20, 2018

Does the library scan show that item getting updated?

March 20, 2018

Totally taking a stab in the dark at what I am looking for but I see that item appear twice in recent history on lines that start with:

2018-03-17 00:22:37.067 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" Updated 261 items:
2018-03-19 12:25:15.417 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" Updated 261 items:

Looking at the most recent occurrence, here are the lines in the log that reference this item around the time of the LastModified being set:

2018-03-19 12:24:02.450 Debug App: Emby.Kodi.SyncQueue: [...,,{"Id":2133,"ItemId":"82c68c127cd554266581de9b9229c440","LastModified":1521260501,"Status":1,"MediaType":1},...]
...
2018-03-19 12:24:33.431 Debug App: Emby.Kodi.SyncQueue: ItemUpdated added for DB Saving 82c68c12-7cd5-5426-6581-de9b9229c440
...
2018-03-19 12:25:08.919 Debug App: Emby.Kodi.SyncQueue:  Updated ItemId: '82c68c127cd554266581de9b9229c440'
...
2018-03-19 12:25:15.285 Debug App: Emby.Kodi.SyncQueue: [...,{"Id":2133,"ItemId":"82c68c127cd554266581de9b9229c440","LastModified":1521476673,"Status":1,"MediaType":1},...]

So it definitely looks like it's showing updated in the library scan.

March 20, 2018

No I mean if you look at the other thread, look at the information we identified in the server log. thanks.

March 20, 2018

So, I have Automatically refresh metadata from the internet: set to Never and Display missing episodes within seasons unchecked.

Other than that, I don't see anything else about what to look for in a log in that whole thread. You just said at some point that whatever the problem was "will be in tomorrow's beta to try." followed by some confusion about which was the right beta. Nothing about what information to look for in the log.

There is a post saying "t was only affecting videos with multiple external subtitles." but I don't have external subtitles for anything on my system.

March 20, 2018

Right but in one of the posts in that thread we identified something refreshing repeatedly in the server log so try going through the same process.

March 21, 2018

I've been through that thread from start to finish half a dozen times. There is no discussion of specific server log entries at all.

I wish there was. There just isn't.

March 21, 2018

Run the library scan and then see if the log mentions the sample item you brought up.

March 21, 2018

It is mentioned in 4 Debug App: Emby.Kodi.SyncQueue: [...] lines inside the window of time that the library scan ran:

2018-03-21 10-28:37.386 Debug App: Emby.Kodi.SyncQueue: [...,{"Id":2133,"ItemId":"82c68c127cd554266581de9b9229c440","LastModified":1521476673,"Status":1,"MediaType":1},...]

The other three are just identical repeats of the above at different timestamps.

But those are the only mentions of this item during that scan.

March 21, 2018

Ignore the kodi sync log lines, you want to see if the core server is repeatedly refreshing the item.

March 23, 2018

@@shred00 - this is just a thought but are you using Sonarr or any other TV show manager?

I notice my install regularly updates the episode timestamps of old shows that I haven't watched or touched in years, I don't use the Kodi plugin on a daily basis anymore but I was always 'amazed' by how many updates it was doing but this is all anecdotal, so ignore if this makes no sense or has been discounted already

March 23, 2018

@@shred00 - this is just a thought but are you using Sonarr or any other TV show manager?

I notice my install regularly updates the episode timestamps of old shows that I haven't watched or touched in years

If this is happening, then yes the Emby library scan will see those changes and re-scan the content.

March 23, 2018

So, I do see a few (small numbers, usually less than half a dozen) tvshow.nfo files being updated per day. Supposedly there is some update in TheTVDB that is triggering these but the file content doesn't actually change. I am working on a patch to prevent those tvshow.nfo files where there is actually no updated content from updating the timestamp on the file.

But still, should a few tvshow.nfo (not episode .nfo) files be causing 600-700 "updates" in fast sync? That doesn't seem right to me.

Unfortunately I have been unable to asses general fast sync functionality for the last couple of days due to the Emby server STBing when asked for a fast sync:

20:01:51.782 T:2416962368  NOTICE: EMBY.downloadutils -> ERROR:: === Bad status response: 400 ===
20:01:51.783 T:2416962368  NOTICE: EMBY.librarysync -> ERROR:: 400 Client Error: Bad Request for url: http://10.75.22.2:8096/emby/Emby.Kodi.SyncQueue/3abbfc1aaa864057bad867e6230f9184/GetItems?format=json&LastUpdateDT=2018-03-22T02%3A46%3A48Z
20:01:51.783 T:2416962368  NOTICE: EMBY.librarysync -> ERROR:: Failed to retrieve latest updates using fast sync.

On the server this happens:

2018-03-22 20:01:51.778 Error HttpServer: Error processing request
        *** Error Report ***
        Version: 3.3.1.0
        Command line: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /var/lib/emby-server -restartpath /usr/lib/emby-server/restart.sh
        Operating system: Unix 3.13.0.135
        64-Bit OS: False
        64-Bit Process: False
        User Interactive: False
        Mono: 4.8.1 (Stable 4.8.1.0/22a39d7 Tue May  2 22:30:49 UTC 2017)
        Processor count: 2
        Program data path: /var/lib/emby-server
        Application directory: /usr/lib/emby-server/bin
        System.ArgumentNullException: Value cannot be null.
        Parameter name: text
          at Emby.Common.Implementations.Serialization.JsonSerializer.DeserializeFromString[T] (System.String text) [0x0000b] in <07306ae2f140476099e69d171d6871b3>:0 
          at NanoApi.File.Read[T] () [0x00094] in <abfe5497b2824bd38a22e31c0cd6c6cd>:0 
          at NanoApi.JsonFile`1[T].Select (System.Predicate`1[T] lambda) [0x00006] in <abfe5497b2824bd38a22e31c0cd6c6cd>:0 
          at Emby.Kodi.SyncQueue.Data.DbRepo.GetUserInfos (System.Int64 dtl, System.String userId, System.Boolean movies, System.Boolean tvshows, System.Boolean music, 
          at Emby.Kodi.SyncQueue.API.SyncAPI+<>c__DisplayClass8_0.<PopulateLibraryInfo>b__10 () [0x00007] in <abfe5497b2824bd38a22e31c0cd6c6cd>:0 
          at System.Threading.Tasks.Task`1[TResult].InnerInvoke () [0x00012] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at System.Threading.Tasks.Task.Execute () [0x00016] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at System.Runtime.CompilerServices.TaskAwaiter`1[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at Emby.Kodi.SyncQueue.API.SyncAPI+<PopulateLibraryInfo>d__8.MoveNext () [0x00260] in <abfe5497b2824bd38a22e31c0cd6c6cd>:0 
        System.ArgumentNullException
          at Emby.Common.Implementations.Serialization.JsonSerializer.DeserializeFromString[T] (System.String text) [0x0000b] in <07306ae2f140476099e69d171d6871b3>:0 
          at NanoApi.File.Read[T] () [0x00094] in <abfe5497b2824bd38a22e31c0cd6c6cd>:0 
          at NanoApi.JsonFile`1[T].Select (System.Predicate`1[T] lambda) [0x00006] in <abfe5497b2824bd38a22e31c0cd6c6cd>:0 
          at Emby.Kodi.SyncQueue.Data.DbRepo.GetUserInfos (System.Int64 dtl, System.String userId, System.Boolean movies, System.Boolean tvshows, System.Boolean music, 
          at Emby.Kodi.SyncQueue.API.SyncAPI+<>c__DisplayClass8_0.<PopulateLibraryInfo>b__10 () [0x00007] in <abfe5497b2824bd38a22e31c0cd6c6cd>:0 
          at System.Threading.Tasks.Task`1[TResult].InnerInvoke () [0x00012] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at System.Threading.Tasks.Task.Execute () [0x00016] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
        --- End of stack trace from previous location where exception was thrown ---
          at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e
          at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at System.Runtime.CompilerServices.TaskAwaiter`1[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0 
          at Emby.Kodi.SyncQueue.API.SyncAPI+<PopulateLibraryInfo>d__8.MoveNext () [0x00260] in <abfe5497b2824bd38a22e31c0cd6c6cd>:0 
        
2018-03-22 20:01:51.779 Info HttpServer: HTTP Response 400 to 10.75.22.129. Time: 1049ms (slow). http://10.75.22.2:8096/emby/Emby.Kodi.SyncQueue/3abbfc1aaa864057bad867e

fast sync not so fast with lots of updates that shouldn't be included

Recommended Posts

Luke 37116

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

Angelblue05 4130

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

Luke 37116

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

Luke 37116

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

Luke 37116

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

Luke 37116

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

Luke 37116

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

Luke 37116

Link to comment

Share on other sites

jaspalgill 19

Link to comment

Share on other sites

Luke 37116

Link to comment

Share on other sites

shred00 13

Link to comment

Share on other sites

Create an account or sign in to comment

Create an account

Sign in

Activity