Plugin - Chapter Editor (ChapterApi)

[TeamB 2352]

I have put together a simple chapter viewer and editor plugin.

The plugin is now in the plugin catalogue.

As always here is the source:
https://github.com/faush01/ChapterApi/tree/main/ChapterApi

It is very simple and allows you to view chapters for a item (Movie, Season or Episode), remove chapters and add them. It supports all the different chapter marker types.

It also has a season Intro summary page, select a season to see if it has intros detected for each episode.

Note:
All chapters are wiped and reset when you do a metadata refresh on an item. If you spend any time setting up or editing your chapters keep this in mind. There is no current way of locking chapters.

Chapter List

 

Season Intro summary

 

Intro Detection (CTRL-F for Intros)

I have added a new way of detecting intros based on theme audio, this is using a very different approach than the core approach, it is using some of the ideas I posted over there:

https://emby.media/community/index.php?/topic/107878-audio-fringerprinting-chromaprint-segment-detection/

With this approach you need an the Into Chromaprint info, this is a simple audio fingerprint of the theme song/music/audio. The plugin looks for this and can create chapters based on the results of the search.

So where do you get the Chromaprint Intro info file, you can create one yourself for a series, season or episode by adding chapter info for one episode and then extracting that as a Chromaprint Info file. The new icons on the season summary page lets you extract the info file, if you just want to check you have the chapter offsets correct you can extract the audio of the chapter to play back and confirm it.

A Chormaprint info file looks like this:

{
	"series":"Game of Thrones",
	"season":2,
	"tvdb":"121361",
	"imdb":"tt0944947",
	"tmdb":"1399",
	"duration":107,
	"extract":10,
	"cp_data":"ThXy/E4hsdxOIZDdziWA3c9lgNnd/YDI3NyAyNyYwMzcuFHc1L0V3dS1F1/E8xJexOISXsfyMl72UzZe5lM13uZlNN/m7FDddvyT3Hack9xWjJDdR52Q3USWkN0EkvHfFJJz3zT2d98s53ffJO1n/yR8Z/4lTCf+Hgwn/k40N/pOJHH63iBR+/4xUfnuEdP47hXDeH1XgXgcd4B4DP/AeAzf0FkM/VBZDO0QWTzkEFkt9BN7bdASet3RUnqP0UJaj9dFe57WRH2u/kR977pEfO++RXw/vlb8D5Ze/Q+GfvcNgn32TdI99m/iPfbvYjj37jUZ/+4FX73uBN+9fhSfvV40vf1eELT9XjCU3V4hlN1fIZfcfzHW3C0FU9w9DRPYHTkTWA0pElgMLVNYBDVBWARRQBgUcUEYNHFRGCR3ARhk7gAY5e4BGdd+AxqGU0IahkHCCo5AwwreUMEKblDACipwwAsrbIMIGemCCAjKgggIipIYCI7QGBiWUBg4kjAbGIIxGvmDEhqrsQFequAAXq4gAF6uIABevjBDTq8Qwk2vEYLM/wKCxA8Og8QPHpDEH36QxDfe8MQ213HEFtUxxAfFdsTX0XbEt/H2xKPzdcSS0zXAgsI3wYLCJ8KSwyXCprXlwqakpcLnrLTC5ay0wlW09MMFsDXDBZE1wwXTJ8FV0ibB5eJm0e1v9lOta/dTrXn1Up0ZdVKNGXdSjwV1Up8BdFLvEGRS7yBgUusgYFLvIPAS72XwEt1d8wLF2fIDxNlyA8TbcgJ0/3ECZK9wAmSncQJEvyJCBZ4iQweOJwE3iiEAJpphACa74xE2qaMTNryjEia8oBInrGASJ6wgM0W4IjHFmCIwxIgmMJTIJjC0SCcwpVw3MeVtNTHnb3QxY270MXJWtTECRrEwAtKhMALjs3QS47N0I+XxdCPv0Hwh+1B8EfsRfAH7EnwB6xJ9EO9Tf3D1U37wxcN+8cXDfpXFQX6V90F/l+ZAfbfuQX337kN959dDf+dVwH7vVcB+//XQds3103fN91J1Tf5SfV3OUn0vz3N9L93wfy/00H4/5NB+H+RQfg/0En4P9BZ+P0U2f29Hdn/vRvd/nxL3dZ4S9XWOMvV0nzL1fJ8iVVyeIlVcvgLzXO4G8VxvFrFcPy6wXA0ukFgNKpAYDWqQCAz+0AgM11AIHPdRCDXzEQg18wMIVdMCCPfHAgm39wMKsuNBCpLzQwqCUUMKkkFBCqZQwAqmIMAJ5myBCGZogggH+YIIBdmCCASP0ggEh1AINIMwCSSzEAoksxEKZKcTSuWnAUqjYwBKkjEASpIwAU6yEMPOphCCz+YQgs1WAYLFFgWRxTZ1kIUn/dCFN8UwhRfHN4QPxzaEHeZ2xF3m1sTd5pXE3fbUxP1GFMT1RjXExQc2xMUXNkTXNRdEZyXVRGct1EQzLdREAz1VRANVNkQDQTYEA8FnAFPBbwDy8e0BoqHvAaKtbwOzuW8Ck4lvApOJZQKTjWUCkZFlArGxZQKhoWVCoaF0QqGldALhrXACxflzAcTbMgDE2yMA9P8lEOTtIRDk5WFR5fVjUXXfZ1FXjmVRFo5gUBaOYFA2nmBRNq3hUybso1Im7KNSJ/yhUmVc8FLVWHNShBgyE4QZMhCECyYQlA4nELQCZxDlM+cQZSOlEDUjpBAXIqQAFxLkABZO5AQWWuEEFtqmBAb6pgwG6rcMF+6wCBfnUAgF0xcLBcMXCjTTBRrl4QQbpeEEG6XlRBmt/UUZv/1FGZd/RRuOf0cbzlVHGV5VRxkuRMEbL1TBGz9lwRofdcMaD/XDGh3Twxp100Aa5fFAGuXhABmlsUEYrbFDGKe/wxinv8Bct7rAXIa+Q1yGn0Jcx5VCXNeF0l1nhfFfJYXwXzWn8F4Vo/NeBfNyXgfzMl4XUTJeJ0ExX2YcMFzmOFBctinRXIYpw1yGL8NdjhfCXY4Dw1+vA9Nf50HRX2Xhkd014bBdNaGwXTSl8F00n/BdFJ9xWRTtcls1bTJaNTUyWjURMlv1ARJb9QNTWbVTQFi1Y0BYteFAWLXhQFj39UNYV7XCWUadwllGmdJbRtnTW1bZ01pW3VNaXtVRWl7QVV5/QFde/0F2X/9Tdl/3ZnZdpiZU3aYmVN2mZ8TfpuHE3+bwgd/WsILXVoSS1zeFkJc3hZCXNYfQhhfXV4YX0TaHF3E2hSYRMoRmYXecZmXXnOZt15z3XZWUx93UlMffVcXF31fFRY82x1WPftV1/3/VZe181WX1dNUx8XXVEdF21AHBftRBQX7U0BN91OAnfNSgL33QoWt/1aFb/9aTS//Wg0v30oLF5VLCwORS86DkUmOgZFJl4GRSZfQ1cnX8NXIk/DZzNH12cVVpdnBVL3xw/y98cO8vfHHvHn9z7w5fU/9O3VNfztxTXc6UU02+lNMNr5XTDa230xettdNnrbXTZ53d02fLH9Imyx7SZkk+0nY5PtJXLH/SxyTvUscg71LXEH9R1wM+VNcCNlRXAnZUTRJ1VB029BQdavQcPOrwHDzq8Bwc6lAcDO8RGQz1EhsM0RYZHUEXGS1AVRgtZVQYb2XXGG/n1xnO8scbztLHGs7Sxxqew8EbrpVBWa+9QFnvqUBY/7lBWc+9Q1vNlUZbTdFGWg3BV1s9wFZZLdB3WS1hdVgv53dYL+bXWR521ltOUtdaztLFWt/CwFvv1cBb79zA2e/8wNnf/MPZzvzD3c7wQ9/O0EPf3sFT33/BVt1391bd9W/23fVp99/1OXXflT913pUzE96FE1Pe3wNTXu8T0V4vM9BeKyOQXzkjkF85dtBfKUbQXyhXUF84N1B/GCUQewh1ET8JXBM92dwDPbnYQTSZ2EA0iZhANImMRDCJhEUxmYDHM7nQ1jL54dYy6ePWMuuj1nLvo3dy54d0c+WPdHHVjVRxhY1Xc4WPVnPVz1Zz519Xc2YvV3NmL3ZzJiVncSYkY3cuFOF3PkDxdw5QsH8P4PB/DeDQPwz1UzkMrRI5DO0SORztAjk8/QE5PVVBON1TQziPU0IYj1LCGI8Cwxi9AkBYrCZAWKwmwVjcP8JYzF+CSExNg0kNRZBPDdWUT17XtU/+t/VN7pf0TK6XdEyut1VFnvVWx47xUsaG0VLGh0FTVrcBUVbvMVBWbSNQVikj8VYpI/FWKDfwUzge8FMYHnBTCFcwVwjXMVcI1TFXCIVwV9mFYXW5jXF1mZ1zdJi9c3SIvXF1mLRwd7iQMHb4sDP2eLAy9jigMvYsoTL2JeMm9yZiZvQmMmb0Igbv9CIN7PwiCOz8Yhjs/MI4/v2CPP5fghT+XoIRf16GE3delhJ3X7cy912vIrVc7SaUWG0ukEhpaoBIGGqASAjqgEhN/tFITddSSF1DM0hdQzNM/UFxTO9lU0znbdNM9m3ST4Zl0k6GwVJOhsETTpaBEU7ns1BO56PQT2WjwE0lp8BNJK/QTRT/Uk0E9xJNBdcSTRVDE0hlUVBIZWVQSHVt0UhVfdFJ1X3VSdd3VUvXU1dL19NWS9fDd0v3wXdLd+XVSTft1Ek3rVRJN7lXWVe9Fl1G3RdfRsUxX9bFM16mUVNetjFTXrYxU162MUFepjHBXuchgV7lIYFePTGRXz0TkF8sU5BdKFfQGSjfUBkY31AZGP8TGxjtExsZbQEZWfVDGZnVRxiZlUcYmZ1FHbi/RB24v0RfuK9Ed5y3R3ack0Z2nJJGcryy1nK14t5y5/L/cubWfXLmxmxy5sds8ubFbPNW1W3zRtVv8QbVbXEW/W1wFnltcDZ5ZXEmeGdxJmhmdzZs5lYWcOZWBtDiXgfQ814FkHMeBbBSGgWkAhsMrAIZTLwCGdzdAhndzUYZvVUHGb0RBRmfEwUY3xNFGP8yRVh9ModYLRaHWD0GhVg9NpRMXW6UTE3ulEzPntVMzofXTZ6F1U+uldVOrpVVTv7BVU7+0XdO/mFyTv5hc15vMXFeaTNxXigj0V44I9FeODZBXigWQF44FkBeGBdAHwhFUB8IwREdGYAQPXmAMD3ZhTQ9m4V0PbuPd327nnJ9m75yfZmuU3+ZrhF+uLc3/rixNv7o8Tb+6OE2/mkhdvZtIXbXLyF+1DYxftQ2Af/UJgy91HYYrcTWKK3ExiivxIY5r8SGT6XFhsPkx7bC5Me28vTHpuN1xebjNcTm8xDMZ+cQzFXvEEwV71BNBfVTTQRxVk8EUVZPFEF2TxRFd09VXfdNfXn1T+1t1E//ZVVOz3FXTk/BU05/wVBfL5HQXy+l0F8trdBfPanBXg25Q14Nt0JeDZICXk3CAl/dQgZc7QYHXK0vRVSvK8RUrivFVJ4vh9WONcfXhgDH1rYAwda+ENFGniDTQr4hkEOuFZBDrh2QQ68tsEKtZbBCvOXjQtjxYULYsSBD+LEgU1ixIFMYsyFTGbIjVRmyI3U5siF1ObZjdTi+Y3QY/mJ0GF5ifBhfY3wYTWN8WA1jfFgFY3lZRXF7GXX1ehvh93ob4fd6",
	"cp_data_length":3372,
	"cp_data_md5":"DDF936E4FD29A02CDA178EBFF37AD2E8"
}

Its just a JSON file with some info and the Chromaprint data. This can then be used in the Intro Detection tab to create a job against a series/season/episode list. Once complete you can import the job results into your items.

This is a semi auto way of detecting chapters for series that are having issues, because you are supply a good well know chromaprint of the audio you want to target your results are much more predictable.

Sharing intro theme cp data

The sharded intro theme cp data is now hosted on github

https://github.com/faush01/ThemeCpData

To use the hosted data in the auto detection in the ChapterApi plugin you can use the following URL in the "Intro Data External Url" on the options tab of the plugin:

https://github.com/faush01/ThemeCpData/archive/refs/heads/main.zip

Add the url, hit download intro data, hit reload intro data and the intro cp data will be loaded for all the series you have that there are cp data in the shared repository.

If you want to add more the to the shared repo, clone it, add your new into cp json items and do a pull request to have you new items merged in and available to others.

 

 

 

 

Edited December 13, 2022 by TeamB

[kikinjo 162]

Thank you TeamB, very useful.

[chef 3745]

This is awesome.

Thanks so much for creating this! 

[TeamB 2352]

New version in first post with a cool Season level Intro summary

Edited July 16, 2022 by TeamB

[TeamB 2352]

@Luke it looks like there is no way of locking chapters to stop metadata refresh wiping all chapter info.

Can we get a lock chapters option?

[GrimReaper 3293]

Very handy tool, @TeamB. Could you maybe add an option to automatically create chapters at 5 minute intervals for the whole lenght of the item (as opposed to adding one by one manually with Time/Add button) for movies that have single chapter marker embedded, like this one? 

 

[TeamB 2352]

43 minutes ago, GrimReaper said:

Very handy tool, @TeamB. Could you maybe add an option to automatically create chapters at 5 minute intervals for the whole lenght of the item (as opposed to adding one by one manually with Time/Add button) for movies that have single chapter marker embedded, like this one?

The problem at the moment is that any metadata refresh of an item will wipe all chapter changes, we really need to have some sort of way to retain manually edited chapters. Or at least be able to lock chapters from metadata refresh actions.

 

[crusher11 851]

I had a glitch with the IntroSkip plugin that resulted in this happening to a bunch of my episodes:

 

Is there an easy way to find which episodes have the glitch?

[TeamB 2352]

6 hours ago, crusher11 said:

I had a glitch with the IntroSkip plugin that resulted in this happening to a bunch of my episodes:

 

Is there an easy way to find which episodes have the glitch?

It looks like they are all IntroEnd chapter markers, I could make it so the season summary page shows you the first IntroEnd it finds and then it would be obviouse by looking season by season if an episode had a IntroEnd at 00:00:00 and no intro duration.

[TeamB 2352]

@crusher11

Latest version in the first post might help you identify episodes with weird markers. You can view a season and quickly check its Intro and Credits chapter markers.

[GrimReaper 3293]

22 hours ago, TeamB said:

The problem at the moment is that any metadata refresh of an item will wipe all chapter changes, we really need to have some sort of way to retain manually edited chapters. Or at least be able to lock chapters from metadata refresh actions.

 

Appreciate the info. Personally never do a metadata refresh within Emby as I curate my collection externally so that doesn't bother me at all. Think it would be useful to have an option to populate all chapters in one go as opposed to doing it one by one. Thanks. 

[TeamB 2352]

21 minutes ago, GrimReaper said:

Appreciate the info. Personally never do a metadata refresh within Emby as I curate my collection externally so that doesn't bother me at all. Think it would be useful to have an option to populate all chapters in one go as opposed to doing it one by one. Thanks. 

So would this be for items that did not have chapters at all? or to replace all chapters with a uniform chapter every x minutes?

I have noticed looking though my collection that a lot of movies and episodes have weird chapters, probably from the original file extracted at import time. Some have 1 chapter like end credits, others have 3 or 4 but at weird times. I agree some way of "fixing" this would be something useful.

My only concern is any changes will get nuked my a metadata refresh, you could spend some time on this and then accidentally wipe all your work by accidentally refreshing metadata on a series to say get the latest ratings etc.

I am not sure what the best option is here.

[GrimReaper 3293]

1 minute ago, TeamB said:

So would this be for items that did not have chapters at all? or to replace all chapters with a uniform chapter every x minutes?

Tbh, I was thinking about filling chapters for items that don't have any or have 1-2 weird ones. But now that you mention it, I'd maybe go with replacing those with uniform x-minutes ones as they can be spaced at really big timeframes, sometimes making them practically useless. 

3 minutes ago, TeamB said:

I have noticed looking though my collection that a lot of movies and episodes have weird chapters, probably from the original file extracted at import time. Some have 1 chapter like end credits, others have 3 or 4 but at weird times

Yup, observed same, those would be embedded chapters, if present Emby would read them as-is and not create generic 5-minutes ones. As said above, those are occasionally spaced really weirdly, sometimes logically within the story, other times completely illogically as per encoder's whim. In either case I'd still prefer uniform x-minute ones for faster navigation. 

[TeamB 2352]

35 minutes ago, GrimReaper said:

Yup, observed same, those would be embedded chapters, if present Emby would read them as-is and not create generic 5-minutes ones. As said above, those are occasionally spaced really weirdly, sometimes logically within the story, other times completely illogically as per encoder's whim. In either case I'd still prefer uniform x-minute ones for faster navigation. 

I though you could already do this this in the library setting thumbnail extraction ever x seconds (advanced library setting). But I just experimenting with that now it looks like this does NOT create new chapters but just creates thumbnails for use in the clients? But it did not show up in the Web Client so is this only for some clients?

I agree I think we will need some create automatic chapter points every x or some other logic sort of thing.

[GrimReaper 3293]

3 minutes ago, TeamB said:

I though you could already do this this in the library setting thumbnail extraction ever x seconds (advanced library setting).

Nope, that setting is only for selecting either 10-second bifs (for visual seeking) or 5-minute Chapter markers. 

4 minutes ago, TeamB said:

But I just experimenting with that now it looks like this does NOT create new chapters but just creates thumbnails for use in the clients?

If you refer to bifs, yes, they are only used in client apps during playback as visual aid, it does not create any new chapters. 

5 minutes ago, TeamB said:

I agree I think we will need some create automatic chapter points every x or some other logic sort of thing.

Yup, agree. 

[Junglejim 351]

This looks cool! It would be good for media that have strange chapters. Most of my media that doesn't have embedded chapters get the default 5 min markers, which is all good.

Some though have weird chapters and this could fix that to some degree. As stated a refresh of meta would blow it away. But personally for movies that's fine with me, I don't usually refresh them.

TV Shows are different, not many have chapters (except anime) so most get the 5 min marker on my system..

Looking forward to testing this out!

As @GrimReaper pointed out an automatic interval of chapter markers would be great.

Edited July 17, 2022 by Junglejim

[Cheesegeezer 3086]

@TeamB great work fella, i actually was using this to diagnose my introEnd issues and it has proved very useful. 
 

thanks for sharing 

[crusher11 851]

Is it possible to allow chapter types to be changed? A lot of my series' have a chapter point at the start of the end credits, it would be super helpful to be able to just change that rather than having to add another chapter there and then delete the existing one.

[TeamB 2352]

New version with Auto create chapters at X interval.

Also added multi select and delete.

14 hours ago, crusher11 said:

Is it possible to allow chapter types to be changed? A lot of my series' have a chapter point at the start of the end credits, it would be super helpful to be able to just change that rather than having to add another chapter there and then delete the existing one.

I will look into it.

[crusher11 851]

Additionally, timings in IntroSkip support thousandths of a second. Having to round things to a whole second can be awkward.

[TeamB 2352]

Just now, crusher11 said:

Additionally, timings in IntroSkip support thousandths of a second. Having to round things to a whole second can be awkward.

why awkward? sec not accurate enough?

I dont think most seeking playback is frame accurate anyway.

[crusher11 851]

It should be, assuming GOPs are correctly set.

[TeamB 2352]

latest version has millisecond and a copy time action.

The copy time action just copies the time to the add form so you can create a new chapter at the same time with a different type, you will still need to delete the old chapter.

[rbjtech 4265]

Nice - thanks @TeamB - as a stand alone general chapter editor - this could be useful.

My understanding is that an editor is being created 'in the near future' for the Core Introskip feature - We cannot get any dates from Eric or Luke so read into that what you will  - but I'm raising FYI.

On the 'Saving' of edited data - yes we hit this one hard in the Plugin ourselves - and never got around to resolving it.

Options, I guess are -

a) Lock data in the chapter table in the emby dB 

b) Write modified (or all?) chapter info to NFO

c) Write info to source (MKV, MP4 etc)

d) write info to external chapter file - chapter.xml etc - also compatible with ffmpeg, mkvtoolnix etc

 

From the lessons learnt in the Introskip Plugin - the above saving of data is #1 on the list for a plugin like this - users spending lots of time curating chapters etc will, understandably, get rather peeved if they lose edits on a metadata refresh...

..and on that note -

@crusher11

The extra chapters issue in the Plugin has been resolved, I've had the fix for a few days now from @Cheesegeezer and it works great.

This needs a manual refresh of the item to put it back to it's original state before correctly adding the Introskip dB chapter points - so we are also working on a way to remove the superfluous entries without the need for a manual refresh as this in itself clearly involves a lot of work to 'find them'.  

Edited July 18, 2022 by rbjtech

[crusher11 851]

1 hour ago, rbjtech said:

..and on that note -

@crusher11

The extra chapters issue in the Plugin has been resolved, I've had the fix for a few days now from @Cheesegeezer and it works great.

This needs a manual refresh of the item to put it back to it's original state before correctly adding the Introskip dB chapter points - so we are also working on a way to remove the superfluous entries without the need for a manual refresh as this in itself clearly involves a lot of work to 'find them'.  

Yes, I have that update as well, that's why I'm trying to find the problem episodes. However, the update seems to have broken the import functionality nearly completely, as I cannot import the intro/end credit points back into most those episodes.