Fixed chapter image extraction doesn't work for most movies (Synology)

August 29, 2016

@@horstepipe

I took a look the MKV properties dump you sent me, this caught my eye...
Writing application : mkvmerge v2.9.0 ('Moanin'') built on May 22 2009 17:46:31
Writing library     : libebml v0.7.7 + libmatroska v0.8.1
When did you create this file? This is a very old version.

As you will have noted in some of the related threads you posted earlier (or a quick Google), there were issues with the way the MKV files were being created historically.

- James

Yes this file is quite old, but I have others with the same problem:

General
Unique ID                                : 231540473773253045873500357489579294344 (0xAE3112BBC6F1B18D89CC1C0336387E88)
Complete name                            : W:\Filme\The Jungle Book (2016)\The Jungle Book.1080p.bluray.dca.mkv
Format                                   : Matroska
Format version                           : Version 4 / Version 2
File size                                : 8.59 GiB
Duration                                 : 1 h 45 min
Overall bit rate                         : 11.6 Mb/s
Encoded date                             : UTC 2016-08-06 19:20:27
Writing application                      : mkvmerge v8.3.0 ('Over the Horizon') 64bit
Writing library                          : libebml v1.3.1 + libmatroska v1.4.2

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.1
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 4 frames
Codec ID                                 : V_MPEG4/ISO/AVC
Duration                                 : 1 h 45 min
Bit rate                                 : 8 552 kb/s
Width                                    : 1 920 pixels
Height                                   : 1 040 pixels
Display aspect ratio                     : 1.85:1
Frame rate mode                          : Constant
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.179
Stream size                              : 6.33 GiB (74%)
Writing library                          : x264 core 148 r2705 3f5ed56
Encoding settings                        : cabac=1 / ref=4 / deblock=1:-2:-2 / analyse=0x3:0x113 / me=umh / subme=7 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=0 / chroma_qp_offset=-2 / threads=24 / lookahead_threads=4 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=5 / b_pyramid=2 / b_adapt=1 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=1 / keyint=250 / keyint_min=23 / scenecut=40 / intra_refresh=0 / rc_lookahead=40 / rc=crf / mbtree=1 / crf=19.0 / qcomp=0.60 / qpmin=16 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00
Language                                 : English
Default                                  : Yes
Forced                                   : No

Audio #1
ID                                       : 2
Format                                   : DTS
Format/Info                              : Digital Theater Systems
Mode                                     : 16
Format settings, Endianness              : Big
Codec ID                                 : A_DTS
Duration                                 : 1 h 45 min
Bit rate mode                            : Constant
Bit rate                                 : 1 509 kb/s
Channel(s)                               : 6 channels
Channel positions                        : Front: L C R, Side: L R, LFE
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 spf)
Bit depth                                : 24 bits
Compression mode                         : Lossy
Stream size                              : 1.12 GiB (13%)
Language                                 : German
Default                                  : Yes
Forced                                   : Yes

Audio #2
ID                                       : 3
Format                                   : DTS
Format/Info                              : Digital Theater Systems
Mode                                     : 16
Format settings, Endianness              : Big
Codec ID                                 : A_DTS
Duration                                 : 1 h 45 min
Bit rate mode                            : Constant
Bit rate                                 : 1 509 kb/s
Channel(s)                               : 6 channels
Channel positions                        : Front: L C R, Side: L R, LFE
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 spf)
Bit depth                                : 24 bits
Compression mode                         : Lossy
Stream size                              : 1.12 GiB (13%)
Language                                 : English
Default                                  : No
Forced                                   : No

Text #1
ID                                       : 4
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 4 s 838 ms
Bit rate                                 : 25.1 kb/s
Count of elements                        : 4
Stream size                              : 14.8 KiB (0%)
Language                                 : German
Default                                  : Yes
Forced                                   : Yes

Text #2
ID                                       : 5
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 1 h 45 min
Bit rate                                 : 21.8 kb/s
Count of elements                        : 3862
Stream size                              : 16.4 MiB (0%)
Language                                 : German
Default                                  : No
Forced                                   : No

Text #3
ID                                       : 6
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 1 h 44 min
Bit rate                                 : 10.6 kb/s
Count of elements                        : 2822
Stream size                              : 7.94 MiB (0%)
Language                                 : English
Default                                  : No
Forced                                   : No

Menu
00:00:00.000                             : en:00:00:00.000
00:00:48.215                             : en:00:00:48.215
00:05:15.315                             : en:00:05:15.315
00:09:02.459                             : en:00:09:02.459
00:12:42.178                             : en:00:12:42.178
00:16:34.452                             : en:00:16:34.452
00:21:20.029                             : en:00:21:20.029
00:27:15.133                             : en:00:27:15.133
00:35:04.144                             : en:00:35:04.144
00:43:21.724                             : en:00:43:21.724
00:48:05.132                             : en:00:48:05.132
00:53:29.248                             : en:00:53:29.248
00:58:03.271                             : en:00:58:03.271
01:05:46.442                             : en:01:05:46.442
01:10:35.523                             : en:01:10:35.523
01:17:01.325                             : en:01:17:01.325
01:20:48.927                             : en:01:20:48.927
01:24:46.540                             : en:01:24:46.540
01:30:32.969                             : en:01:30:32.969
01:35:53.206                             : en:01:35:53.206

no chapter image at all here

August 29, 2016

Hello @@horstepipe

Can you also run the following, to make sure these behave as expected, posting the output back here.

SSH to your box then run these commands:-
cd /var/packages/EmbyServer/target/ffmpeg/bin

sudo ./ffprobe -i file:"/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/Watchmen - Die WÃ¤chter.1080p.bluray.ac3.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format

sudo ./ffmpeg -i file:"/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/Watchmen - Die WÃ¤chter.1080p.bluray.ac3.mkv" -map 0:v:0 -an -filter:v idet -frames:v 500 -an -f null /dev/null
As before, you'll need to fixup the path to correct for the unicode characters.

- James

August 29, 2016

Hello @@horstepipe

The second command doesn't appear to have run, can you try again - looks like there may have been a leading #.

- James

August 29, 2016

Hello @@horstepipe

The second command doesn't appear to have run, can you try again - looks like there may have been a leading #.

- James

ohps sorry:

August 29, 2016

Thanks @@horstepipe, I don't see any issues here with FFmpeg or FFprobe, the behaviour appears correct.

When you ran the chapter image extraction command earlier, how long did it take?

- James

August 29, 2016

Thanks @@horstepipe, I don't see any issues here with FFmpeg or FFprobe, the behaviour appears correct.

When you ran the chapter image extraction command earlier, how long did it take?

- James

about 3 minutes

August 29, 2016

Hello

So that was to generate the single testimg.jpg? If so, that'll be the problem, 3 minutes is just too long and the extract will hit the timeout.

Filtering the log and looking through the timings earlier, you can see the pattern.

This was discussed a few years back here: http://emby.media/community/index.php?/topic/4086-chapter-image-extraction-issues/?p=62986

The ARM based Synology machines generally do not have the raw processing power of their Intel counterparts, but I would not expect this to take 3 minutes.

- James

August 29, 2016

Hi @@horstepipe

Can you get the timing for generating the thumbnail image using the below instead.

SSH to your box then run these commands:-

cd /usr/bin

sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/Watchmen - Die WÃ¤chter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/testimg.jpg"

As before, you'll need to fixup the path to correct for the unicode characters.

- James

Edited August 29, 2016 by solabc16

August 29, 2016

Hello

So that was to generate the single testimg.jpg? If so, that'll be the problem, 3 minutes is just too long and the extract will hit the timeout.

Filtering the log and looking through the timings earlier, you can see the pattern.

This was discussed a few years back here: http://emby.media/community/index.php?/topic/4086-chapter-image-extraction-issues/?p=62986

The ARM based Synology machines generally do not have the raw processing power of their Intel counterparts, but I would not expect this to take 3 minutes.

- James

one moment, I hope I didn't mix something up. I was talking about this command:

sudo ./ffmpeg -i file:"/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/Watchmen - Die WÃ¤chter.1080p.bluray.ac3.mkv" -map 0:v:0 -an -filter:v idet -frames:v 500 -an -f null /dev/null

I started it again three times, in fact in only needs one minute, I checked it with a stopwatch, sorry.

But if you are talking about this command:

sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/Watchmen - Die WÃ¤chter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/testimg.jpg"

this only needs 10 seconds.

August 29, 2016

Hi @@horstepipe

Can you get the timing for generating the thumbnail image using the below instead.

SSH to your box then run these commands:-
cd /usr/bin

sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/Watchmen - Die WÃ¤chter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die WÃ¤chter (2009)/testimg.jpg"
As before, you'll need to fixup the path to correct for the unicode characters.

- James

nothing happens here and no testimg.jpg is being created

admin@WollesNAS:/$ cd /usr/bin
admin@WollesNAS:/usr/bin$ sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
Password:
admin@WollesNAS:/usr/bin$

August 29, 2016

Hello @@horstepipe

Ok, that gives us something more to go on.

Just to be sure, before making any conclusions, did you delete the existing testimg.jpg before running the command above?

- James

August 29, 2016

Hello @@horstepipe

Ok, that gives us something more to go on.

Just to be sure, before making any conclusions, did you delete the existing testimg.jpg before running the command above?

- James

yes

admin@WollesNAS:/$ cd "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/"
admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ ls
banner.jpg    fanart.jpg     theme.mp3
clearart.png  landscape.jpg  Watchmen - Die Wächter.1080p.bluray.ac3.mkv
disc.png      logo.png       Watchmen - Die Wächter.1080p.bluray.ac3.nfo
extrafanart   poster.jpg
admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ cd /usr/bin
admin@WollesNAS:/usr/bin$ sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
Password:
admin@WollesNAS:/usr/bin$ cd "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/"
admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ ls
banner.jpg    fanart.jpg     theme.mp3
clearart.png  landscape.jpg  Watchmen - Die Wächter.1080p.bluray.ac3.mkv
disc.png      logo.png       Watchmen - Die Wächter.1080p.bluray.ac3.nfo
extrafanart   poster.jpg
admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$

Edited August 29, 2016 by horstepipe

August 29, 2016

Ok, thanks for confirming that. I'm not surprised that it didn't work with the version shipped with DSM.

How quickly does the prompt return after issuing the command in the example above?

The newer build is actually working as proven by the tests, which is of course why we built it.

However, on the ARM equipped Synology boxes (in this case at least), it doesn't look like we can complete the extract before the timeout kicks in.

@@Luke, is this configurable? With the increased support for differenent h/w platforms and CPU architectures, this is ideally something we would be able to tune as part of the packaging process for different targets.

- James

August 29, 2016

Not at the moment but it's possible to add that in the future.

August 29, 2016

How quickly does the prompt return after issuing the command in the example above?

not even half a second.

Mhh that's really a stupid situation. Hope there's something that could be done in the future.

August 29, 2016

The timeout to extract a single image is 10 seconds before Emby kills the process, fyi.

August 29, 2016

I wouldn't call it 'stupid', it's just a by-product of progress, as the platforms Emby Server is supported on grows.

It's not a small task porting to different targets and making sure the functionality is up to scratch.

This is why we have the beta programmes and ARM (Marvell) support is still in closed-group beta at this stage to work through items such as this.

@@Luke, is there any way for us to prove the theory by adjusting this setting? If you can point me to the relevant source, I can take it from there if need be.

Best

- James

August 29, 2016

why not just run the command line all by itself for testing purposes?

August 29, 2016

why not just run the command line all by itself for testing purposes?

That's what all of the testing above is about, and how we reached the conclusion we have?

What it doesn't conclude 100% is that it is the timeout, although that is the likely conclusion.

It would be good to prove this within the server environment before making further decisions.

- James

Edited August 29, 2016 by solabc16

August 29, 2016

Ok, i'll add a hidden config switch soon in an upcoming beta. Thanks.

August 29, 2016

Thanks @@Luke

August 30, 2016

Hello @@horstepipe

Please can you SSH to your box and run the following, to give us some more information on the chapter image extraction performance:-

cd /var/packages/EmbyServer/target/ffmpeg/bin

sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"

You'll get some output similiar to the below:-

real 0.37
user 0.41
sys 0.02

If you could run this five times, deleting the output file (testimg.jpg) between each run, then posting the output here that would be great.

- James

August 31, 2016

Hello @@horstepipe

Please can you SSH to your box and run the following, to give us some more information on the chapter image extraction performance:-
cd /var/packages/EmbyServer/target/ffmpeg/bin

sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
You'll get some output similiar to the below:-
real 0.37
user 0.41
sys 0.02
If you could run this five times, deleting the output file (testimg.jpg) between each run, then posting the output here that would be great.

- James

sure:

admin@WollesNAS:/$ cd /var/packages/EmbyServer/target/ffmpeg/bin
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
Password:
real 8.58
user 10.99
sys 0.12
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
real 7.39
user 11.00
sys 0.11
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"                                                  admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
real 7.48
user 11.02
sys 0.08
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"                                                  admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
real 7.68
user 10.97
sys 0.13
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"                                                  admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
real 8.58
user 11.03
sys 0.09
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$

August 31, 2016

so are those values acceptable or it is too slow in general?

August 31, 2016

Hello @@horstepipe

At best it's borderline, which we already knew and likely to run into the process timeout; which is what we've seen in your logs.

I wanted some more detail, hence the reason for running the above, so I could get the user/sys times.

- James

Sign In

Fixed chapter image extraction doesn't work for most movies (Synology)

Recommended Posts

horstepipe 377

horstepipe 377

solabc16 379

horstepipe 377

solabc16 379

horstepipe 377

solabc16 379

solabc16 379

horstepipe 377

horstepipe 377

solabc16 379

horstepipe 377

solabc16 379

Luke 40077

horstepipe 377

Luke 40077

solabc16 379

Luke 40077

solabc16 379

Luke 40077

solabc16 379

solabc16 379

horstepipe 377

horstepipe 377

solabc16 379

Create an account or sign in to comment

Create an account

Sign in

Activity