Jump to content

chapter image extraction doesn't work for most movies (Synology)

horstepipe

By horstepipe,
in Synology

 Share
Go to solution Solved by solabc16,

Recommended Posts

horstepipe

horstepipe   312

Posted
  • Author
Posted

@@horstepipe

 

I took a look the MKV properties dump you sent me, this caught my eye...

Writing application : mkvmerge v2.9.0 ('Moanin'') built on May 22 2009 17:46:31
Writing library     : libebml v0.7.7 + libmatroska v0.8.1

When did you create this file? This is a very old version.

 

As you will have noted in some of the related threads you posted earlier (or a quick Google), there were issues with the way the MKV files were being created historically.

 

- James

 

Yes this file is quite old, but I have others with the same problem:

General
Unique ID                                : 231540473773253045873500357489579294344 (0xAE3112BBC6F1B18D89CC1C0336387E88)
Complete name                            : W:\Filme\The Jungle Book (2016)\The Jungle Book.1080p.bluray.dca.mkv
Format                                   : Matroska
Format version                           : Version 4 / Version 2
File size                                : 8.59 GiB
Duration                                 : 1 h 45 min
Overall bit rate                         : 11.6 Mb/s
Encoded date                             : UTC 2016-08-06 19:20:27
Writing application                      : mkvmerge v8.3.0 ('Over the Horizon') 64bit
Writing library                          : libebml v1.3.1 + libmatroska v1.4.2

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.1
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 4 frames
Codec ID                                 : V_MPEG4/ISO/AVC
Duration                                 : 1 h 45 min
Bit rate                                 : 8 552 kb/s
Width                                    : 1 920 pixels
Height                                   : 1 040 pixels
Display aspect ratio                     : 1.85:1
Frame rate mode                          : Constant
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.179
Stream size                              : 6.33 GiB (74%)
Writing library                          : x264 core 148 r2705 3f5ed56
Encoding settings                        : cabac=1 / ref=4 / deblock=1:-2:-2 / analyse=0x3:0x113 / me=umh / subme=7 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=0 / chroma_qp_offset=-2 / threads=24 / lookahead_threads=4 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=5 / b_pyramid=2 / b_adapt=1 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=1 / keyint=250 / keyint_min=23 / scenecut=40 / intra_refresh=0 / rc_lookahead=40 / rc=crf / mbtree=1 / crf=19.0 / qcomp=0.60 / qpmin=16 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00
Language                                 : English
Default                                  : Yes
Forced                                   : No

Audio #1
ID                                       : 2
Format                                   : DTS
Format/Info                              : Digital Theater Systems
Mode                                     : 16
Format settings, Endianness              : Big
Codec ID                                 : A_DTS
Duration                                 : 1 h 45 min
Bit rate mode                            : Constant
Bit rate                                 : 1 509 kb/s
Channel(s)                               : 6 channels
Channel positions                        : Front: L C R, Side: L R, LFE
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 spf)
Bit depth                                : 24 bits
Compression mode                         : Lossy
Stream size                              : 1.12 GiB (13%)
Language                                 : German
Default                                  : Yes
Forced                                   : Yes

Audio #2
ID                                       : 3
Format                                   : DTS
Format/Info                              : Digital Theater Systems
Mode                                     : 16
Format settings, Endianness              : Big
Codec ID                                 : A_DTS
Duration                                 : 1 h 45 min
Bit rate mode                            : Constant
Bit rate                                 : 1 509 kb/s
Channel(s)                               : 6 channels
Channel positions                        : Front: L C R, Side: L R, LFE
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 spf)
Bit depth                                : 24 bits
Compression mode                         : Lossy
Stream size                              : 1.12 GiB (13%)
Language                                 : English
Default                                  : No
Forced                                   : No

Text #1
ID                                       : 4
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 4 s 838 ms
Bit rate                                 : 25.1 kb/s
Count of elements                        : 4
Stream size                              : 14.8 KiB (0%)
Language                                 : German
Default                                  : Yes
Forced                                   : Yes

Text #2
ID                                       : 5
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 1 h 45 min
Bit rate                                 : 21.8 kb/s
Count of elements                        : 3862
Stream size                              : 16.4 MiB (0%)
Language                                 : German
Default                                  : No
Forced                                   : No

Text #3
ID                                       : 6
Format                                   : PGS
Muxing mode                              : zlib
Codec ID                                 : S_HDMV/PGS
Codec ID/Info                            : Picture based subtitle format used on BDs/HD-DVDs
Duration                                 : 1 h 44 min
Bit rate                                 : 10.6 kb/s
Count of elements                        : 2822
Stream size                              : 7.94 MiB (0%)
Language                                 : English
Default                                  : No
Forced                                   : No

Menu
00:00:00.000                             : en:00:00:00.000
00:00:48.215                             : en:00:00:48.215
00:05:15.315                             : en:00:05:15.315
00:09:02.459                             : en:00:09:02.459
00:12:42.178                             : en:00:12:42.178
00:16:34.452                             : en:00:16:34.452
00:21:20.029                             : en:00:21:20.029
00:27:15.133                             : en:00:27:15.133
00:35:04.144                             : en:00:35:04.144
00:43:21.724                             : en:00:43:21.724
00:48:05.132                             : en:00:48:05.132
00:53:29.248                             : en:00:53:29.248
00:58:03.271                             : en:00:58:03.271
01:05:46.442                             : en:01:05:46.442
01:10:35.523                             : en:01:10:35.523
01:17:01.325                             : en:01:17:01.325
01:20:48.927                             : en:01:20:48.927
01:24:46.540                             : en:01:24:46.540
01:30:32.969                             : en:01:30:32.969
01:35:53.206                             : en:01:35:53.206

no chapter image at all here

Link to comment
Share on other sites
horstepipe

horstepipe   312

Posted
  • Author
Posted

Hello @@horstepipe

 

Can you also run the following, to make sure these behave as expected, posting the output back here.

 

SSH to your box then run these commands:-

cd /var/packages/EmbyServer/target/ffmpeg/bin

sudo ./ffprobe -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format

sudo ./ffmpeg -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -map 0:v:0 -an -filter:v idet -frames:v 500 -an -f null /dev/null

As before, you'll need to fixup the path to correct for the unicode characters.

 

- James

Link to comment
Share on other sites
horstepipe

horstepipe   312

Posted
  • Author
Posted

Hello @@horstepipe

 

The second command doesn't appear to have run, can you try again - looks like there may have been a leading #.

 

- James

ohps sorry:

Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted

Thanks @@horstepipe, I don't see any issues here with FFmpeg or FFprobe, the behaviour appears correct.

 

When you ran the chapter image extraction command earlier, how long did it take?

 

- James

Link to comment
Share on other sites
horstepipe

horstepipe   312

Posted
  • Author
Posted

Thanks @@horstepipe, I don't see any issues here with FFmpeg or FFprobe, the behaviour appears correct.

 

When you ran the chapter image extraction command earlier, how long did it take?

 

- James

about 3 minutes

Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted

Hello

 

So that was to generate the single testimg.jpg? If so, that'll be the problem, 3 minutes is just too long and the extract will hit the timeout.

 

Filtering the log and looking through the timings earlier, you can see the pattern.

 

This was discussed a few years back here: http://emby.media/community/index.php?/topic/4086-chapter-image-extraction-issues/?p=62986

 

The ARM based Synology machines generally do not have the raw processing power of their Intel counterparts, but I would not expect this to take 3 minutes.

 

- James

Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted (edited)

Hi @@horstepipe

 

Can you get the timing for generating the thumbnail image using the below instead.

 

SSH to your box then run these commands:-

cd /usr/bin

sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"

As before, you'll need to fixup the path to correct for the unicode characters.

 

- James

Edited by solabc16
Link to comment
Share on other sites
horstepipe

horstepipe   312

Posted
  • Author
Posted

Hello

 

So that was to generate the single testimg.jpg? If so, that'll be the problem, 3 minutes is just too long and the extract will hit the timeout.

 

Filtering the log and looking through the timings earlier, you can see the pattern.

 

This was discussed a few years back here: http://emby.media/community/index.php?/topic/4086-chapter-image-extraction-issues/?p=62986

 

The ARM based Synology machines generally do not have the raw processing power of their Intel counterparts, but I would not expect this to take 3 minutes.

 

- James

 

one moment, I hope I didn't mix something up. I was talking about this command:

sudo ./ffmpeg -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -map 0:v:0 -an -filter:v idet -frames:v 500 -an -f null /dev/null

I started it again three times, in fact in only needs one minute, I checked it with a stopwatch, sorry.

 

But if you are talking about this command:

sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"

this only needs 10 seconds.

Link to comment
Share on other sites
horstepipe

horstepipe   312

Posted
  • Author
Posted

Hi @@horstepipe

 

Can you get the timing for generating the thumbnail image using the below instead.

 

SSH to your box then run these commands:-

cd /usr/bin

sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"

As before, you'll need to fixup the path to correct for the unicode characters.

 

- James

 

 

nothing happens here and no testimg.jpg is being created

admin@WollesNAS:/$ cd /usr/bin
admin@WollesNAS:/usr/bin$ sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
Password:
admin@WollesNAS:/usr/bin$
Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted

Hello @@horstepipe

 

Ok, that gives us something more to go on.

 

Just to be sure, before making any conclusions, did you delete the existing testimg.jpg before running the command above?

 

- James

Link to comment
Share on other sites
horstepipe

horstepipe   312

Posted
  • Author
Posted (edited)

Hello @@horstepipe

 

Ok, that gives us something more to go on.

 

Just to be sure, before making any conclusions, did you delete the existing testimg.jpg before running the command above?

 

- James

 

yes

admin@WollesNAS:/$ cd "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/"
admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ ls
banner.jpg    fanart.jpg     theme.mp3
clearart.png  landscape.jpg  Watchmen - Die Wächter.1080p.bluray.ac3.mkv
disc.png      logo.png       Watchmen - Die Wächter.1080p.bluray.ac3.nfo
extrafanart   poster.jpg
admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ cd /usr/bin
admin@WollesNAS:/usr/bin$ sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
Password:
admin@WollesNAS:/usr/bin$ cd "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/"
admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ ls
banner.jpg    fanart.jpg     theme.mp3
clearart.png  landscape.jpg  Watchmen - Die Wächter.1080p.bluray.ac3.mkv
disc.png      logo.png       Watchmen - Die Wächter.1080p.bluray.ac3.nfo
extrafanart   poster.jpg
admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$
Edited by horstepipe
Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted

Ok, thanks for confirming that. I'm not surprised that it didn't work with the version shipped with DSM.

 

How quickly does the prompt return after issuing the command in the example above?

 

The newer build is actually working as proven by the tests, which is of course why we built it.

 

However, on the ARM equipped Synology boxes (in this case at least), it doesn't look like we can complete the extract before the timeout kicks in.

 

@@Luke, is this configurable? With the increased support for differenent h/w platforms and CPU architectures, this is ideally something we would be able to tune as part of the packaging process for different targets.

 

- James

Link to comment
Share on other sites
horstepipe

horstepipe   312

Posted
  • Author
Posted

How quickly does the prompt return after issuing the command in the example above?

 

 

not even half a second.

 

Mhh that's really a stupid situation. Hope there's something that could be done in the future.

Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted

I wouldn't call it 'stupid', it's just a by-product of progress, as the platforms Emby Server is supported on grows.

 

It's not a small task porting to different targets and making sure the functionality is up to scratch.

 

This is why we have the beta programmes and ARM (Marvell) support is still in closed-group beta at this stage to work through items such as this.

 

@@Luke, is there any way for us to prove the theory by adjusting this setting? If you can point me to the relevant source, I can take it from there if need be.

 

Best

- James

  • Like 1
Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted (edited)

why not just run the command line all by itself for testing purposes?

 

That's what all of the testing above is about, and how we reached the conclusion we have?

 

What it doesn't conclude 100% is that it is the timeout, although that is the likely conclusion.

 

It would be good to prove this within the server environment before making further decisions.

 

- James

Edited by solabc16
Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted

Hello @@horstepipe

 

Please can you SSH to your box and run the following, to give us some more information on the chapter image extraction performance:-

cd /var/packages/EmbyServer/target/ffmpeg/bin

sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"

You'll get some output similiar to the below:-

real 0.37
user 0.41
sys 0.02

If you could run this five times, deleting the output file (testimg.jpg) between each run, then posting the output here that would be great.

 

- James

Link to comment
Share on other sites
horstepipe

horstepipe   312

Posted
  • Author
Posted

Hello @@horstepipe

 

Please can you SSH to your box and run the following, to give us some more information on the chapter image extraction performance:-

cd /var/packages/EmbyServer/target/ffmpeg/bin

sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"

You'll get some output similiar to the below:-

real 0.37
user 0.41
sys 0.02

If you could run this five times, deleting the output file (testimg.jpg) between each run, then posting the output here that would be great.

 

- James

 

 

sure:

admin@WollesNAS:/$ cd /var/packages/EmbyServer/target/ffmpeg/bin
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
Password:
real 8.58
user 10.99
sys 0.12
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
real 7.39
user 11.00
sys 0.11
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"                                                  admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
real 7.48
user 11.02
sys 0.08
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"                                                  admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
real 7.68
user 10.97
sys 0.13
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"                                                  admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg"
real 8.58
user 11.03
sys 0.09
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$
Link to comment
Share on other sites
solabc16

solabc16   379

Posted
Posted

Hello @@horstepipe

 

At best it's borderline, which we already knew and likely to run into the process timeout; which is what we've seen in your logs.

 

I wanted some more detail, hence the reason for running the above, so I could get the user/sys times.

 

- James

  • Like 1
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...