horstepipe 356 Posted August 29, 2016 Author Share Posted August 29, 2016 @@horstepipe I took a look the MKV properties dump you sent me, this caught my eye... Writing application : mkvmerge v2.9.0 ('Moanin'') built on May 22 2009 17:46:31 Writing library : libebml v0.7.7 + libmatroska v0.8.1 When did you create this file? This is a very old version. As you will have noted in some of the related threads you posted earlier (or a quick Google), there were issues with the way the MKV files were being created historically. - James Yes this file is quite old, but I have others with the same problem: General Unique ID : 231540473773253045873500357489579294344 (0xAE3112BBC6F1B18D89CC1C0336387E88) Complete name : W:\Filme\The Jungle Book (2016)\The Jungle Book.1080p.bluray.dca.mkv Format : Matroska Format version : Version 4 / Version 2 File size : 8.59 GiB Duration : 1 h 45 min Overall bit rate : 11.6 Mb/s Encoded date : UTC 2016-08-06 19:20:27 Writing application : mkvmerge v8.3.0 ('Over the Horizon') 64bit Writing library : libebml v1.3.1 + libmatroska v1.4.2 Video ID : 1 Format : AVC Format/Info : Advanced Video Codec Format profile : High@L4.1 Format settings, CABAC : Yes Format settings, ReFrames : 4 frames Codec ID : V_MPEG4/ISO/AVC Duration : 1 h 45 min Bit rate : 8 552 kb/s Width : 1 920 pixels Height : 1 040 pixels Display aspect ratio : 1.85:1 Frame rate mode : Constant Frame rate : 23.976 (24000/1001) FPS Color space : YUV Chroma subsampling : 4:2:0 Bit depth : 8 bits Scan type : Progressive Bits/(Pixel*Frame) : 0.179 Stream size : 6.33 GiB (74%) Writing library : x264 core 148 r2705 3f5ed56 Encoding settings : cabac=1 / ref=4 / deblock=1:-2:-2 / analyse=0x3:0x113 / me=umh / subme=7 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=0 / chroma_qp_offset=-2 / threads=24 / lookahead_threads=4 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=5 / b_pyramid=2 / b_adapt=1 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=1 / keyint=250 / keyint_min=23 / scenecut=40 / intra_refresh=0 / rc_lookahead=40 / rc=crf / mbtree=1 / crf=19.0 / qcomp=0.60 / qpmin=16 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00 Language : English Default : Yes Forced : No Audio #1 ID : 2 Format : DTS Format/Info : Digital Theater Systems Mode : 16 Format settings, Endianness : Big Codec ID : A_DTS Duration : 1 h 45 min Bit rate mode : Constant Bit rate : 1 509 kb/s Channel(s) : 6 channels Channel positions : Front: L C R, Side: L R, LFE Sampling rate : 48.0 kHz Frame rate : 93.750 FPS (512 spf) Bit depth : 24 bits Compression mode : Lossy Stream size : 1.12 GiB (13%) Language : German Default : Yes Forced : Yes Audio #2 ID : 3 Format : DTS Format/Info : Digital Theater Systems Mode : 16 Format settings, Endianness : Big Codec ID : A_DTS Duration : 1 h 45 min Bit rate mode : Constant Bit rate : 1 509 kb/s Channel(s) : 6 channels Channel positions : Front: L C R, Side: L R, LFE Sampling rate : 48.0 kHz Frame rate : 93.750 FPS (512 spf) Bit depth : 24 bits Compression mode : Lossy Stream size : 1.12 GiB (13%) Language : English Default : No Forced : No Text #1 ID : 4 Format : PGS Muxing mode : zlib Codec ID : S_HDMV/PGS Codec ID/Info : Picture based subtitle format used on BDs/HD-DVDs Duration : 4 s 838 ms Bit rate : 25.1 kb/s Count of elements : 4 Stream size : 14.8 KiB (0%) Language : German Default : Yes Forced : Yes Text #2 ID : 5 Format : PGS Muxing mode : zlib Codec ID : S_HDMV/PGS Codec ID/Info : Picture based subtitle format used on BDs/HD-DVDs Duration : 1 h 45 min Bit rate : 21.8 kb/s Count of elements : 3862 Stream size : 16.4 MiB (0%) Language : German Default : No Forced : No Text #3 ID : 6 Format : PGS Muxing mode : zlib Codec ID : S_HDMV/PGS Codec ID/Info : Picture based subtitle format used on BDs/HD-DVDs Duration : 1 h 44 min Bit rate : 10.6 kb/s Count of elements : 2822 Stream size : 7.94 MiB (0%) Language : English Default : No Forced : No Menu 00:00:00.000 : en:00:00:00.000 00:00:48.215 : en:00:00:48.215 00:05:15.315 : en:00:05:15.315 00:09:02.459 : en:00:09:02.459 00:12:42.178 : en:00:12:42.178 00:16:34.452 : en:00:16:34.452 00:21:20.029 : en:00:21:20.029 00:27:15.133 : en:00:27:15.133 00:35:04.144 : en:00:35:04.144 00:43:21.724 : en:00:43:21.724 00:48:05.132 : en:00:48:05.132 00:53:29.248 : en:00:53:29.248 00:58:03.271 : en:00:58:03.271 01:05:46.442 : en:01:05:46.442 01:10:35.523 : en:01:10:35.523 01:17:01.325 : en:01:17:01.325 01:20:48.927 : en:01:20:48.927 01:24:46.540 : en:01:24:46.540 01:30:32.969 : en:01:30:32.969 01:35:53.206 : en:01:35:53.206 no chapter image at all here Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 29, 2016 Author Share Posted August 29, 2016 Hello @@horstepipe Can you also run the following, to make sure these behave as expected, posting the output back here. SSH to your box then run these commands:- cd /var/packages/EmbyServer/target/ffmpeg/bin sudo ./ffprobe -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format sudo ./ffmpeg -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -map 0:v:0 -an -filter:v idet -frames:v 500 -an -f null /dev/null As before, you'll need to fixup the path to correct for the unicode characters. - James Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 Hello @@horstepipe The second command doesn't appear to have run, can you try again - looks like there may have been a leading #. - James Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 29, 2016 Author Share Posted August 29, 2016 Hello @@horstepipe The second command doesn't appear to have run, can you try again - looks like there may have been a leading #. - James ohps sorry: Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 Thanks @@horstepipe, I don't see any issues here with FFmpeg or FFprobe, the behaviour appears correct. When you ran the chapter image extraction command earlier, how long did it take? - James Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 29, 2016 Author Share Posted August 29, 2016 Thanks @@horstepipe, I don't see any issues here with FFmpeg or FFprobe, the behaviour appears correct. When you ran the chapter image extraction command earlier, how long did it take? - James about 3 minutes Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 Hello So that was to generate the single testimg.jpg? If so, that'll be the problem, 3 minutes is just too long and the extract will hit the timeout. Filtering the log and looking through the timings earlier, you can see the pattern. This was discussed a few years back here: http://emby.media/community/index.php?/topic/4086-chapter-image-extraction-issues/?p=62986 The ARM based Synology machines generally do not have the raw processing power of their Intel counterparts, but I would not expect this to take 3 minutes. - James Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 (edited) Hi @@horstepipe Can you get the timing for generating the thumbnail image using the below instead. SSH to your box then run these commands:- cd /usr/bin sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" As before, you'll need to fixup the path to correct for the unicode characters. - James Edited August 29, 2016 by solabc16 Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 29, 2016 Author Share Posted August 29, 2016 Hello So that was to generate the single testimg.jpg? If so, that'll be the problem, 3 minutes is just too long and the extract will hit the timeout. Filtering the log and looking through the timings earlier, you can see the pattern. This was discussed a few years back here: http://emby.media/community/index.php?/topic/4086-chapter-image-extraction-issues/?p=62986 The ARM based Synology machines generally do not have the raw processing power of their Intel counterparts, but I would not expect this to take 3 minutes. - James one moment, I hope I didn't mix something up. I was talking about this command: sudo ./ffmpeg -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -map 0:v:0 -an -filter:v idet -frames:v 500 -an -f null /dev/null I started it again three times, in fact in only needs one minute, I checked it with a stopwatch, sorry. But if you are talking about this command: sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" this only needs 10 seconds. Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 29, 2016 Author Share Posted August 29, 2016 Hi @@horstepipe Can you get the timing for generating the thumbnail image using the below instead. SSH to your box then run these commands:- cd /usr/bin sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" As before, you'll need to fixup the path to correct for the unicode characters. - James nothing happens here and no testimg.jpg is being created admin@WollesNAS:/$ cd /usr/bin admin@WollesNAS:/usr/bin$ sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" Password: admin@WollesNAS:/usr/bin$ Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 Hello @@horstepipe Ok, that gives us something more to go on. Just to be sure, before making any conclusions, did you delete the existing testimg.jpg before running the command above? - James Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 29, 2016 Author Share Posted August 29, 2016 (edited) Hello @@horstepipe Ok, that gives us something more to go on. Just to be sure, before making any conclusions, did you delete the existing testimg.jpg before running the command above? - James yes admin@WollesNAS:/$ cd "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/" admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ ls banner.jpg fanart.jpg theme.mp3 clearart.png landscape.jpg Watchmen - Die Wächter.1080p.bluray.ac3.mkv disc.png logo.png Watchmen - Die Wächter.1080p.bluray.ac3.nfo extrafanart poster.jpg admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ cd /usr/bin admin@WollesNAS:/usr/bin$ sudo ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" Password: admin@WollesNAS:/usr/bin$ cd "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/" admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ ls banner.jpg fanart.jpg theme.mp3 clearart.png landscape.jpg Watchmen - Die Wächter.1080p.bluray.ac3.mkv disc.png logo.png Watchmen - Die Wächter.1080p.bluray.ac3.nfo extrafanart poster.jpg admin@WollesNAS:/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)$ Edited August 29, 2016 by horstepipe Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 Ok, thanks for confirming that. I'm not surprised that it didn't work with the version shipped with DSM. How quickly does the prompt return after issuing the command in the example above? The newer build is actually working as proven by the tests, which is of course why we built it. However, on the ARM equipped Synology boxes (in this case at least), it doesn't look like we can complete the extract before the timeout kicks in. @@Luke, is this configurable? With the increased support for differenent h/w platforms and CPU architectures, this is ideally something we would be able to tune as part of the packaging process for different targets. - James Link to comment Share on other sites More sharing options...
Luke 37064 Posted August 29, 2016 Share Posted August 29, 2016 Not at the moment but it's possible to add that in the future. Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 29, 2016 Author Share Posted August 29, 2016 How quickly does the prompt return after issuing the command in the example above? not even half a second. Mhh that's really a stupid situation. Hope there's something that could be done in the future. Link to comment Share on other sites More sharing options...
Luke 37064 Posted August 29, 2016 Share Posted August 29, 2016 The timeout to extract a single image is 10 seconds before Emby kills the process, fyi. Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 I wouldn't call it 'stupid', it's just a by-product of progress, as the platforms Emby Server is supported on grows. It's not a small task porting to different targets and making sure the functionality is up to scratch. This is why we have the beta programmes and ARM (Marvell) support is still in closed-group beta at this stage to work through items such as this. @@Luke, is there any way for us to prove the theory by adjusting this setting? If you can point me to the relevant source, I can take it from there if need be. Best - James 1 Link to comment Share on other sites More sharing options...
Luke 37064 Posted August 29, 2016 Share Posted August 29, 2016 why not just run the command line all by itself for testing purposes? Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 (edited) why not just run the command line all by itself for testing purposes? That's what all of the testing above is about, and how we reached the conclusion we have? What it doesn't conclude 100% is that it is the timeout, although that is the likely conclusion. It would be good to prove this within the server environment before making further decisions. - James Edited August 29, 2016 by solabc16 Link to comment Share on other sites More sharing options...
Luke 37064 Posted August 29, 2016 Share Posted August 29, 2016 Ok, i'll add a hidden config switch soon in an upcoming beta. Thanks. 1 Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 29, 2016 Share Posted August 29, 2016 Thanks @@Luke Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 30, 2016 Share Posted August 30, 2016 Hello @@horstepipe Please can you SSH to your box and run the following, to give us some more information on the chapter image extraction performance:- cd /var/packages/EmbyServer/target/ffmpeg/bin sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" You'll get some output similiar to the below:- real 0.37 user 0.41 sys 0.02 If you could run this five times, deleting the output file (testimg.jpg) between each run, then posting the output here that would be great. - James Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 31, 2016 Author Share Posted August 31, 2016 Hello @@horstepipe Please can you SSH to your box and run the following, to give us some more information on the chapter image extraction performance:- cd /var/packages/EmbyServer/target/ffmpeg/bin sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" You'll get some output similiar to the below:- real 0.37 user 0.41 sys 0.02 If you could run this five times, deleting the output file (testimg.jpg) between each run, then posting the output here that would be great. - James sure: admin@WollesNAS:/$ cd /var/packages/EmbyServer/target/ffmpeg/bin admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" Password: real 8.58 user 10.99 sys 0.12 admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" real 7.39 user 11.00 sys 0.11 admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" real 7.48 user 11.02 sys 0.08 admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" real 7.68 user 10.97 sys 0.13 admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo rm "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/Watchmen - Die Wächter.1080p.bluray.ac3.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/Watchmen - Die Wächter (2009)/testimg.jpg" real 8.58 user 11.03 sys 0.09 admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ Link to comment Share on other sites More sharing options...
horstepipe 356 Posted August 31, 2016 Author Share Posted August 31, 2016 so are those values acceptable or it is too slow in general? Link to comment Share on other sites More sharing options...
solabc16 379 Posted August 31, 2016 Share Posted August 31, 2016 Hello @@horstepipe At best it's borderline, which we already knew and likely to run into the process timeout; which is what we've seen in your logs. I wanted some more detail, hence the reason for running the above, so I could get the user/sys times. - James 1 Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now