Jump to content

chapter image extraction doesn't work for most movies (Synology)


horstepipe
Go to solution Solved by solabc16,

Recommended Posts

solabc16

Hello @@horstepipe

 

I've just published 3.1.130.0-1-beta on the beta channel, if you could run the timing tests above once you have this update installed, that would be useful.

 

Thanks

- James

Link to comment
Share on other sites

horstepipe

Hello @@horstepipe

 

I've just published 3.1.130.0-1-beta on the beta channel, if you could run the timing tests above once you have this update installed, that would be useful.

 

Thanks

- James

sure:

real 8.45
user 11.83
sys 0.08

Link to comment
Share on other sites

solabc16

This topic is specific to Synology, correct?

 

Hello @@Happy2Play

 

Yes, if you have the power, then please move this to the Synology forum, were it would be better placed.

 

Best

- James

Link to comment
Share on other sites

solabc16

Hello @@horstepipe
   
I've just published 3.1.130.0-2-beta on the beta channel, if you could run the timing tests again once you have this update installed, that would be great.

Thanks
- James
 

Link to comment
Share on other sites

horstepipe

Hello @@horstepipe

   

I've just published 3.1.130.0-2-beta on the beta channel, if you could run the timing tests again once you have this update installed, that would be great.

 

Thanks

- James

 

 

sure :-)

real 7.64
user 10.82
sys 0.11

Link to comment
Share on other sites

solabc16

Thanks, could you run it a few times so we can get an average, then try running the chapter image extraction to see how it runs.

 

-James

Link to comment
Share on other sites

horstepipe
real 6.80
user 10.83
sys 0.02

real 6.80
user 10.83
sys 0.09

real 6.71
user 10.78
sys 0.13

real 6.78
user 10.78
sys 0.09

real 6.76
user 10.83
sys 0.06

real 6.65
user 10.81
sys 0.07

ok I'll try.

Will the movies which failed before processed again or are they marked kind of finished in Emby?

Same question for the half processed movies.

If so, how can I reset all chapter images?

Link to comment
Share on other sites

Happy2Play

Well on Windows they are stored by movieid in "Emby-Server\Metadata\library" subfolders.

 

example

Emby-Server\Metadata\library\00\000eca2aa41b5a1766eb575847eb0914

57c875770b60f_folder.jpg

Link to comment
Share on other sites

horstepipe

Well on Windows they are stored by movieid in "Emby-Server\Metadata\library" subfolders.

 

example

Emby-Server\Metadata\library\00\000eca2aa41b5a1766eb575847eb0914

57c875770b60f_folder.jpg

thanks,

so simply delete all "chapters" folders should do the trick I hope

Link to comment
Share on other sites

horstepipe

Thanks, could you run it a few times so we can get an average, then try running the chapter image extraction to see how it runs.

 

-James

 

that was way too fast I think I'll have to delete the chapters folders first.

Link to comment
Share on other sites

horstepipe

mhh the images are still available although I removed the folders.

Guess they're cached somewhere, hope the movies are being processed anyway.

Link to comment
Share on other sites

horstepipe

Ok, keep us posted...

 

- James

 

ok here we go:

The chapter-failures.txt contains all movies which fail (makes sense :-) ) So the movies without chapters at all and the movies where only the first chapters were processed are listed there.

I have 436 of 1031 failed movies, that's still quite a lot I think. Looks like almost all of my HD movies failed.

 

I'm gonna pick some of these and post media info and log snippet here.

Link to comment
Share on other sites

horstepipe

I skipped the ones with

Writing application : mkvmerge v2.9.0 ('Moanin'') built on May 22 2009 17:46:31
Writing library     : libebml v0.7.7 + libmatroska v0.8.1

will fire them through mkvtoolnix and look if they work then.

Link to comment
Share on other sites

horstepipe

I tried a

Writing application : mkvmerge v2.9.0 ('Moanin'') built on May 22 2009 17:46:31
Writing library     : libebml v0.7.7 + libmatroska v0.8.1

movie with mkvtoolnix (standard settings)

 

Now it's:

General
Unique ID                                : 233591176725227285863944400525957325982 (0xAFBC0631F83C0C289F9CF215409CE49E)
Complete name                            : W:\Filme\12 Monkeys (1995)\12 Monkeys.1080p.bluray.dca (1).mkv
Format                                   : Matroska
Format version                           : Version 4 / Version 2
File size                                : 12.0 GiB
Duration                                 : 2 h 9 min
Overall bit rate                         : 13.3 Mb/s
Encoded date                             : UTC 2016-09-03 14:26:13
Writing application                      : mkvmerge v9.4.0 ('Knurl') 64bit
Writing library                          : libebml v1.3.4 + libmatroska v1.4.5

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L4.1
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 5 frames
Codec ID                                 : V_MPEG4/ISO/AVC
Duration                                 : 2 h 9 min
Bit rate                                 : 10.3 Mb/s
Width                                    : 1 904 pixels
Height                                   : 1 064 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.212
Stream size                              : 9.31 GiB (77%)
Writing library                          : x264 core 65 r1074M b6bb3d4
Encoding settings                        : cabac=1 / ref=5 / deblock=1:0:0 / analyse=0x3:0x113 / me=hex / subme=6 / psy_rd=1.1:1.0 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=1 / 8x8dct=1 / cqm=0 / deadzone=21,11 / chroma_qp_offset=-4 / threads=3 / nr=0 / decimate=0 / mbaff=0 / bframes=3 / b_pyramid=1 / b_adapt=2 / b_bias=0 / direct=3 / wpredb=1 / keyint=250 / keyint_min=25 / scenecut=40(pre) / rc=2pass / bitrate=10300 / ratetol=1.0 / qcomp=0.60 / qpmin=5 / qpmax=51 / qpstep=4 / cplxblur=20.0 / qblur=0.5 / ip_ratio=1.40 / pb_ratio=1.30 / aq=1:0.40
Default                                  : Yes
Forced                                   : No

Audio #1
ID                                       : 2
Format                                   : DTS
Format/Info                              : Digital Theater Systems
Mode                                     : 16
Format settings, Endianness              : Big
Codec ID                                 : A_DTS
Duration                                 : 2 h 9 min
Bit rate mode                            : Constant
Bit rate                                 : 1 509 kb/s
Channel(s)                               : 6 channels
Channel positions                        : Front: L C R, Side: L R, LFE
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 spf)
Bit depth                                : 16 bits
Compression mode                         : Lossy
Stream size                              : 1.36 GiB (11%)
Language                                 : German
Default                                  : Yes
Forced                                   : No

Audio #2
ID                                       : 3
Format                                   : DTS
Format/Info                              : Digital Theater Systems
Mode                                     : 16
Format settings, Endianness              : Big
Codec ID                                 : A_DTS
Duration                                 : 2 h 9 min
Bit rate mode                            : Constant
Bit rate                                 : 1 509 kb/s
Channel(s)                               : 6 channels
Channel positions                        : Front: L C R, Side: L R, LFE
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 spf)
Bit depth                                : 16 bits
Compression mode                         : Lossy
Stream size                              : 1.36 GiB (11%)
Language                                 : English
Default                                  : No
Forced                                   : No

But I'm still getting

2016-09-03 16:47:52.3105 Error MediaEncoder: ffmpeg image extraction failed for file:"/volume1/WollesNAS/Filme/12 Monkeys (1995)/12 Monkeys.1080p.bluray.dca.mkv"
2016-09-03 16:47:52.3110 Error MediaEncoder: I-frame image extraction failed, will attempt standard way. Input: file:"/volume1/WollesNAS/Filme/12 Monkeys (1995)/12 Monkeys.1080p.bluray.dca.mkv"
2016-09-03 16:47:52.8486 Info HttpServer: HTTP GET http://horstepipe.no-ip.biz:8096/?deviceId=CD232380BE19465C8D2F5DA9EFB2CAD8. UserAgent: 
2016-09-03 16:47:58.0216 Info HttpServer: HTTP GET http://horstepipe.no-ip.biz:8096/?deviceId=CD232380BE19465C8D2F5DA9EFB2CAD8. UserAgent: 
2016-09-03 16:48:02.8204 Info MediaEncoder: Killing ffmpeg process
2016-09-03 16:48:03.2081 Info HttpServer: HTTP GET http://horstepipe.no-ip.biz:8096/?deviceId=CD232380BE19465C8D2F5DA9EFB2CAD8. UserAgent: 
2016-09-03 16:48:03.8305 Error MediaEncoder: ffmpeg image extraction failed for file:"/volume1/WollesNAS/Filme/12 Monkeys (1995)/12 Monkeys.1080p.bluray.dca.mkv"
2016-09-03 16:48:03.8333 Error App: Error extracting chapter images for /volume1/WollesNAS/Filme/12 Monkeys (1995)/12 Monkeys.1080p.bluray.dca.mkv
	*** Error Report ***
	Version: 3.1.132.0
	Command line: /var/packages/EmbyServer/target/server/MediaBrowser.Server.Mono.exe -programdata /var/packages/EmbyServer/target/var -ffmpeg /var/packages/EmbyServer/target/ffmpeg/bin/ffmpeg -ffprobe /var/packages/EmbyServer/target/ffmpeg/bin/ffprobe
	Operating system: Unix 3.2.40.0
	Processor count: 2
	64-Bit OS: False
	64-Bit Process: False
	Program data path: /var/packages/EmbyServer/target/var
	Mono: 4.4.2 (Stable 4.4.2.11/f72fe45 Sat Sep  3 02:34:25 CST 2016)
	Application Path: /volume1/@appstore/EmbyServer/releases/v3.1.132-beta/MediaBrowser.Server.Mono.exe
	ffmpeg image extraction failed for file:"/volume1/WollesNAS/Filme/12 Monkeys (1995)/12 Monkeys.1080p.bluray.dca.mkv"
	System.ApplicationException
	  at MediaBrowser.MediaEncoding.Encoder.MediaEncoder+<ExtractImageInternal>d__37.MoveNext () <0x34a983c0 + 0x00e04> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x33ab6f68 + 0x00024> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x33ab6c58 + 0x000bb> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x33ab6b78 + 0x0008b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x2e6b41f8 + 0x0003f> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x2e448c48 + 0x0001b> in <filename unknown>:0 
	  at MediaBrowser.MediaEncoding.Encoder.MediaEncoder+<ExtractImage>d__30.MoveNext () <0x34a973f0 + 0x00787> in <filename unknown>:0 
	--- End of stack trace from previous location where exception was thrown ---
	  at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x33ab6f68 + 0x00024> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x33ab6c58 + 0x000bb> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x33ab6b78 + 0x0008b> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x2e6b41f8 + 0x0003f> in <filename unknown>:0 
	  at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x2e448c48 + 0x0001b> in <filename unknown>:0 
	  at MediaBrowser.Server.Implementations.MediaEncoder.EncodingManager+<RefreshChapterImages>d__0.MoveNext () <0x34a92ac0 + 0x00d57> in <filename unknown>:0 

for that movie.

Edited by horstepipe
Link to comment
Share on other sites

solabc16

Hello @@horstepipe

 

Can you run the timed test extract from the command line like before, for this specific movie.

 

e.g.

cd /var/packages/EmbyServer/target/ffmpeg/bin

sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/12 Monkeys (1995)/12 Monkeys.1080p.bluray.dca.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/12 Monkeys (1995)/testimg.jpg"

- James

Link to comment
Share on other sites

horstepipe

Hello @@horstepipe

 

Can you run the timed test extract from the command line like before, for this specific movie.

 

e.g.

cd /var/packages/EmbyServer/target/ffmpeg/bin

sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/12 Monkeys (1995)/12 Monkeys.1080p.bluray.dca.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/12 Monkeys (1995)/testimg.jpg"

- James

admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/12 Monkeys (1995)/12 Monkeys.1080p.bluray.dca.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/12 Monkeys (1995)/testimg.jpg"
real 25.77
user 39.98
sys 0.18
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$

admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/10 Cloverfield Lane (2016)/10 Cloverfield Lane.1080p.bluray.dca.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/12 Monkeys (1995)/testimg.jpg"
real 16.25
user 24.98
sys 0.09
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$


admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/2012 (2009)/2012.1080p.bluray.dca.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/12 Monkeys (1995)/testimg.jpg"
real 10.40
user 16.77
sys 0.17
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$

admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/39,90 (2007)/39,90.720p.bluray.dca.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/12 Monkeys (1995)/testimg.jpg"
real 3.50
user 4.69
sys 0.11
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$


(this one is always that fast...)

admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$ sudo time -p ./ffmpeg -ss 00:00:15.000 -i file:"/volume1/WollesNAS/Filme/7 Psychos (2012)/7 Psychos.1080p.bluray.dca.mkv" -threads 0 -v quiet -vframes 1 -vf "scale=600:trunc(600/dar/2)*2,thumbnail=30" -f image2 "/volume1/WollesNAS/Filme/12 Monkeys (1995)/testimg.jpg"
real 7.62
user 10.91
sys 0.08
admin@WollesNAS:/var/packages/EmbyServer/target/ffmpeg/bin$

quite long, I guess...?

It doesn't bother me if it needs a long time to extract the images, the main thing is that it works.

Edited by horstepipe
Link to comment
Share on other sites

solabc16

Hello @@horstepipe

Thanks for the information above. The improvements we made to the FFmpeg build gave us ~15% improvement, which gave us a good step forward.

Of course for those taking >20s, it's not going to bring them below the timeout.

When you have a moment, could you send the media info for the movies you provided the timings for above. I'd like to try and get to the bottom of what is driving the variation, to see if there is anything else we can improve.

Thanks @@Luke, we'll take advantage of that as soon as it's available.

- James

 

Link to comment
Share on other sites

horstepipe

Hello @@horstepipe

 

Thanks for the information above. The improvements we made to the FFmpeg build gave us ~15% improvement, which gave us a good step forward.

 

Of course for those taking >20s, it's not going to bring them below the timeout.

 

When you have a moment, could you send the media info for the movies you provided the timings for above. I'd like to try and get to the bottom of what is driving the variation, to see if there is anything else we can improve.

 

Thanks @@Luke, we'll take advantage of that as soon as it's available.

 

- James

 

 

 

Hey

Those are exactly the movies from post 68, so you find the media info in the attached text file.

 

Regards

Link to comment
Share on other sites

horstepipe

Hey

Good news here:

I set the imageextractiontimeout in system.xml to 300000, removed the chapters-failures.txt file and started extraction.

It took two days but it looks that now all of my movies have chapter images. Only a few movies got back into the chapters-failures.txt, but only the last one or two chapters are missing here. So I think this is because of corrupted MKVs.

 

 

THANK YOU for support!

 

Best regards

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...