Tons of ffprobe errors all of a sudden...

[doonze 30]

I really don't know exactly how long it's been going on. But I noticed tonight. I've seen something like 20-30 of these in just the logs I've looked through:

2017-12-25 05:39:18.515 Error App: Error in ffprobe
    *** Error Report ***
    Version: 3.2.60.0
    Command line: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /var/lib/emby-server -restartpath /usr/lib/emby-server/restart.sh
    Operating system: Unix 4.9.0.4
    64-Bit OS: True
    64-Bit Process: True
    User Interactive: False
    Mono: 4.8.1 (Stable 4.8.1.0/22a39d7 Tue May 2 22:25:43 UTC 2017)
    Processor count: 2
    Program data path: /var/lib/emby-server
    Application directory: /usr/lib/emby-server/bin
    System.Exception: ffprobe failed - streams and format are both null.
     at Emby.Server.MediaEncoding.Encoder.MediaEncoder+<GetMediaInfoInternal>d__61.MoveNext () [0x00141] in <9660b9518eb6424a914dff2c53832dbf>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo+<ProbeVideo>c__async0`1[T].MoveNext () [0x001ad] in <7095f8574e0845a79c33ffbee512a43c>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at MediaBrowser.Providers.Manager.MetadataService`2+<RunCustomProvider>c__async5[TItemType,TIdType].MoveNext () [0x000db] in <7095f8574e0845a79c33ffbee512a43c>:0
    System.Exception
     at Emby.Server.MediaEncoding.Encoder.MediaEncoder+<GetMediaInfoInternal>d__61.MoveNext () [0x00141] in <9660b9518eb6424a914dff2c53832dbf>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo+<ProbeVideo>c__async0`1[T].MoveNext () [0x001ad] in <7095f8574e0845a79c33ffbee512a43c>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at MediaBrowser.Providers.Manager.MetadataService`2+<RunCustomProvider>c__async5[TItemType,TIdType].MoveNext () [0x000db] in <7095f8574e0845a79c33ffbee512a43c>:0
    
2017-12-25 05:39:24.966 Error App: Error in ffprobe
    *** Error Report ***
    Version: 3.2.60.0
    Command line: /usr/lib/emby-server/bin/MediaBrowser.Server.Mono.exe -programdata /var/lib/emby-server -restartpath /usr/lib/emby-server/restart.sh
    Operating system: Unix 4.9.0.4
    64-Bit OS: True
    64-Bit Process: True
    User Interactive: False
    Mono: 4.8.1 (Stable 4.8.1.0/22a39d7 Tue May 2 22:25:43 UTC 2017)
    Processor count: 2
    Program data path: /var/lib/emby-server
    Application directory: /usr/lib/emby-server/bin
    System.Exception: ffprobe failed - streams and format are both null.
     at Emby.Server.MediaEncoding.Encoder.MediaEncoder+<GetMediaInfoInternal>d__61.MoveNext () [0x00141] in <9660b9518eb6424a914dff2c53832dbf>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo+<ProbeVideo>c__async0`1[T].MoveNext () [0x001ad] in <7095f8574e0845a79c33ffbee512a43c>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at MediaBrowser.Providers.Manager.MetadataService`2+<RunCustomProvider>c__async5[TItemType,TIdType].MoveNext () [0x000db] in <7095f8574e0845a79c33ffbee512a43c>:0
    System.Exception
     at Emby.Server.MediaEncoding.Encoder.MediaEncoder+<GetMediaInfoInternal>d__61.MoveNext () [0x00141] in <9660b9518eb6424a914dff2c53832dbf>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo+<ProbeVideo>c__async0`1[T].MoveNext () [0x001ad] in <7095f8574e0845a79c33ffbee512a43c>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () [0x0000c] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) [0x0004e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) [0x0002e] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) [0x0000b] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () [0x00000] in <dbb16e0bacdc4a0f87478e401bc29b6c>:0
     at MediaBrowser.Providers.Manager.MetadataService`2+<RunCustomProvider>c__async5[TItemType,TIdType].MoveNext () [0x000db] in <7095f8574e0845a79c33ffbee512a43c>:0

All of them are the same: streams and format are both null.

 

It seems to be causing lots of CPU, and I started looking because something is messing with my apache server. I don't know if it's something EMBY is doing, or something else, but till I can get the CPU down and logs clean it's moot. I'll work on apache and figure that out after I get Emby behaving. 

 

Any ideas? 

 

EDIT: I've got about 20-30 new media files tonight. It looks like it's just constantly trying to go through them and refresh them, again and again. Using a constant 25-50% CPU.

Edited December 25, 2017 by doonze

[Luke 37100]

Hi there, occasionally this will happen with some files. It's nothing to worry about. The server will recover from it and continue scanning. Thanks !

[doonze 30]

Merry Christmas Luke!! As normal, you were right. I checked back about 6 hours later and it had stopped. I'm not sure why it was causing such havoc with my apache though, but now that it's stopped getting those errors everything is right with the world. 

 

Normally high CPU isn't enough to trash my web server that bad, was kinda weird. As a take away, can it be less aggressive? Like maybe instead of retrying again and again, it will wait like 6 hours, try it once again, then wait another 6? Maybe give up after a day?? If I had been running a more serious production server I'd have had to turn Emby off to save my web server. As it was, my server was unresponsive about 50% of the time while it was getting those errors. I think overall usage was about 50% for hours and hours, but I'm thinking when it was running on the same core as apache was when I was getting hosed. It had that core at 100%. While htop told me overall was 50%, it was often showing the Emby threads at 100%. (This server is duel core)

Edited December 26, 2017 by doonze