Emby in Docker on Unraid server: Items deleted due to inactive disks

[WonkoTheSane 11]

Hi all,

 

I'm facing a problem with Emby which I cannot seem to solve. 

I'm using Emby mainly as a centralized media database for movies

and tv shows for my Kodi clients. This works quite well, except for the

fact that regulary thousands of old media items that were not recently

added or modified get synchronized on the clients.

 

I looked into the server logs and I found a lot of entries like the following:

 

 

2016-08-30 19:15:51.8350 Info App: Deleting item from database Boston Legal because path no longer exists. type: Series path: /media/tv/Boston Legal

 

Unraid powers down disks that are not accessed after some time and it takes them

some seconds to wake up and be accessible again. My suspicion is that in these situations,

Emby determines that files/folders were deleted and consequently removes the related items

from its database.

 

The obvious question now is: Is there a way to fix this?

 

 

Thanks for your time

 

Matthias

Edited August 31, 2016 by WonkoTheSane

[Luke 37058]

Hi, what version of Emby Server are you running?

[WonkoTheSane 11]

Hi,

 

I am currently running Version 3.0.5986.0

[mgworek 121]

I have never seen that with my unraid setup when my disks were asleep. Have you tried the cache plugin that will keep a cache of your files when the disks are asleep.

[WonkoTheSane 11]

I have never seen that with my unraid setup when my disks were asleep. Have you tried the cache plugin that will keep a cache of your files when the disks are asleep.

 

Hi, 

 

thanks for your input. That plugin sounds promising. I'll give it a go and report back. This might

take a day or 2.

[WonkoTheSane 11]

Hi,

 

here's my update regarding this issue. I no longer see any hints of movies or complete

series getting deleted as described in my original post. The cache directories plugin seems

to have helped this. I still see some items (mainly movies) getting resynced on clients due to

server side updates for which I have yet to find an explanation, but this is something I can live

with for now.

 

Thanks for the help and thanks to the Emby team for a great piece of software.

 

 

Regards

 

Matthias

Edited September 4, 2016 by WonkoTheSane

[Luke 37058]

Thanks for the report !

[WonkoTheSane 11]

I had a look again at my server logs to sort out what is going on with the movies that keep getting updated

on my clients. Here is part of a log that looks interesting:

 

 

 

2016-09-03 09:40:21.9910 Info App: Validating media library
2016-09-03 09:41:29.1382 Info HttpClient: HttpClientManager GET: https://www.omdbapi.com/?plot=full&r=json&y=2009&t=Hulk+vs.+Thor&type=movie
2016-09-03 09:41:29.6087 Info HttpClient: HttpClientManager GET: https://www.omdbapi.com/?plot=full&r=json&y=2009&t=Hulk+vs.+Wolverine&type=movie
2016-09-03 09:41:34.6667 Info App: Emby.Kodi.SyncQueue: Starting Library Sync...
2016-09-03 09:41:34.6687 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" User fbd6e2db6e7342cf99906763d259fc98(Matze) posted 0 items to "Items Added":
2016-09-03 09:41:34.6813 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" User fbd6e2db6e7342cf99906763d259fc98(Matze) posted 2 items to "Items Updated": 445baf2daa155e7aa2b33a921d69763d(Hulk vs. Thor),d767ecfc5e95b383c7c108148efaec88(Hulk vs. Wolverine)
2016-09-03 09:41:34.6813 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" User fbd6e2db6e7342cf99906763d259fc98(Matze) posted 0 items to "Items Removed":
2016-09-03 09:41:34.6813 Info App: Emby.Kodi.SyncQueue: Finished Library Sync Taking 00:00:00.0146200
2016-09-03 09:43:05.5288 Info MediaEncoder: Killing ffmpeg process
2016-09-03 09:43:05.5288 Error MediaEncoder: Error sending q command to process
2016-09-03 09:43:05.5288 Error MediaEncoder: Error in WaitForExit
2016-09-03 09:43:05.5482 Error MediaEncoder: Error killing process
    *** Error Report ***
    Version: 3.0.5986.0
    Command line: /usr/lib/emby-server/MediaBrowser.Server.Mono.exe -programdata /config -ffmpeg /usr/bin/ffmpeg -ffprobe /usr/bin/ffprobe
    Operating system: Unix 4.1.17.0
    Processor count: 4
    64-Bit OS: True
    64-Bit Process: True
    Program data path: /config
    Mono: 4.4.0 (Stable 4.4.0.40/f8474c4 Mon Mar 28 12:22:29 UTC 2016)
    Application Path: /usr/lib/emby-server/MediaBrowser.Server.Mono.exe
    Cannot access a disposed object.
    Object name: 'handle'.
    System.ObjectDisposedException
     at System.Runtime.InteropServices.SafeHandle.DangerousAddRef (System.Boolean& success) <0x2b150e68d7c0 + 0x00094> in <filename unknown>:0
     at System.Diagnostics.Process.Close (Int32 signo) <0x41febb40 + 0x00052> in <filename unknown>:0
     at System.Diagnostics.Process.Kill () <0x41febb10 + 0x00013> in <filename unknown>:0
     at (wrapper remoting-invoke-with-check) System.Diagnostics.Process:Kill ()
     at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.StopProcess (MediaBrowser.MediaEncoding.Encoder.ProcessWrapper process, Int32 waitTimeMs, Boolean enableForceKill) <0x41feb700 + 0x0020f> in <filename unknown>:0
    
2016-09-03 09:43:05.5540 Error App: Error in ffprobe
    *** Error Report ***
    Version: 3.0.5986.0
    Command line: /usr/lib/emby-server/MediaBrowser.Server.Mono.exe -programdata /config -ffmpeg /usr/bin/ffmpeg -ffprobe /usr/bin/ffprobe
    Operating system: Unix 4.1.17.0
    Processor count: 4
    64-Bit OS: True
    64-Bit Process: True
    Program data path: /config
    Mono: 4.4.0 (Stable 4.4.0.40/f8474c4 Mon Mar 28 12:22:29 UTC 2016)
    Application Path: /usr/lib/emby-server/MediaBrowser.Server.Mono.exe
    ffprobe failed - streams and format are both null.
    System.ApplicationException
     at MediaBrowser.MediaEncoding.Encoder.MediaEncoder+<GetMediaInfoInternal>c__async2.MoveNext () <0x41db1530 + 0x009fb> in <filename unknown>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x2b150e68be30 + 0x00029> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x2b150e689cf0 + 0x000b3> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x2b150e689c50 + 0x00093> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x2b150e689c00 + 0x0003a> in <filename unknown>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x2b150e68a470 + 0x00017> in <filename unknown>:0
     at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo+<GetMediaInfo>c__async1.MoveNext () <0x41db01f0 + 0x006d9> in <filename unknown>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x2b150e68be30 + 0x00029> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x2b150e689cf0 + 0x000b3> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x2b150e689c50 + 0x00093> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x2b150e689c00 + 0x0003a> in <filename unknown>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x2b150e68a470 + 0x00017> in <filename unknown>:0
     at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo+<ProbeVideo>c__async0`1[T].MoveNext () <0x41daec20 + 0x00a44> in <filename unknown>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x2b150e68be30 + 0x00029> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x2b150e689cf0 + 0x000b3> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x2b150e689c50 + 0x00093> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x2b150e689c00 + 0x0003a> in <filename unknown>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x41adeff0 + 0x0001a> in <filename unknown>:0
     at MediaBrowser.Providers.Manager.MetadataService`2+<RunCustomProvider>c__async7[TItemType,TIdType].MoveNext () <0x41dad970 + 0x0034f> in <filename unknown>:0
    
2016-09-03 09:43:05.5931 Info HttpClient: HttpClientManager GET: https://www.omdbapi.com/?plot=full&r=json&y=2005&t=Unter+den+Strassen+von+Hannover&type=movie
2016-09-03 09:43:11.2595 Info App: Emby.Kodi.SyncQueue: Starting Library Sync...
2016-09-03 09:43:11.2606 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" User fbd6e2db6e7342cf99906763d259fc98(Matze) posted 0 items to "Items Added":
2016-09-03 09:43:11.2696 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" User fbd6e2db6e7342cf99906763d259fc98(Matze) posted 1 items to "Items Updated": 900c20bf90858ad75f4cd5305485efda(Unter den Strassen von Hannover)
2016-09-03 09:43:11.2696 Info App: Emby.Kodi.SyncQueue: "LIBRARYSYNC" User fbd6e2db6e7342cf99906763d259fc98(Matze) posted 0 items to "Items Removed":
2016-09-03 09:43:11.2696 Info App: Emby.Kodi.SyncQueue: Finished Library Sync Taking 00:00:00.0101310
2016-09-03 09:43:46.9372 Info MediaEncoder: Killing ffmpeg process
2016-09-03 09:43:46.9372 Error MediaEncoder: Error sending q command to process
2016-09-03 09:43:46.9372 Error MediaEncoder: Error in WaitForExit
2016-09-03 09:43:46.9372 Error MediaEncoder: Error killing process
    *** Error Report ***
    Version: 3.0.5986.0
    Command line: /usr/lib/emby-server/MediaBrowser.Server.Mono.exe -programdata /config -ffmpeg /usr/bin/ffmpeg -ffprobe /usr/bin/ffprobe
    Operating system: Unix 4.1.17.0
    Processor count: 4
    64-Bit OS: True
    64-Bit Process: True
    Program data path: /config
    Mono: 4.4.0 (Stable 4.4.0.40/f8474c4 Mon Mar 28 12:22:29 UTC 2016)
    Application Path: /usr/lib/emby-server/MediaBrowser.Server.Mono.exe
    Cannot access a disposed object.
    Object name: 'handle'.
    System.ObjectDisposedException
     at System.Runtime.InteropServices.SafeHandle.DangerousAddRef (System.Boolean& success) <0x2b150e68d7c0 + 0x00094> in <filename unknown>:0
     at System.Diagnostics.Process.Close (Int32 signo) <0x41febb40 + 0x00052> in <filename unknown>:0
     at System.Diagnostics.Process.Kill () <0x41febb10 + 0x00013> in <filename unknown>:0
     at (wrapper remoting-invoke-with-check) System.Diagnostics.Process:Kill ()
     at MediaBrowser.MediaEncoding.Encoder.MediaEncoder.StopProcess (MediaBrowser.MediaEncoding.Encoder.ProcessWrapper process, Int32 waitTimeMs, Boolean enableForceKill) <0x41feb700 + 0x0020f> in <filename unknown>:0
    
2016-09-03 09:43:46.9380 Error App: Error in ffprobe
    *** Error Report ***
    Version: 3.0.5986.0
    Command line: /usr/lib/emby-server/MediaBrowser.Server.Mono.exe -programdata /config -ffmpeg /usr/bin/ffmpeg -ffprobe /usr/bin/ffprobe
    Operating system: Unix 4.1.17.0
    Processor count: 4
    64-Bit OS: True
    64-Bit Process: True
    Program data path: /config
    Mono: 4.4.0 (Stable 4.4.0.40/f8474c4 Mon Mar 28 12:22:29 UTC 2016)
    Application Path: /usr/lib/emby-server/MediaBrowser.Server.Mono.exe
    ffprobe failed - streams and format are both null.
    System.ApplicationException
     at MediaBrowser.MediaEncoding.Encoder.MediaEncoder+<GetMediaInfoInternal>c__async2.MoveNext () <0x41db1530 + 0x009fb> in <filename unknown>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x2b150e68be30 + 0x00029> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x2b150e689cf0 + 0x000b3> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x2b150e689c50 + 0x00093> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x2b150e689c00 + 0x0003a> in <filename unknown>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x2b150e68a470 + 0x00017> in <filename unknown>:0
     at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo+<GetMediaInfo>c__async1.MoveNext () <0x41db01f0 + 0x006d9> in <filename unknown>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x2b150e68be30 + 0x00029> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x2b150e689cf0 + 0x000b3> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x2b150e689c50 + 0x00093> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x2b150e689c00 + 0x0003a> in <filename unknown>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x2b150e68a470 + 0x00017> in <filename unknown>:0
     at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo+<ProbeVideo>c__async0`1[T].MoveNext () <0x41daec20 + 0x00a44> in <filename unknown>:0
    --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw () <0x2b150e68be30 + 0x00029> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess (System.Threading.Tasks.Task task) <0x2b150e689cf0 + 0x000b3> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification (System.Threading.Tasks.Task task) <0x2b150e689c50 + 0x00093> in <filename unknown>:0
     at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd (System.Threading.Tasks.Task task) <0x2b150e689c00 + 0x0003a> in <filename unknown>:0
     at System.Runtime.CompilerServices.ConfiguredTaskAwaitable`1+ConfiguredTaskAwaiter[TResult].GetResult () <0x41adeff0 + 0x0001a> in <filename unknown>:0
     at MediaBrowser.Providers.Manager.MetadataService`2+<RunCustomProvider>c__async7[TItemType,TIdType].MoveNext () <0x41dad970 + 0x0034f> in <filename unknown>:0 

[Luke 37058]

hi, i would try removing installed plugins and seeing if the issue persists with just the core server. thanks.