fdetect high ram usage ubuntu 18

[runtimesandbox 152]

Having to rebuild my server due to a hardware failure - I am running the latest stable on Ubuntu 18.04

 

I have noticed that the ffdetect process has been running for 188h and has a ram usage of over 5.8gb. Is this supposed to be the case?

[softworkz 3329]

Of course it isn't. The question is whether this was caused by your hw failure or something else.

 

Please check whether it keeps happening after you have fixed your hardware problem.

[runtimesandbox 152]

Hardware problem is fixed, this is a brand new VM on a different hypervisor.

 

It appears to be running as it should - media items are being updated and thumbs extracted, just ever growing ram usage

 

I can see a few musicbrainz errors in the logs and some other crashes of ffdetect

2019-10-07 12:58:30.366 Error App: Error in MusicBrainz
    *** Error Report ***
    Version: 4.2.1.0
    Command line: /opt/emby-server/system/EmbyServer.dll -programdata /var/lib/emby -ffdetect /opt/emby-server/bin/ffdetect -ffmpeg /opt/emby-server/bin/ffmpeg -ffprobe /opt/emby-server/bin/ffprobe -restartexitcode 3 -updatepackage emby-server-deb_{version}_amd64.deb
    Operating system: Unix 5.3.0.50300
    64-Bit OS: True
    64-Bit Process: True
    User Interactive: True
    Runtime: file:///opt/emby-server/system/System.Private.CoreLib.dll
    Processor count: 8
    Program data path: /var/lib/emby
    Application directory: /opt/emby-server/system
    MediaBrowser.Model.Net.HttpException: MediaBrowser.Model.Net.HttpException: Cancelling connection to http://musicbrainz01.eastus2.cloudapp.azure.com:8080/ws/2/release/?query="The+Smiths" AND artist:"The+Smiths" due to a previous timeout.
     at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsyncInternal(HttpRequestOptions options, String httpMethod)
     at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsync(HttpRequestOptions options, String httpMethod)
     at MusicBrainz.MusicBrainzAlbumProvider.GetMusicBrainzResponse(String url, Boolean isSearch, Boolean forceMusicBrainzProper, CancellationToken cancellationToken)
     at MusicBrainz.MusicBrainzAlbumProvider.GetSearchResults(AlbumInfo searchInfo, CancellationToken cancellationToken)
     at MusicBrainz.MusicBrainzAlbumProvider.GetMetadata(AlbumInfo id, CancellationToken cancellationToken)
     at MediaBrowser.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, String logName, TIdType id, IEnumerable`1 providers, CancellationToken cancellationToken)
    Source: Emby.Server.Implementations
    TargetSite: Void MoveNext()
    
2019-10-07 12:58:30.629 Error App: Error in MusicBrainz
    *** Error Report ***
    Version: 4.2.1.0
    Command line: /opt/emby-server/system/EmbyServer.dll -programdata /var/lib/emby -ffdetect /opt/emby-server/bin/ffdetect -ffmpeg /opt/emby-server/bin/ffmpeg -ffprobe /opt/emby-server/bin/ffprobe -restartexitcode 3 -updatepackage emby-server-deb_{version}_amd64.deb
    Operating system: Unix 5.3.0.50300
    64-Bit OS: True
    64-Bit Process: True
    User Interactive: True
    Runtime: file:///opt/emby-server/system/System.Private.CoreLib.dll
    Processor count: 8
    Program data path: /var/lib/emby
    Application directory: /opt/emby-server/system
    MediaBrowser.Model.Net.HttpException: MediaBrowser.Model.Net.HttpException: Cancelling connection to http://musicbrainz01.eastus2.cloudapp.azure.com:8080/ws/2/artist/?query="The+Smiths"&dismax=true due to a previous timeout.
     at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsyncInternal(HttpRequestOptions options, String httpMethod)
     at Emby.Server.Implementations.HttpClientManager.CoreHttpClientManager.SendAsync(HttpRequestOptions options, String httpMethod)
     at MusicBrainz.MusicBrainzAlbumProvider.GetMusicBrainzResponse(String url, Boolean isSearch, Boolean forceMusicBrainzProper, CancellationToken cancellationToken)
     at MusicBrainz.MusicBrainzArtistProvider.GetSearchResults(ArtistInfo searchInfo, CancellationToken cancellationToken)
     at MusicBrainz.MusicBrainzArtistProvider.GetMetadata(ArtistInfo id, CancellationToken cancellationToken)
     at MediaBrowser.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, String logName, TIdType id, IEnumerable`1 providers, CancellationToken cancellationToken)
    Source: Emby.Server.Implementations
    TargetSite: Void MoveNext()
    
2019-10-07 12:58:30.645 Info MediaEncoder: ProcessRun 'ffprobe' Execute: /opt/emby-server/bin/ffprobe -i file:"/mnt/media/Music/The xx/Coexist/10 Swept Away.m4a" -threads 0 -v info -print_format json -show_streams -show_format
2019-10-07 12:58:30.735 Info MediaEncoder: ProcessRun 'ffprobe' Started.

2019-10-07 21:21:41.225 Error HttpServer: Error processing request
    *** Error Report ***
    Version: 4.2.1.0
    Command line: /opt/emby-server/system/EmbyServer.dll -programdata /var/lib/emby -ffdetect /opt/emby-server/bin/ffdetect -ffmpeg /opt/emby-server/bin/ffmpeg -ffprobe /opt/emby-server/bin/ffprobe -restartexitcode 3 -updatepackage emby-server-deb_{version}_amd64.deb
    Operating system: Unix 5.3.0.50300
    64-Bit OS: True
    64-Bit Process: True
    User Interactive: True
    Runtime: file:///opt/emby-server/system/System.Private.CoreLib.dll
    Processor count: 8
    Program data path: /var/lib/emby
    Application directory: /opt/emby-server/system
    System.NullReferenceException: System.NullReferenceException: Object reference not set to an instance of an object.
     at Emby.Server.Implementations.IO.SharpCifsFileSystem.IsEnabledForPath(String path)
     at Emby.Server.Implementations.IO.ManagedFileSystem.GetFileStream(String path, FileOpenMode mode, FileAccessMode access, FileShareMode share, Boolean isAsync)
     at MediaBrowser.Providers.Manager.ProviderManager.SaveImage(BaseItem item, String source, ReadOnlyMemory`1 mimeType, ImageType type, Nullable`1 imageIndex, Nullable`1 saveLocallyWithMedia, CancellationToken cancellationToken)
     at Emby.Server.Implementations.Library.LibraryManager.GetLazyImage(String key, BaseItem item, ImageType type, Int32 imageIndex, CancellationToken cancellationToken)
     at Emby.Server.Implementations.Library.LibraryManager.ConvertImageToLocal(BaseItem item, ItemImageInfo image, Int32 imageIndex, CancellationToken cancellationToken)
     at Emby.Drawing.ImageProcessor.ProcessImage(ImageProcessingOptions options, CancellationToken cancellationToken)
     at MediaBrowser.Api.Images.ImageService.GetImage(ImageRequest request, Int64 itemId, BaseItem item, Boolean isHeadRequest)
     at Emby.Server.Implementations.Services.ServiceController.GetTaskResult(Task task)
     at Emby.Server.Implementations.Services.ServiceHandler.ProcessRequestAsync(HttpListenerHost appHost, IRequest httpReq, IResponse httpRes, RestPath restPath, String responseContentType, CancellationToken cancellationToken)
     at Emby.Server.Implementations.HttpServer.HttpListenerHost.RequestHandler(IRequest httpReq, ReadOnlyMemory`1 urlString, ReadOnlyMemory`1 host, ReadOnlyMemory`1 localPath, CancellationToken cancellationToken)
    Source: Emby.Server.Implementations
    TargetSite: Boolean IsEnabledForPath(System.String)

Edited October 7, 2019 by spudd

[Luke 37046]

I would re-evaluate after your initial setup and library scans have completed. thanks.