Jump to content

Have a few issues after migrating local Emby to Docker

Ladiesman0217

By Ladiesman0217
in General/Windows

 Share
Go to solution Solved by guunter,

Recommended Posts

Ladiesman0217

Ladiesman0217 14

Posted
Posted (edited)

I successfully migrated Emby to run in a container in Docker, but I have the following 2 issues.

  1. Real Time Monitoring is no longer working for my Media Libraries.  Manually running "Scan Library Files" finds the new media, but it's not automatic anymore.  Looking for advice on how to fix that.
     
  2. I'm seeing a lot of File Not Found exceptions in the logs when looking for images.  Here's an example:
      
    2025-05-04 19:33:34.839 Error Server: Error processing request
*** Error Report ***
Version: 4.8.11.0
Command line: /system/EmbyServer.dll -programdata /config -ffdetect /bin/ffdetect -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartexitcode 3
Operating system: Linux version 5.15.167.4-microsoft-standard-WSL2 (root@f9c826d3017f) (gcc (GCC) 11.2.0, GNU ld (GNU Binutils) 2.37) #1 SMP Tue Nov 5 00:21:55 UTC 2024
Framework: .NET 6.0.36
OS/Process: x64/x64
Runtime: system/System.Private.CoreLib.dll
Processor count: 20
Data path: /config
Application path: /system
System.IO.FileNotFoundException: System.IO.FileNotFoundException: Could not find file '/config/metadata\library\a0\a0e43950055a152095da8d7945a2a37b\auto_poster_83655_83342_83311_83313.jpg'.
File name: '/config/metadata\library\a0\a0e43950055a152095da8d7945a2a37b\auto_poster_83655_83342_83311_83313.jpg'
at Emby.Drawing.Skia.SkiaEncoder.GetTempFile(String path)
at Emby.Drawing.Skia.SkiaEncoder.GetSKFileStream(String path)
at Emby.Drawing.Skia.SkiaEncoder.EncodeImage(String inputPath, String outputPath, Boolean autoOrient, Nullable`1 orientation, Int32 quality, ImageProcessingOptions options, ImageFormat selectedOutputFormat)
at Emby.Drawing.ImageProcessor.ProcessImage(ImageProcessingOptions options, CancellationToken cancellationToken)
at Emby.Api.Images.ImageService.GetImage(ImageRequest request, Int64 itemId, BaseItem item, Boolean isHeadRequest)
at Emby.Server.Implementations.Services.ServiceController.GetTaskResult(Task task)
at Emby.Server.Implementations.Services.ServiceHandler.ProcessRequestAsync(HttpListenerHost httpHost, IServerApplicationHost appHost, IRequest httpReq, IResponse httpRes, IStreamHelper streamHelper, RestPath restPath, String responseContentType, CancellationToken cancellationToken)
at Emby.Server.Implementations.HttpServer.HttpListenerHost.RequestHandler(IRequest httpReq, ReadOnlyMemory`1 urlString, ReadOnlyMemory`1 localPath, CancellationToken cancellationToken)
Source: Emby.Drawing.Skia
TargetSite: System.String GetTempFile(System.String)
Path: /config/metadata\library\a0\a0e43950055a152095da8d7945a2a37b\auto_poster_83655_83342_83311_83313.jpg

    Does it matter that the file path is showing both forward / and back \ slashes in the path?  I've confirmed that I can see the image file in the path it's looking for (if you ignore the incorrect slashes).

Edited by Ladiesman0217
Luke Emby Team

Luke 42077

Posted
Posted

Hi, did you migrate from Windows?

Luke Emby Team

Luke 42077

Posted
Posted
Quote
  • Real Time Monitoring is no longer working for my Media Libraries.  Manually running "Scan Library Files" finds the new media, but it's not automatic anymore.  Looking for advice on how to fix that.

Is the media on the same machine as the server? What folder path did you setup the library with?

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted (edited)

Hi Luke,

Yes I migrated from a local install on Windows to Docker on the same Windows machine.

Yes the media is on the same machine, just a different drive.  I have the following volumes in my docker-compose.yml

      - E:/TV/Movies:/media/Movies
      - F:/TV:/media/TV

And as an example for one of my Media Libraries, I have one called Movies that used to use Folder path E:\TV\Movies but now is using /media/Movies.

Edited by Ladiesman0217
  • 2 weeks later...
Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted

I've been monitoring this for a week and it's still not detecting media changes in my libraries.

Is there a way to make the Scheduled Task "Scan Media Library" run more often so I'm not manually scanning the libraries each time I add something?

Luke Emby Team

Luke 42077

Posted
Posted
10 minutes ago, Ladiesman0217 said:

I've been monitoring this for a week and it's still not detecting media changes in my libraries.

Is there a way to make the Scheduled Task "Scan Media Library" run more often so I'm not manually scanning the libraries each time I add something?

@Ladiesman0217

HI there, can you please provide a specific example?

How to Report a Problem

Thanks !

 

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted

To test it and show it in the logs, I deleted an episode and waited for Emby to detect that the file was gone.  It did not. It still showed as available, so I clicked on it to play it and got an error that the file was missing: 

2025-05-13 19:01:54.205 Info PlaybackReporting - EventMonitorEntryPoint: Saving final duration for Item : 404c067c-fee0-4a37-963f-90764f4359d7|7a1cd9b5d60641b5b6586deb26cb449e|251368|DirectStream
2025-05-13 19:01:54.247 Info App: ProcessRun 'StreamTranscode 5ab7d8' Execute: /bin/ffmpeg -loglevel +timing -y -print_graphs_file "/config/logs/ffmpeg-remux-5ab7d8b8-529c-4920-9dad-70501f31453c_1graph.txt" -copyts -start_at_zero -f matroska,webm -noaccurate_seek -c:v:0 hevc -noautorotate -i "/media/TV/TV Shared/1923/Season 2/1923 - S02E01 - The Killing Season HDTV-720p.mkv" -map 0:0 -map 0:1 -sn -c:v:0 copy -bsf:v:0 hevc_mp4toannexb -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list "/config/transcoding-temp/7403CB/7403CB.m3u8" -segment_list_type m3u8 -segment_time 00:00:06.000 -segment_start_number 0 -break_non_keyframes 1 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 "/config/transcoding-temp/7403CB/7403CB_%d.ts"
2025-05-13 19:01:54.296 Info App: AppendExtraLogData - Read graph file: /config/logs/ffmpeg-remux-5ab7d8b8-529c-4920-9dad-70501f31453c_1graph.txt
2025-05-13 19:01:54.303 Info App: AppendExtraLogData - Deserialized GraphData fileStream: 27.000 bytes Graph Count: 0
2025-05-13 19:01:54.304 Info App: AppendExtraLogData - File Deleted
2025-05-13 19:01:54.335 Info App: ProcessRun 'StreamTranscode 5ab7d8' Process exited with code 1 - Failed
2025-05-13 19:01:54.337 Error Server: Error processing request
	*** Error Report ***
	Version: 4.8.11.0
	Command line: /system/EmbyServer.dll -programdata /config -ffdetect /bin/ffdetect -ffmpeg /bin/ffmpeg -ffprobe /bin/ffprobe -restartexitcode 3
	Operating system: Linux version 5.15.167.4-microsoft-standard-WSL2 (root@f9c826d3017f) (gcc (GCC) 11.2.0, GNU ld (GNU Binutils) 2.37) #1 SMP Tue Nov 5 00:21:55 UTC 2024
	Framework: .NET 6.0.36
	OS/Process: x64/x64
	Runtime: system/System.Private.CoreLib.dll
	Processor count: 20
	Data path: /config
	Application path: /system
	Emby.Server.MediaEncoding.Unified.Ffmpeg.FfRunException: Emby.Server.MediaEncoding.Unified.Ffmpeg.FfRunException: Error starting ffmpeg
	-loglevel +timing -y -print_graphs_file "/config/logs/ffmpeg-remux-5ab7d8b8-529c-4920-9dad-70501f31453c_1graph.txt" -copyts -start_at_zero -f matroska,webm -noaccurate_seek -c:v:0 hevc -noautorotate -i "/media/TV/TV Shared/1923/Season 2/1923 - S02E01 - The Killing Season HDTV-720p.mkv" -map 0:0 -map 0:1 -sn -c:v:0 copy -bsf:v:0 hevc_mp4toannexb -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list "/config/transcoding-temp/7403CB/7403CB.m3u8" -segment_list_type m3u8 -segment_time 00:00:06.000 -segment_start_number 0 -break_non_keyframes 1 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 "/config/transcoding-temp/7403CB/7403CB_%d.ts"
	
	19:01:54.276 ffmpeg version 5.1-emby_2023_06_25 Copyright (c) 2000-2022 the FFmpeg developers and softworkz for Emby LLC
	19:01:54.277   built with gcc 10.3.0 (crosstool-NG 1.25.0)
	19:01:54.279 Execution Date: 2025-05-13 19:01:54
	19:01:54.291 /media/TV/TV Shared/1923/Season 2/1923 - S02E01 - The Killing Season HDTV-720p.mkv: No such file or directory
	19:01:54.292 EXIT
	
	
	
	
	   at Emby.Server.MediaEncoding.Api.BaseStreamingService.StartFfMpeg(StreamState state, String outputPath, CancellationToken cancellationToken, Boolean acquireResources)
	   at Emby.Server.MediaEncoding.Api.Hls.DynamicHlsService.GetDynamicSegment(StreamRequest request, String manifestAbsoluteUri, String playlistId, String segmentId, Int32 subtitleStreamIndex, AuthorizationInfo authorizationInfo)
	   at Emby.Server.Implementations.Services.ServiceController.GetTaskResult(Task task)
	   at Emby.Server.Implementations.Services.ServiceHandler.ProcessRequestAsync(HttpListenerHost httpHost, IServerApplicationHost appHost, IRequest httpReq, IResponse httpRes, IStreamHelper streamHelper, RestPath restPath, String responseContentType, CancellationToken cancellationToken)
	   at Emby.Server.Implementations.HttpServer.HttpListenerHost.RequestHandler(IRequest httpReq, ReadOnlyMemory`1 urlString, ReadOnlyMemory`1 localPath, CancellationToken cancellationToken)
	Source: Emby.Server.MediaEncoding
	TargetSite: Void MoveNext()
	
2025-05-13 19:01:54.337 Info Server: http/1.1 Response 500 to host1. Time: 239ms. GET http://host2/emby/videos/251368/hls1/main/0.ts?PlaySessionId=64101fa61f624c59a7dae14ea50c51d4

I then deleted the episode from Emby, which was successful. 

2025-05-13 19:09:09.179 Info Server: http/1.1 POST http://host2/emby/Items/Delete?Ids=251368&X-Emby-Client=Emby Web&X-Emby-Device-Name=Microsoft Edge Windows&X-Emby-Device-Id=404c067c-fee0-4a37-963f-90764f4359d7&X-Emby-Client-Version=4.8.11.0&X-Emby-Token=x_secret3_x&X-Emby-Language=en-us. Source Ip: host1, UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36 Edg/136.0.0.0
2025-05-13 19:09:09.183 Info App: Removing item from database, Type: Episode, Name: The Killing Season, Path: /media/TV/TV Shared/1923/Season 2/1923 - S02E01 - The Killing Season HDTV-720p.mkv, Id: 251368
2025-05-13 19:09:09.415 Info App: Deleting file /media/TV/TV Shared/1923/Season 2/1923 - S02E01 - The Killing Season HDTV-720p.mkv


I then added the file back and waited for Emby to detect the new file.  It did not.  I then manually requested a refresh of the Show's files and you can see in the logs it successfully detected it and added it to Emby.

  

025-05-13 19:10:46.647 Info App: Refresh metadata requested on 251359
2025-05-13 19:10:46.648 Info Server: http/1.1 Response 204 to host1. Time: 4ms. POST http://host2/emby/Items/251359/Refresh?Recursive=true&ImageRefreshMode=Default&MetadataRefreshMode=Default&ReplaceAllImages=false&ReplaceAllMetadata=false&X-Emby-Client=Emby Web&X-Emby-Device-Name=Microsoft Edge Windows&X-Emby-Device-Id=404c067c-fee0-4a37-963f-90764f4359d7&X-Emby-Client-Version=4.8.11.0&X-Emby-Token=x_secret3_x&X-Emby-Language=en-us
2025-05-13 19:10:46.875 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: /bin/ffprobe -i file:"/media/TV/TV Shared/1923/Season 2/1923 - S02E01 - The Killing Season HDTV-720p.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2025-05-13 19:10:46.936 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 0 - Succeeded

 

Full log attached as well.

embyserver.txt

Luke Emby Team

Luke 42077

Posted
Posted

When you waited, how long did you wait? And then what exactly did you do?

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted

For the test above I deleted the file and then waited about 10 minutes. After that I completed all the steps detailed above.

Luke Emby Team

Luke 42077

Posted
Posted

The server uses INotify. I'm guessing it either doesn't support your volumes or the container needs to be configured appropriately so that it will get notified of file system changes. Then in turn, it will notify Emby Server.

You could experiment by adding INotify into the container and seeing what file system changes it reports on.

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted

I'm happy to do the research. Do you have info on how I do this or point me to some documentation? Thanks!

Luke Emby Team

Luke 42077

Posted
Posted

Hi, are these nfs volumes?

 

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted
On 5/24/2025 at 1:10 PM, Luke said:

Hi, are these nfs volumes?

 

      - E:/TV/Movies:/media/Movies - this one is a directly connected drive
      - F:/TV:/media/TV - this one is a Windows 11 Storage Space.

I don't have NFS tools installed on this machine.

guunter

guunter 49

Posted
Posted

If you migrated from local to docker I believe you still need to keep folder naming the same. You can make the volume mount 

- F:/TV:/TV

You don’t need to put the media in front. 

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted
19 hours ago, guunter said:

If you migrated from local to docker I believe you still need to keep folder naming the same. You can make the volume mount 

- F:/TV:/TV

You don’t need to put the media in front. 

For what purpose? I updated all my libraries with the new paths already and Emby can still see all my media.  Are you saying that path has something to do with iNotify not working?

guunter

guunter 49

Posted
Posted
5 hours ago, Ladiesman0217 said:

For what purpose? I updated all my libraries with the new paths already and Emby can still see all my media.  Are you saying that path has something to do with iNotify not working?

It was in terms of the migration. If you didn’t want to have Emby redo all your libraries in docker you make the paths the same. 

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted
11 hours ago, guunter said:

It was in terms of the migration. If you didn’t want to have Emby redo all your libraries in docker you make the paths the same. 

Either way I had to redo the paths in the libraries. They went from a drive letter to a mapped path in the container.

Luke Emby Team

Luke 42077

Posted
Posted

In terms of the original question, I personally have never installed INotify in a docker container but I've seen users here to do it in order to answer this very question.

Basically if INotify is detecting the change, then Emby Server should be able to as well. So in this case it would be a problem with the server.

If INotify does not detect the change, then neither will Emby Server. This is the most likely outcome because the way you've got your storage mounted now it's adding additional layers compared to before, and one of those layers is probably not supporting something that is required in order for realtime notifications to work.

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted
8 minutes ago, Luke said:

In terms of the original question, I personally have never installed INotify in a docker container but I've seen users here to do it in order to answer this very question.

Basically if INotify is detecting the change, then Emby Server should be able to as well. So in this case it would be a problem with the server.

If INotify does not detect the change, then neither will Emby Server. This is the most likely outcome because the way you've got your storage mounted now it's adding additional layers compared to before, and one of those layers is probably not supporting something that is required in order for realtime notifications to work.

Understood.  I'll see what I can find out.

Is there some documentation on the proper way to set up my volumes so that Emby running in a container CAN detect the file changes?  Surely I'm not the only one running Emby in a container :)

Luke Emby Team

Luke 42077

Posted
Posted
Just now, Ladiesman0217 said:

Understood.  I'll see what I can find out.

Is there some documentation on the proper way to set up my volumes so that Emby running in a container CAN detect the file changes?  Surely I'm not the only one running Emby in a container :)

Normally on Linux I would not expect it to work with a network path anyway, so just getting that out there in the open.

I was just questioning whether this falls under that bucket or not because technically it is a network path but the server sees it as a local path.

kaj

kaj 316

Posted
Posted (edited)

When I recently moved from Synology to a N100 windows box, I initially installed Desktop Docker to run the arrs etc. Desktop Docker just turned out to be horrible, resource hog and generally most people seem to recommend not running it. I moved to native window apps for everything, including Emby and the arrs and everything runs smoothly and was simple to set up.

Edited by kaj
Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted
17 minutes ago, kaj said:

When I recently moved from Synology to a N100 windows box, I initially installed Desktop Docker to run the arrs etc. Desktop Docker just turned out to be horrible, resource hog and generally most people seem to recommend not running it. I moved to native window apps for everything, including Emby and the arrs and everything runs smoothly and was simple to set up.

Ha, that's literally what i JUST moved away from.  I want everything in containers for portability and restorability.

kaj

kaj 316

Posted
Posted
10 minutes ago, Ladiesman0217 said:

Ha, that's literally what i JUST moved away from.  I want everything in containers for portability and restorability.

He he. I found that running everything on my NAS was very noisy, particularly the arrs, there was always disk activity. When I moved to the N100 box I initially ran LINUX on it, but my old brain just couldn't get the arrs talking properly to my NAS with docker...so then i moved back to running Windows, loaded up desktop docker but just didn't like it and again getting to it communicate properly with my NAS. Moved to the windows apps and everything just worked...and my NAs is much quieter...

guunter

guunter 49

Posted
Posted
7 hours ago, Ladiesman0217 said:

Understood.  I'll see what I can find out.

Is there some documentation on the proper way to set up my volumes so that Emby running in a container CAN detect the file changes?  Surely I'm not the only one running Emby in a container :)

If you setup the arr stack you can connect it to Emby and it’ll notify Emby to scan for changes. My Emby docker also won’t detect changes reliably if I didn’t use that feature.

 

if you decide to love to docker on Linux I highly recommend to install portainer to help you manage docker. If you want an App Store like synology you can install casaos in Linux also. Its more beginner friendly 

Ladiesman0217

Ladiesman0217 14

Posted
  • Author
Posted
28 minutes ago, guunter said:

If you setup the arr stack you can connect it to Emby and it’ll notify Emby to scan for changes. My Emby docker also won’t detect changes reliably if I didn’t use that feature.

 

Where in the settings for radar and sonar is that?

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...