Manjaro - automatic scanning not scanning automatically

[th3rhin0 0]

Hi,

When I add media to Emby it doesn't always automatically update the libraries.  I can manually scan the libraries and new media will be added properly, but it doesn't always seem to do it automatically - sometimes it will eventually work and sometimes never.   My media is stored across 4x 8TB drives (SATA, internal) formatted for ext4.

I have mergerfs setup for the media drives, but emby is pointed to the drives individually (I wondered if there was a hangup using mergerfs instead of directly scanning the drives) and I have been adding new media to the drives directly, not through mergerfs.

fstab looks like this:

UUID=2137d70f-3027-4fc2-a7d4-08afd99d7c1f /              ext4    defaults,noatime 0 1
tmpfs                                     /tmp           tmpfs   defaults,noatime,mode=1777 0 0

UUID=cde46ccb-bd05-4351-8fe7-acecaa465851   /home/craigjesslogan/.drivemounts/disk1  ext4 defaults 0 1
UUID=880d344e-1179-4ecd-9d2b-24b24abbf8ef   /home/craigjesslogan/.drivemounts/disk2  ext4 defaults 0 1
UUID=ff5cce60-de39-4d4e-aceb-0ec8c2102ce6   /home/craigjesslogan/.drivemounts/disk3  ext4 defaults 0 1
UUID=80ab5b14-d8aa-4246-af4d-d7dd0d51cf0d   /home/craigjesslogan/.drivemounts/disk4  ext4 defaults 0 1

/home/craigjesslogan/.drivemounts/disk* /home/craigjesslogan/Media fuse.mergerfs defaults,allow_other,cache.files=partial,use_ino,moveonenospc=true,minfreespace=10G,func.getattr=newest,fsname=mergerfsPool 0 0

 

Emby is part of the media group - there are no playback issues, and manual scans get everything every time.

Here is the output of ls -l on all 4 drives showing that emby has read+write as part of the media group

 

[craigjesslogan@craigjesslogan-x58aud3r ~]$ ls -l /home/craigjesslogan/.drivemounts/disk1
total 36
drwxrwsrwx+  4 craigjesslogan media  4096 Aug 26 21:06 Backup
drwxrwsrwx+  2 craigjesslogan media 16384 Aug 19 13:32 lost+found
drwxrwsrwx+  2 craigjesslogan media  4096 Aug 29 14:39 MegaSync
drwxrwsrwx+ 39 craigjesslogan media  4096 Aug 28 07:34 Movies
drwxrwsr-x+  2 craigjesslogan media  4096 Aug 29 03:50 The.Sims.4.Cottage.Living-CODEX
drwxrwsrwx+ 31 craigjesslogan media  4096 Aug 26 13:08 TV
[craigjesslogan@craigjesslogan-x58aud3r ~]$ ls -l /home/craigjesslogan/.drivemounts/disk2
total 24
drwxrwsrwx+  2 craigjesslogan media 16384 Aug 21 19:31 lost+found
drwxrwsrwx+ 18 craigjesslogan media  4096 Aug 29 14:32 Movies
drwxrwsrwx+ 33 craigjesslogan media  4096 Aug 28 19:00 TV
[craigjesslogan@craigjesslogan-x58aud3r ~]$ ls -l /home/craigjesslogan/.drivemounts/disk3
total 24
drwxrwsrwx+  2 craigjesslogan media 16384 Aug 19 13:34 lost+found
drwxrwsrwx+ 20 craigjesslogan media  4096 Aug 29 14:46 Movies
drwxrwsrwx+ 33 craigjesslogan media  4096 Aug 29 10:48 TV
[craigjesslogan@craigjesslogan-x58aud3r ~]$ ls -l /home/craigjesslogan/.drivemounts/disk4
total 24
drwxrwsrwx+  2 craigjesslogan media 16384 Aug 19 13:35 lost+found
drwxrwsr-x+ 22 craigjesslogan media  4096 Aug 29 18:25 Movies
drwxrwsrwx+ 27 craigjesslogan media  4096 Aug 28 14:37 TV

I've attached the usual logs that seem to be asked for.  I noticed that I don't have any permission denied errors in this most recent log, but in the previous log generated today I did get this error:

 

2021-08-29 12:44:14.303 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: /usr/bin/ffprobe-emby -i file:"/home/craigjesslogan/.drivemounts/disk2/Movies/Indiana.Jones.and.the.Raiders.of.the.Lost.Ark.1981.BluRay.1080p.TrueHD.Atmos.7.1.AVC.HYBRID.REMUX-FraMeSToR/Indiana.Jones.and.the.Raiders.of.the.Lost.Ark.1981.BluRay.1080p.TrueHD.Atmos.7.1.AVC.HYBRID.REMUX-FraMeSToR.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data
2021-08-29 12:44:14.314 Info MediaProbeManager: ProcessRun 'ffprobe' Process exited with code 1
2021-08-29 12:44:14.317 Error App: Error in ffprobe
	*** Error Report ***
	Version: 4.6.4.0
	Command line: /usr/lib/emby-server/EmbyServer.dll -programdata /var/lib/emby -ffdetect /usr/bin/ffdetect-emby -ffmpeg /usr/bin/ffmpeg-emby -ffprobe /usr/bin/ffprobe-emby -restartexitcode 3
	Operating system: Linux version 5.13.11-1-MANJARO (builduser@fv-az39-548) (gcc (GCC) 11.1.0, GNU ld (GNU Binutils) 2.36.1) #1 SMP PREEMPT Sun Aug 15 13:15:18 UTC 2021
	Framework: .NET Core 3.1.17
	OS/Process: x64/x64
	Runtime: usr/share/dotnet/shared/Microsoft.NETCore.App/3.1.17/System.Private.CoreLib.dll
	Processor count: 12
	Data path: /var/lib/emby
	Application path: /usr/lib/emby-server
	System.Exception: System.Exception: ffprobe failed for file:"/home/craigjesslogan/.drivemounts/disk2/Movies/Indiana.Jones.and.the.Raiders.of.the.Lost.Ark.1981.BluRay.1080p.TrueHD.Atmos.7.1.AVC.HYBRID.REMUX-FraMeSToR/Indiana.Jones.and.the.Raiders.of.the.Lost.Ark.1981.BluRay.1080p.TrueHD.Atmos.7.1.AVC.HYBRID.REMUX-FraMeSToR.mkv" - streams and format are both null: 
	{
	
	}
	
	
	ffprobe version 4.3.0-emby__p__2021_02_27 Copyright (c) 2007-2021 the FFmpeg developers and softworkz for Emby LLC
	  built with gcc 11.1.0 (GCC)
	file:/home/craigjesslogan/.drivemounts/disk2/Movies/Indiana.Jones.and.the.Raiders.of.the.Lost.Ark.1981.BluRay.1080p.TrueHD.Atmos.7.1.AVC.HYBRID.REMUX-FraMeSToR/Indiana.Jones.and.the.Raiders.of.the.Lost.Ark.1981.BluRay.1080p.TrueHD.Atmos.7.1.AVC.HYBRID.REMUX-FraMeSToR.mkv: Permission denied
	
	
	   at Emby.Server.MediaEncoding.Probing.MediaProbeManager.GetMediaInfoInternal(String inputPath, String primaryPath, MediaProtocol protocol, String userAgent, Boolean extractChapters, String probeSizeArgument, Boolean isAudio, Boolean forceEnableLogging, CancellationToken cancellationToken)
	   at MediaBrowser.Providers.MediaInfo.FFProbeVideoInfo.ProbeVideo[T](MetadataResult`1 metadataResult, MetadataRefreshOptions options, LibraryOptions libraryOptions, CancellationToken cancellationToken)
	   at MediaBrowser.Providers.Manager.MetadataService`2.RunCustomProvider(ICustomMetadataProvider`1 provider, MetadataResult`1 itemResult, String logName, MetadataRefreshOptions options, LibraryOptions libraryOptions, RefreshResult refreshResult, CancellationToken cancellationToken)
	Source: Emby.Server.MediaEncoding
	TargetSite: Void MoveNext()
	

 

TL;DR - manual scans work 100% of the time, automatic scanning works when it wants to if it works at all.  The ffprobe error only seems have happened once even though the file had permissions with the media group that emby is part of.

embyserver.txt hardware_detection-63765848884.txt

[th3rhin0 0]

Perhaps I was too hasty in this - I added 5 movies between 9pm-1130pm last night and Emby did catch all of them automatically.  Maybe it's a timing thing?  When I used Windows the automatic scan seemed to be near instantaneous.

[Luke 37045]

Hi, the .NET core runtime uses INotify for realtime file system updates. This is what Emby Server uses. I don't believe INotify works with mergefs.