More NFS troubles

[ctaranto 6]

** To avoid any confusion, the below thread ended up being related to be a combined issue with NFS and mergerfs.  Using NFS by itself works fine **

 

 

 

 

I've had been using SMB shares for a while that have recently been giving me performance problems, so I switched to NFS.

 

I have everything pretty much working outside of Emby.  Emby is giving me fits.

 

The Emby library that I had set up (at the same mount point) using SMB is no longer working (movies won't play).

 

I deleted that Emby library path and tried to re-add it.  When I attempted to re-add /storage/movies, I receive the following error:

"The path could not be found. Please ensure the path is valid and try again."

 

I have a local folder /storage/foo which adds fine in Emby (though it has no media since it's local).  Both foo and movies have the same permissions (see below).

 

I read through many other threads, including adding the Optional Network section (nfs://172.20.0.11/storage/movies in my case), but that didn't work.

 

Any info would be greatly appreciated.  Lots of config info below....

 

 

 

OS: Manjaro (latest on both)

Emby:  3.5.0.0

 

172.20.0.11 - Media server with shared media

172.20.0.66 - Emby server; thor-pc

 

[ctaranto@thor-pc storage]$ ls -al

total 48

drwxr-xr-x  9 ctaranto root      4096 Aug  6 21:46 .

drwxr-xr-x 19 root     root      4096 May  9 11:26 ..

drwxrwxrwx  2 ctaranto ctaranto  4096 Aug  6 21:46 foo

drwxrwxrwx  3 ctaranto ctaranto 12288 Aug  6 12:34 movies

 

 

 

172.20.0.11

/etc/exports

/storage/movies *(rw,async,no_subtree_check,insecure,no_root_squash,fsid=2)

 

/etc/fstab

/mnt/red1/snapraid/media_server/Movies:/mnt/red2/snapraid/media_server/Movies:/mnt/red3/snapraid/media_server/Movies    /storage/movies fuse.mergerfs   user,noauto,allow_other,use_ino,hard_remove,fsname=movies   0       0

 

(The above is how /storage/movies is mounted on the Media Server.  It uses mergerfs to combine multiple drives into one logical volume)

 

 

172.20.0.66

/etc/fstab

172.20.0.11:/storage/movies    /storage/movies nfs     nfsvers=3,rw,noauto     0       0

 

To mount on 172.20.0.66:

mount /storage/movies

 

On 172.20.0.66:  df -kh

Filesystem                     Size  Used Avail Use% Mounted on

dev                             16G     0   16G   0% /dev

run                             16G  1.3M   16G   1% /run

/dev/sda1                      180G   57G  114G  34% /

tmpfs                           16G  8.0K   16G   1% /dev/shm

tmpfs                           16G     0   16G   0% /sys/fs/cgroup

tmpfs                           16G   36K   16G   1% /tmp

tmpfs                          3.2G   16K  3.2G   1% /run/user/1000

172.20.0.11:/storage/movies    22T   12T  8.9T  58% /storage/movies

 

Edited August 7, 2018 by ctaranto

[riothamus 51]

What I'm wondering about is the usage of mergerfs (I have never used it, I just run autofs from my media server to my Emby srever).  Since it is using fuse, this type of daemon mounts locations in userland.  What does the output of ls -ld /storage/movies show on your Emby server?  On the face of it, I'm going to assume something is not meshing right with permissions.

 

Also, what output shows up in your Emby log itself?  Perhaps it can shed some light on this. 

[Luke 37119]

Yes those are good questions. Thanks.

[ctaranto 6]

What I'm wondering about is the usage of mergerfs (I have never used it, I just run autofs from my media server to my Emby srever).  Since it is using fuse, this type of daemon mounts locations in userland.  What does the output of ls -ld /storage/movies show on your Emby server?  On the face of it, I'm going to assume something is not meshing right with permissions.

 

Also, what output shows up in your Emby log itself?  Perhaps it can shed some light on this. 

 

Thanks for the response.

 

[ctaranto@thor-pc ~]$ ls -ld /storage/movies

drwxrwxrwx 3 ctaranto ctaranto 12288 Aug  6 12:34 /storage/movies

 

I normally don't 777 anything, but in this case, I'm trying everything.

 

On the thought that mergerfs is causing the problem, I created an NFS mount to a non-mergerfs volume.  That works.

 

Though this doesn't really help me much since I need to mount the mergerfs volume.  Emby worked fine when I had SMB mounting the mergerfs volume.  This all started when I switched to NFS.

 

The log when trying to configure /storage/movies (the mergerfs volume) using the Emby UI.  I first select /, then select storage, then select movies.

 

 

2018-08-07 08:04:58.702 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Library/VirtualFolders. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:04:58.704 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 2ms. http://172.20.0.66:8096/emby/Library/VirtualFolders 
2018-08-07 08:04:58.738 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Localization/cultures. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:04:58.740 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 2ms. http://172.20.0.66:8096/emby/Localization/cultures 
2018-08-07 08:04:58.778 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Localization/countries. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:04:58.779 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 1ms. http://172.20.0.66:8096/emby/Localization/countries 
2018-08-07 08:04:58.825 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Libraries/AvailableOptions?LibraryContentType=movies&IsNewLibrary=false. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:04:58.827 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 2ms. http://172.20.0.66:8096/emby/Libraries/AvailableOptions?LibraryContentType=movies&IsNewLibrary=false 
2018-08-07 08:04:59.995 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Environment/DefaultDirectoryBrowser. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:04:59.997 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 1ms. http://172.20.0.66:8096/emby/Environment/DefaultDirectoryBrowser 
2018-08-07 08:05:00.031 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Environment/Drives. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:05:00.036 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 4ms. http://172.20.0.66:8096/emby/Environment/Drives 
2018-08-07 08:05:03.672 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Environment/DirectoryContents?includeDirectories=true&path=%2F. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:05:03.672 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Environment/ParentPath?path=%2F. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:05:03.673 Info HttpServer: HTTP Response 204 to 172.20.0.1. Time: 2ms. http://172.20.0.66:8096/emby/Environment/ParentPath?path=%2F 
2018-08-07 08:05:03.674 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 2ms. http://172.20.0.66:8096/emby/Environment/DirectoryContents?includeDirectories=true&path=%2F 
2018-08-07 08:05:10.295 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Environment/ParentPath?path=%2Fstorage. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:05:10.295 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Environment/DirectoryContents?includeDirectories=true&path=%2Fstorage. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:05:10.297 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 1ms. http://172.20.0.66:8096/emby/Environment/ParentPath?path=%2Fstorage 
2018-08-07 08:05:10.298 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 3ms. http://172.20.0.66:8096/emby/Environment/DirectoryContents?includeDirectories=true&path=%2Fstorage 
2018-08-07 08:05:13.192 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Environment/DirectoryContents?includeDirectories=true&path=%2Fstorage%2Fmovies. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:05:13.192 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/Environment/ParentPath?path=%2Fstorage%2Fmovies. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36
2018-08-07 08:05:13.194 Info HttpServer: HTTP Response 200 to 172.20.0.1. Time: 2ms. http://172.20.0.66:8096/emby/Environment/ParentPath?path=%2Fstorage%2Fmovies 
2018-08-07 08:05:13.194 Info HttpServer: HTTP Response 500 to 172.20.0.1. Time: 2ms. http://172.20.0.66:8096/emby/Environment/DirectoryContents?includeDirectories=true&path=%2Fstorage%2Fmovies 
2018-08-07 08:05:17.486 Info HttpServer: HTTP GET http://172.20.0.66:8096/emby/System/Logs/Log?name=embyserver.txt. UserAgent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/68.0.3440.84 Safari/537.36

 

Edited August 7, 2018 by ctaranto

[riothamus 51]

You're getting a 500 HTTP (internal server error) response back from Emby on that location.:

2018-08-07 08:05:13.194 Info HttpServer: HTTP Response 500 to 172.20.0.1. Time: 2ms. http://172.20.0.66:8096/emby/Environment/DirectoryContents?includeDirectories=true&path=%2Fstorage%2Fmovies 

I'm not really familiar with mergerfs, so I'm not sure how the internals work with that service.  However, your operating system doesn't seem to have a problem with it.  I did find a link here where someone was using it for that 'other' media server system:  https://forums.servethehome.com/index.php?threads/directory-structure-for-nfs-shares-mergerfs.9738/.  There are some differences between your mount options and what the user in this thread has applied. 

 

I'm not sure if this is an Emby problem, since Emby was able to use mergerfs over your SMB shares.  From my seat, I wonder if it's the implementation of mergerfs with the NFS backing share here.

[ctaranto 6]

Thanks again for the response.

 

I added the "category.create=eplfs" (which is the only thing I didn't have compared to that thread) but it didn't help.

 

It's a bit perplexing that everything else treats the NFS mount as just another volume, but Emby needs things "just so".

 

 

Just thought about something that may work instead.  Since mergerfs leaves the source disks in tact, they are individually mountable.  If I NFS mount each drive separately (there are 3 drives in the pool), could I add each NFS mount to the library and have the same end-user experience as mounting one large pooled volume?  Does Emby pool together multiple sources?

Edited August 7, 2018 by ctaranto

[riothamus 51]

Yep, that is precisely what I do.

 

I have 3 movie mounts, and I use Emby to just pool those together into one Movie Library for me.

 

https://imgur.com/a/28mtqpj

Edited August 7, 2018 by riothamus

[ctaranto 6]

Thanks.  I've added the 3 drives and fully rebuilding the metadata.  Appears to be going well so far.

[riothamus 51]

Excellent!  I got lost in the details, I should have mentioned that you could use multiple directories at once for a library in Emby.  FWIW, Kodi does the same thing.

[BlackDub 28]

On 07/08/2018 at 15:14, riothamus said:

Yep, that is precisely what I do.

 

I have 3 movie mounts, and I use Emby to just pool those together into one Movie Library for me.

 

https://imgur.com/a/28mtqpj

The solution is that you need change the permission ABOVE each directoy in all disks, try it

[Luke 37119]

Hi, has this resolved your issue?