Question about my folder permissions

[md_heuler 2]

Hi,

 

I am running an EmbyServer under Linux (Version 4.0.1.0) now for a couple of months and I am quite happy with the system.

Great work, congrats.

 

But this weekend I hit a quite annoying issue:

 

After reorganizing my library which resulted in changes to the folder structure I had to do a full library scan (from scratch).

With the first two added folders this worked like a charm but the third one simply FAILED to scan.

Emby wouldn't find a single one of the roughly 150 movies.

In the folder view of the library (on the home screen) the folder could be seen though, but was just empty.

 

In the log file I couldn't find any clue what's going wrong.

 

It took me quite a while to find out what was happening.

 

It turned out that there were two movies that seem to generate problems during the scan.

If any of it was located in the folder, the scan just failed/stopped silently, without giving any error notice.

Removing them, the scan ran smoothly and all movies showed up in the library.

 

Now I am a bit worried because the effect leads to a very subtile error situation on a library already filled with movies:

- Suppose I have a library with hundreds of movies

- Suppose I add a couple of new movies with at least one that fails the scan

- Future scans will fail silently and I see only the old movies which don't seem to be touched, but no movie added after that will show up

- Hopefuly I will recognize immediately that the new movies are missing (so that I got a chance to identify the one that's problematic)

- If I don't, I end up with a folder of hundreds of movies and no clue which one causes problems

 

Just if you wonder, that's actually a situation I observed, not just theory.

 

 

So my question is: Is this an already known isssue. Are there any improvement in the pipeline?

IMHO if the scan hit's any problematic movie, it should rather ignore it (or even better report an error) but still find all the other movies.

 

Also is there a better way to find such problematic movies, except for try-and-error ;-(

 

If there is any additional information I could provide feel free to ask.

 

Thanks

md_heuler

 

 

[Luke 37361]

Hi there, please attach the emby server log. you can learn how to do that here:

https://emby.media/community/index.php?/topic/739-how-to-report-a-problem/

 

Thanks !

[md_heuler 2]

Ok here you are ...

 

I created a fresh one documenting the following workflow:

 

- started from scratch by setting up a new server instance

- enabled debug logging

- first library from folder 'Quarantine' contains 3 movies (two faulty, one working)

- tried several scans without success

- then created a new library ('Works') from the folder Quarantine_2 (contains just the same working movie)

- movie shows up fine

 

Hope that helps

embyserver.txt

[Luke 37361]

Ok so the library scan isn't failing, you're just having trouble with content not showing up. Is that correct?

[md_heuler 2]

That's correct ... somehow:

 

When I trigger the scan, something seems to happen BUT content is not showing up.

 

But on a second view not only the faulty content does not show up but NO content is found AT ALL.

From that user perspective one can very well argue that the scan is not working correctly/robustly.

 

Does this make sense?

[Luke 37361]

@@md_heuler can you give an example of something that isn't showing up? You mentioned the title, but what is the folder structure? Thanks !

[md_heuler 2]

Ok, referring to the log file above my disks looks like:

 

/windows/Archive.merged/01/

> Quarantine

> > Film1

> > Film2

> > Film3 (specifically: "Apple.Nichts.als ...")

> Quarantine_2

> > Film3 (copy of the exact same as above)

 

I created two media libraries for Quarantine and Quarantine_2.

The first one has NO entry AT ALL! ZERO!

The second one has the entry for Film3 as one would expect.

 

I would expect that Quarantine shows at least Film3 but that's

not the case, I think the log file shows that emby isn't event trying

to scan Quarantine ... am I right?

[md_heuler 2]

F.Y.I.

 

Just run a cross check on emby (Version 3.5.3.0) on the exact same folders:

it behaves as I would expect. Film3 is available in both libraries.

 

On Version 4.0.1.0 it's not!

[Luke 37361]

These are both setup with content type movies in library setup? is that correct?

[md_heuler 2]

Yes, content type is Movies.

I tried to setup both libraries with the exact same settings - pretty much default except for disabling 'real time monitoring'.

[md_heuler 2]

Argh ... just figured out the real source of the problem.

 

File permissions on the Film1 and Film2 folders were flawed.

The emby 3.5.3.0 log showed an 'UnauthorizedAccessException' ;-(.

 

Nonetheless the overall behavior of 4.0.1.0 has deteriorated compared to 3.5.3.0.

In 3.5.3.0 there was the error showing up in the log file and the scan proceeded

with all folders it had access to.

 

In 4.0.1.0 in case there is a single folder without access permissions the whole

scan silently fails and does not find any content - not even the content in

accessible directories.

 

So it should be quite easy to reproduce, just take away read permissions on one

of your movie sub-folders and you should see the effect.

[Luke 37361]

Thanks for the feedback.

[md_heuler 2]

So do you plan any improvements on the scan in future releases, e.g.,

 

- Better logging to identify such problems

- More robust scanning that just ignores directories without access permission but still scans all other directories

 

Again, the behavior of version 3.5.3.0 was better in that sense and 4.0.1.0 falls behind that.

[Luke 37361]

Improvements are planned for the future, thanks.