Help Troubleshooting Broken Real Time Monitoring

[mrsmithb 11]

Recently started having problem where RTM of libraries is not functioning properly. Browsed through the log and couldn't find a smoking gun. Any help would be appreciated.

embyserver(1).txt

[Luke 42078]

Hi there, can you please provide a specific example? Thanks.

[mrsmithb 11]

Not sure exactly what you're looking for. Early this morning (00:16) a movie (Speak No Evil) was added to the Local Movies library folder (L:/Videos/Movies). Real time monitoring failed to pick it up. I ran a manual scan this morning (~08:00?) in order for it to show up in the Local Movies library in Emby. Just one example, this has been going on for a few weeks. Not sure that RTM has worked one time during that span.

Edited October 1, 2024 by mrsmithb

[Carlo 4561]

Hi,

 Please upload the log file that covers the time of the above tests so we can have a look.

Carlo

[mrsmithb 11]

I updated my previous reply to be more exact. The movie was added to the HDD at 00:16 this morning. The manual scan I triggered that finally added the movie to the library happened at 08:20. During those 8 hours real time monitoring never picked up on the new media file being present. I believe that all of this should be covered by the log file I uploaded in my original post (10/1/24 00:00 - 10/1/24 09:11).

[Luke 42078]

Hi, I think we'll need to have you temporarily enable debug logging, then get the problem to happen again, and then attach the debug log. Thanks.

[mrsmithb 11]

Will do. I'll be back once it's done.

[mrsmithb 11]

Still having this problem. Occassionally it seems like RTM works for a little while, but then stops working again unexpectedly. I turned on debug logging this morning, added a bunch of new movies. Waited a while and none of them were picked up by RTM. Went ahead and ran a manual library scan and it brought in all the new movies files. Pulled the log right after that:

embyserver.txt

[Luke 42078]

19 hours ago, mrsmithb said:

Still having this problem. Occassionally it seems like RTM works for a little while, but then stops working again unexpectedly. I turned on debug logging this morning, added a bunch of new movies. Waited a while and none of them were picked up by RTM. Went ahead and ran a manual library scan and it brought in all the new movies files. Pulled the log right after that:

embyserver.txt 2.36 MB · 1 download

HI, what example are we focusing on here in this log file?

[mrsmithb 11]

22 minutes ago, Luke said:

HI, what example are we focusing on here in this log file?

Take your pick. I'll give one example. At ~14:26 I triggered a manual scan of the Local Movie library. It picked up a huge number of movies which had been added hours prior. One of these was Monkey Business (1931). The .mp4 was in the file system at 13:45. But it (along with all the other movies) wasn't detected and added to the Local Movie library until I triggered the scan at 14:26.

[Carlo 4561]

Looking through your log I see no LibraryMonitor entries.

Can you make sure debugging is turned on, then restart the server.

There should be a couple entries like:
Starting entry point Emby.Server.Implementations.IO.LibraryMonitorStartup
Emby.Server.Implementations.IO.LibraryMonitorStartup. Duration: 0.0143136 seconds

And then an entry for each location being watched:
LibraryMonitor: Watching directory with new FileSystemWatcher for C:\Media\Movies item 10

 

[mrsmithb 11]

I will reboot the server and try again. I know that debugging is turned on and RTM is turned on.

[Luke 42078]

On 10/26/2024 at 7:33 PM, mrsmithb said:

I will reboot the server and try again. I know that debugging is turned on and RTM is turned on.

Please let us know how this goes. Thanks.

[Carlo 4561]

On 10/26/2024 at 7:33 PM, mrsmithb said:

I will reboot the server and try again. I know that debugging is turned on and RTM is turned on.

Any updates?

[Luke 42078]

@mrsmithb?

[kbeck 64]

+1 Real time Monitoring no longer working. Turned on for years. Verified it is on. Sits for days not picking up new titles. Have to manually Scan Libraries. Have restarted server with no change.

[mrsmithb 11]

What I've noticed over the past week is that RTM works sometimes, but often doesn't. I finally got around to turning on debugging, reseting the server, adding new content. And of course, RTM worked this time. Does it maybe work for some time after a server reset? Not sure. 

I did notice something new. There was an alert that I had never seen before, from 11/2. I know that RTM was not functioning before I reset the server, so I'm wondering if this may be related. I've attached a copy of the screenshot below (tried to copy and paste the text, it wouldn't let me). Searching back through the alerts, I found maybe one or two more examples of this going back several months.

[kbeck 64]

13 minutes ago, mrsmithb said:

What I've noticed over the past week is that RTM works sometimes, but often doesn't. I finally got around to turning on debugging, reseting the server, adding new content. And of course, RTM worked this time. Does it maybe work for some time after a server reset? Not sure. 

I did notice something new. There was an alert that I had never seen before, from 11/2. I know that RTM was not functioning before I reset the server, so I'm wondering if this may be related. I've attached a copy of the screenshot below (tried to copy and paste the text, it wouldn't let me). Searching back through the alerts, I found maybe one or two more examples of this going back several months.

 

Mine also started working about an hour after restarting. Will see how long it lasts.

[mrsmithb 11]

Alright @Luke, @Carlo...giving this another try. Yesterday as I mentioned, I made sure that debugging logging was turned on, then rebooted the server. Shortly after I added a new piece of media to the folder that houses my movie library, and RTM immediately picked it up and added it to the emby server.. 

Last night I noticed that RTM appeared to be not working again. So this morning I added the following .mp4 at 09:06

L:\Videos\Movies\Breaking.Away.1979\Breaking.Away.1979.mp4

Waited an hour. RTM did not pick up anything. So at 10:06 I ran a manual scan of the movie library. The movie was then added to the library as expected. I've attached the log.

embyserver (2).txt

[Luke 42078]

5 hours ago, mrsmithb said:

Alright @Luke, @Carlo...giving this another try. Yesterday as I mentioned, I made sure that debugging logging was turned on, then rebooted the server. Shortly after I added a new piece of media to the folder that houses my movie library, and RTM immediately picked it up and added it to the emby server.. 

Last night I noticed that RTM appeared to be not working again. So this morning I added the following .mp4 at 09:06

L:\Videos\Movies\Breaking.Away.1979\Breaking.Away.1979.mp4

Waited an hour. RTM did not pick up anything. So at 10:06 I ran a manual scan of the movie library. The movie was then added to the library as expected. I've attached the log.

embyserver (2).txt 1.83 MB · 0 downloads

HI, are you sure you have the realtime monitor enabled on that library? Can you show us what your library options look like?

[mrsmithb 11]

Screenshot attached.

[Luke 42078]

What kind of drive is your L: drive?

[mrsmithb 11]

It's a HDD on my NAS. The server is on a separate min-PC.

[Carlo 4561]

1 hour ago, mrsmithb said:

It's a HDD on my NAS. The server is on a separate min-PC.

There's the answer. Realtime update depends on the OS making a notification that programs can respond to.
The OS only sends this notification for files on disk that it manages. This doesn't work for network attached storage.

[Luke 42078]

One thing you could try is using the original network location with Emby Server, rather than the mapped drive. Maybe it will work without having that extra layer.