Jump to content

Scan in loop !

vincen

By vincen
in Linux

 Share

Recommended Posts

vincen

vincen   13

Posted
Posted

Hi

 

I have a weirdo behaviour with scanner. If I trigger a scan on a specific library, it'll do a first scan and as soon as it's finished, restart the scan again and again. Usually after 2/3 pass it'll stop but recently it has become more and more stucky on it :(

Is it normal behaviour of scan process or something in my library that messes up the scan engine ?

I attach logs extracted during a scan loop.

 

Thanks

 

Vincèn

embyserver.txt

Link to comment
Share on other sites
Happy2Play

Happy2Play   8289

Posted
Posted

To me it would appears normal but Dev may have to confirm. 

	Line 125481: 2024-04-09 13:04:24.264 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125482: 2024-04-09 13:04:24.265 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125483: 2024-04-09 13:04:24.265 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125484: 2024-04-09 13:04:24.266 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125485: 2024-04-09 13:04:24.284 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125486: 2024-04-09 13:04:24.308 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125487: 2024-04-09 13:04:24.325 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125488: 2024-04-09 13:04:24.340 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125489: 2024-04-09 13:04:24.360 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125490: 2024-04-09 13:04:24.375 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125491: 2024-04-09 13:04:24.393 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125492: 2024-04-09 13:04:24.408 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125493: 2024-04-09 13:04:24.434 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125494: 2024-04-09 13:04:24.476 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125496: 2024-04-09 13:04:24.476 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125498: 2024-04-09 13:04:32.985 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125499: 2024-04-09 13:04:32.988 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125500: 2024-04-09 13:04:32.994 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125501: 2024-04-09 13:04:33.001 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125502: 2024-04-09 13:04:33.003 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125504: 2024-04-09 13:04:33.008 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125505: 2024-04-09 13:04:33.010 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125506: 2024-04-09 13:04:33.013 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125507: 2024-04-09 13:04:33.015 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125508: 2024-04-09 13:04:33.016 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125509: 2024-04-09 13:04:33.017 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125510: 2024-04-09 13:04:33.020 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125512: 2024-04-09 13:04:33.021 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125514: 2024-04-09 13:04:33.028 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125515: 2024-04-09 13:04:33.033 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125516: 2024-04-09 13:04:33.035 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125518: 2024-04-09 13:04:33.043 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125520: 2024-04-09 13:04:33.045 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125521: 2024-04-09 13:04:33.046 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125522: 2024-04-09 13:04:33.048 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125523: 2024-04-09 13:04:33.050 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125524: 2024-04-09 13:04:33.051 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125525: 2024-04-09 13:04:33.052 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125529: 2024-04-09 13:04:33.081 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125530: 2024-04-09 13:04:33.083 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125531: 2024-04-09 13:04:33.084 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125532: 2024-04-09 13:04:33.085 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125533: 2024-04-09 13:04:33.086 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125534: 2024-04-09 13:04:33.088 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125536: 2024-04-09 13:04:33.093 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125537: 2024-04-09 13:04:33.097 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125538: 2024-04-09 13:04:33.099 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125539: 2024-04-09 13:04:33.100 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125540: 2024-04-09 13:04:33.100 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125541: 2024-04-09 13:04:33.102 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125542: 2024-04-09 13:04:33.103 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125543: 2024-04-09 13:04:33.104 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125544: 2024-04-09 13:04:33.105 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125546: 2024-04-09 13:04:33.108 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125547: 2024-04-09 13:04:33.109 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125549: 2024-04-09 13:04:33.113 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125550: 2024-04-09 13:04:33.114 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125551: 2024-04-09 13:04:33.114 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125552: 2024-04-09 13:04:33.116 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125553: 2024-04-09 13:04:33.117 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125554: 2024-04-09 13:04:33.118 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125556: 2024-04-09 13:04:33.120 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125557: 2024-04-09 13:04:33.120 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125558: 2024-04-09 13:04:33.120 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125559: 2024-04-09 13:04:33.123 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125560: 2024-04-09 13:04:33.123 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125561: 2024-04-09 13:04:33.124 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125562: 2024-04-09 13:04:33.125 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125563: 2024-04-09 13:04:33.126 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125564: 2024-04-09 13:04:33.127 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125565: 2024-04-09 13:04:33.128 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125566: 2024-04-09 13:04:33.131 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125567: 2024-04-09 13:04:33.131 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125568: 2024-04-09 13:04:33.133 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125569: 2024-04-09 13:04:33.133 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125570: 2024-04-09 13:04:33.134 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125571: 2024-04-09 13:04:33.135 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125572: 2024-04-09 13:04:33.137 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125573: 2024-04-09 13:04:33.138 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.
	Line 125628: 2024-04-09 13:04:36.136 Info LibraryMonitor: Series en Cours (/medias/Series en Cours) will be refreshed.

But this log is filled with RTM event so would expect scans being triggered every 60 seconds.  Debug logging would show a little more info.

This is an additional scan after the one above as it is outside of the previous scan as monitoring stops during scan. 

Line 125921: 2024-04-09 13:06:55.697 Info LibraryMonitor: Series Finies (/medias/Series Finies) will be refreshed.

Then would be another 

Line 126051: 2024-04-09 13:08:35.035 Info LibraryMonitor: Saison 7 (/medias/Series en Cours/Vera (2011)/Season 07) will be refreshed.

And 

Line 126676: 2024-04-09 13:17:18.367 Info LibraryMonitor: Series Finies (/medias/Series Finies) will be refreshed.

So with RTM interval only being 60 seconds and a lot of change can actually create loops / continuous scans. 

<LibraryMonitorDelay>60</LibraryMonitorDelay>

 

Link to comment
Share on other sites
Luke Emby Team

Luke   37084

Posted
Posted

Hi there, this log does contain a lot of activity, but what makes you think that it's looping?

Link to comment
Share on other sites
vincen

vincen   13

Posted
  • Author
Posted
19 hours ago, Happy2Play said:

To me it would appears normal but Dev may have to confirm.

But this log is filled with RTM event so would expect scans being triggered every 60 seconds.  Debug logging would show a little more info. 

Line 126676: 2024-04-09 13:17:18.367 Info LibraryMonitor: Series Finies (/medias/Series Finies) will be refreshed.

So with RTM interval only being 60 seconds and a lot of change can actually create loops / continuous scans. 

<LibraryMonitorDelay>60</LibraryMonitorDelay>

 

What is RTM ? I have no setup interval at 60 seconds in settings, I have only automatic scan on detection of modifications in directories of the library that's it !

10 hours ago, Luke said:

Hi there, this log does contain a lot of activity, but what makes you think that it's looping?

Well the fact that it was restarting muliple times. It runs till 100% then restart immediately and again and again...

Link to comment
Share on other sites
Lessaj

Lessaj   61

Posted
Posted
37 minutes ago, vincen said:

What is RTM ? I have no setup interval at 60 seconds in settings, I have only automatic scan on detection of modifications in directories of the library that's it !

image.png.e1dc3dfa3f33d4a8d102cdee4214de9e.png

The interval is not shown in the library config, it's in system.xml.

Link to comment
Share on other sites
vincen

vincen   13

Posted
  • Author
Posted
Just now, Lessaj said:

The interval is not shown in the library config, it's in system.xml.

Sorry but I'm a little lost there 😕 For me Real Time Monitoring means that Emby doesn't to scan whole library to find new files but use OS system call to be alerted when a change has happened and then trigger a scan to find these new files ? And if so why an interval ? or is it to prevent an other scan to start in less than 60 seconds in case OS reports a new file change ?

Link to comment
Share on other sites
Lessaj

Lessaj   61

Posted
Posted

Yes it uses inotify to detect a change in a specific folder and scan just that rather than the whole library, the interval is there to act a delay so it doesn't try to scan while you're still doing things, such as moving files around, or new files being populated.

  • Like 1
Link to comment
Share on other sites
vincen

vincen   13

Posted
  • Author
Posted
1 hour ago, Lessaj said:

Yes it uses inotify to detect a change in a specific folder and scan just that rather than the whole library, the interval is there to act a delay so it doesn't try to scan while you're still doing things, such as moving files around, or new files being populated.

Thanks for explanations :) before next reboot of emby server I'll modify setting in config file and see if it makes a difference.

Link to comment
Share on other sites
Luke Emby Team

Luke   37084

Posted
Posted
15 hours ago, vincen said:

What is RTM ? I have no setup interval at 60 seconds in settings, I have only automatic scan on detection of modifications in directories of the library that's it !

Well the fact that it was restarting muliple times. It runs till 100% then restart immediately and again and again...

I only see one execution of a library scan in that. What exactly do you feel was looping?

Link to comment
Share on other sites
vincen

vincen   13

Posted
  • Author
Posted
2 hours ago, Luke said:

I only see one execution of a library scan in that. What exactly do you feel was looping?

The fact that it restarts a bunch of time when I look at scan progress in Emby parameters. I have the indication on the library of scan progress going up to 100% and then restart till it reaches 100% and again and again ;) From what I have understood now it's normal behaviour so I'll know I should not care about it 😄

 

Link to comment
Share on other sites
Luke Emby Team

Luke   37084

Posted
Posted
On 4/11/2024 at 3:31 AM, vincen said:

The fact that it restarts a bunch of time when I look at scan progress in Emby parameters. I have the indication on the library of scan progress going up to 100% and then restart till it reaches 100% and again and again ;) From what I have understood now it's normal behaviour so I'll know I should not care about it 😄

 

Where do you see it going back to 100%?

Link to comment
Share on other sites
vincen

vincen   13

Posted
  • Author
Posted
3 hours ago, Luke said:

Where do you see it going back to 100%?

Where you have all libraries displayed in server settings ;) It displays the little round indicator on each library when it scans it !

Link to comment
Share on other sites
Luke Emby Team

Luke   37084

Posted
Posted

HI, are you still having an issue with this?

Link to comment
Share on other sites
vincen

vincen   13

Posted
  • Author
Posted
12 hours ago, Luke said:

are you still having an issue with this?

Well now that I know it's not an issue but normal behaviour I don't check anymore scan progression in server settings 😎

Link to comment
Share on other sites
vincen

vincen   13

Posted
  • Author
Posted
On 4/24/2024 at 8:13 PM, Luke said:

You can always disable the real-time monitor on your libraries if desired.

Yeah but no I prefer to keep it this way as it works quite well and easier than to have to trigger manually scans all the time 😄

  • Thanks 1
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...