Scans taking forever

[JasonNalley 37]

So, about 6-8 months ago, I enabled "Download images in advance" for my TV Library only, just to see what the difference was.  I knew the scans would take longer based on the warning for the selection.  At first, things were scanning in normally and didn't seem like it was making any real, tangible difference.  However, the longer I let it remain that way,  the longer scans started to take.  Before enabling it, scans would take maybe 2-3 minutes and I'd be able to watch the content, however, as time went on, 10 minutes, 30 minutes, hour etc.  Well, I decided to disable the feature, as it was 30min - hour before I could watch content after it was added.  However, the problem has still progressively gotten worse.  I am now up to something like 3-4 hours from the time it's added to the library till I can watch it and have no idea how to fix what I broke.  Hoping someone here can help. 

The other oddity I've noticed is this:
In the case of new episodes for existing content - it moves the show to the top of latest tv almost immediately, but does not show any unwatched episodes, it takes approx 3-4 hours till the unwatched episode actually pops up.

In the case of new shows/content - it doesn't show immediately like above, but takes anywhere from 15min - 1 hr to show up with a blank poster/etc and will be about 3-4 hours before all the information populates and I'm able to watch said content.

Anyone know what to look for in the settings?  I am 90% certain that save for moving around a couple of metadata providers that it is back to default, but not really sure.

Edited September 26, 2021 by JasonNalley

[Carlo 4561]

Hi, these long times seem unrelated to downloading the graphics.

Please post your server log so we can take a look.

[JasonNalley 37]

31 minutes ago, cayars said:

Hi, these long times seem unrelated to downloading the graphics.

Please post your server log so we can take a look.

Do you want me to rar the entire logs folder? (tried and it seems to stop because "in use"), or any particular log file you are interested in?

[Carlo 4561]

No just attach the latest server log.

[JasonNalley 37]

@cayars k, I restarted it, let it sit for a couple of hours (because I had some things to do), and just added a new episode and refresh scanned on the tv library.  As soon as it's done and I can see the episode I will reply with the server log... embyserver.txt

[JasonNalley 37]

Here are the logs, it was shorter this time than the past couple of times, but still just abnormally long... 

 

Edited September 27, 2021 by JasonNalley

[Carlo 4561]

I'm seeing a lot of errors from Trakt & Proxer.

I would try removing those plugins.

[Happy2Play 9783]

Yes there are a few LibraryMonitor will be refreshed and looks the like the library scan interrupts the the process and 20 minutes later the item is actually imported and gets metadate and images..

2021-09-26 17:58:38.950 Info MediaProbeManager: ProcessRun 'ffprobe' Execute: C:\Users\Jason\AppData\Roaming\Emby-Server\system\ffprobe.exe -i file:"M:\Media\TV Shows\Josh Gates Tonight\Season 03\Josh Gates Tonight - S03E10 - Diving In-WEBDL-1080p.mkv" -threads 0 -v info -print_format json -show_streams -show_chapters -show_format -show_data

But a wild guess as it has shown issues in other topics would be "OMBI" as it database intensive in its process.  If you disable/shutdown "OMBI" do you get different results?

[Luke 42083]

Quote

If you disable/shutdown "OMBI" do you get different results?

Oh yes, shutting this down will make a massive difference. I would also suggest removing the anime plugin and just going with tvdb/moviedb metadata if you can.

 

[JasonNalley 37]

I mean, I've been running Ombi since before I switched from Plex a couple of years ago and never has been a problem.  Is there any reason that it would cause issues now?  I can de-link Ombi from Emby, not sure what benefit it has anyways being connected, but I don't know why all of a sudden it's starting to take this long, and while it shows only a gap of ~20 minutes, it ended up being more like an hour and a half from the time I did the Library scan till the time I was actually able to see and watch the episode... It has been taking about 3-4 hours though, which is just insane... 

Trakt is on a scheduled task, not sure what "proxer" is... 

And as for the Anime Plugin, there are a few series that TVDB considers Direct to video Hentai that I would consider more Ecchi than Hentai and therefore are excluded from TVDB... Without the Anime Plugin I will/would need to manually input the metadata, which is a pita.

[Happy2Play 9783]

2 minutes ago, JasonNalley said:

I mean, I've been running Ombi since before I switched from Plex a couple of years ago and never has been a problem.  Is there any reason that it would cause issues now?  I can de-link Ombi from Emby, not sure what benefit it has anyways being connected, but I don't know why all of a sudden it's starting to take this long, and while it shows only a gap of ~20 minutes, it ended up being more like an hour and a half from the time I did the Library scan till the time I was actually able to see and watch the episode... It has been taking about 3-4 hours though, which is just insane... 

Trakt is on a scheduled task, not sure what "proxer" is... 

And as for the Anime Plugin, there are a few series that TVDB considers Direct to video Hentai that I would consider more Ecchi than Hentai and therefore are excluded from TVDB... Without the Anime Plugin I will/would need to manually input the metadata, which is a pita.

All we can do is test to see what if any of these items are having adverse issues on your system.  but proxer is a fetcher within the Anime plugin.

But my guess would be OMBI.

[JasonNalley 37]

2 minutes ago, Happy2Play said:

All we can do is test to see what if any of these items are having adverse issues on your system.  but proxer is a fetcher within the Anime plugin.

But my guess would be OMBI.

Sure, I get that all you can do is test.  I was just curious if anyone knew anything that changed that might cause it.  I've de-linked Ombi from Emby, so we'll see.  I can add an episode here in a bit, but the scan itself that I did to get the new episode in still isn't even finished, it's at 95%.  I have noticed that too, that it goes real quick from 0-90 (that's normal) but the 90-100 is what takes so long.  Before all of this it only took about 2-3 minutes to get to 100, now, hours... 

[Happy2Play 9783]

Depends on what is being seen, as every system is different but I know on my setup RTM is seeing items in the 60 second delay set in system.xml and a full library scan take about 1 and a half.

But every plugin and enabled options have a factor in the process.

[JasonNalley 37]

Alright, so disabling Ombi/removing its connection to Emby didn't help.  I set Trakt to only go off at 2am and 3am daily, that didn't help.  However, uninstalling the Anime plug-in seemed to fix it  (90-100% is taking 10-ish minutes instead of 2-3 hours).  So, what is going on in the Anime Plugin that it has spun that far out of control?  Any ideas?

[Luke 42083]

The anime plugin is a community driven plugin but we'll take a look as we're able to. Thanks for the feedback.