Tv Show identify slow

[Popeye2468 44]

ok so im in the process of scanning my TV Shows to emby i have over 3000 

 

it gets the folders quick enough but it is then painfully slow at identifying and getting the video in to the library

however if i manualy identify themts really fast is there any way too speed this up  without me getting RSi?

[Luke 42079]

Hi there, it depends on what features you've enabled. Please attach an emby server log from this activity and then we can use that to suggest features to disable for faster library scans.

[Popeye2468 44]

i have the basic minimum required i have removed all nfo plugins and dvd folder support plugins etc etc

 

the issue is emby scans 1 tv show at a time which is very slow

however lets say i select a tv show select identify type it in search and select correct one then back out before it finishes then select another and repeat i can add the shows at a much faster rate

 

i dont think there is any issues in regards to anything, i just purely think this is an emby issue, if you install emby 3 or legacy whatever its called, it scans almost 5 times faster much more efficient but this version of emby is just slow at scanning really slow

 

i have used plex and jellyfin both can scan the show into the library in 3 days or less (everything is stored on googledrive) emby is the only one that scans at a snails pace unless i myself take over and manually start adding the shows, then its faster than plex and jellyfin

 

i was wondering if there was a setting to set the scanner at a higher priority like ther is in plex, and if there isnt then maybe someone needs to revisit the scanner as it is under utilised and has actually got worse as time has gone on

[Luke 42079]

Please attach the emby server log and then I'll be able to offer more advice. Thanks.

[Popeye2468 44]

 here you go, however i dont think you understand what it is im saying

embyserver.txt

[Luke 42079]

Strange as there's nothing obvious here. You could always try the beta server and see how that compares.

[Popeye2468 44]

like i said if i do everything manualy its blazing fast but my wrist hurts lol

 

if i leave it to emby its super slow, but not for movies

[Happy2Play 9781]

My guess would be Initial import is working on the entire library where Identify only does one.  You can not get everything for the api all at once.

[Popeye2468 44]

so can that be looked at? it was never like that before and it scanned way faster and plex also doesnt do it his way

 

an idea as to how painfully slow it is .....

 

left to its own devices emby scanned 123 TV shows in 16 hours i manually added 476 in 4 hours

 

personally i think this needs to be looked at, emby is the slowest out there for scanning in your TV shows by quite a long way, is there a reason the old way of scanning in the shows was binned?

 

[Happy2Play 9781]

5 minutes ago, Popeye2468 said:

 it scanned way faster and plex

They use there own servers and mirror provider sites, Emby use the provider site so this can not be a comparison.  But to me from a automated standpoint spamming any provider site will just make the provider throttle or blacklist the api key.

Not sure why your log starts with System.OutOfMemoryException or if related.

2020-09-10 19:56:18.107 Error HttpServer: Error processing request
	*** Error Report ***
	Version: 4.4.3.0
	Command line: C:\Users\Craig\AppData\Roaming\Emby-Server\system\EmbyServer.dll
	Operating system: Microsoft Windows NT 6.2.9200.0
	64-Bit OS: True
	64-Bit Process: True
	User Interactive: True
	Runtime: file:///C:/Users/Craig/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll
	System.Environment.Version: 3.1.4
	Processor count: 4
	Program data path: C:\Users\Craig\AppData\Roaming\Emby-Server\programdata
	Application directory: C:\Users\Craig\AppData\Roaming\Emby-Server\system
	System.OutOfMemoryException: System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
	   at Emby.Server.Implementations.Services.ServiceController.GetTaskResult(Task task)
	   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[TStateMachine](TStateMachine& stateMachine)
	   at Emby.Server.Implementations.Services.ServiceController.GetTaskResult(Task task)
	   at Emby.Server.Implementations.Services.ServiceController.Execute(HttpListenerHost appHost, Object requestDto, IRequest req)
	   at Emby.Server.Implementations.Services.ServiceHandler.ProcessRequestAsync(HttpListenerHost appHost, IRequest httpReq, IResponse httpRes, RestPath restPath, String responseContentType, CancellationToken cancellationToken)
	   at Emby.Server.Implementations.HttpServer.HttpListenerHost.RequestHandler(IRequest httpReq, ReadOnlyMemory`1 urlString, ReadOnlyMemory`1 localPath, CancellationToken cancellationToken)
	Source: Emby.Server.Implementations
	TargetSite: Void MoveNext()

 

 

[Popeye2468 44]

that was because of google drive filestream doing stuff in the background so i stopped it

 

[Popeye2468 44]

my only bug bear is it used to be fast then it got terribly slow

 

i dont understand why the decision was made to take something good and make it bad?

[pwhodges 2012]

At the bottom of the library properties, what is the setting for generating thumbnail images?  This is a very intensive task, so if it is done as media is added it can slow it greatly; leaving it to a scheduled task is probably preferable in practice.

Paul

[rbjtech 5284]

4 hours ago, pwhodges said:

At the bottom of the library properties, what is the setting for generating thumbnail images?  This is a very intensive task, so if it is done as media is added it can slow it greatly; leaving it to a scheduled task is probably preferable in practice.

Paul

2020-09-10 23:18:56.471 Info App: ProcessRun 'extract-image' Execute: C:\Users\Craig\AppData\Roaming\Emby-Server\system\ffmpeg.exe

@pwhodges is spot on - the logs show you are generating a thumbnail image set for each show episode - turn this off (and choose to do it on a schedule) and your TV identity rate will be significantly improved.   ps - it says as much in the setting when you turn it on ... see below

 

Edited September 11, 2020 by rbjtech

[Popeye2468 44]

This makes no difference at all it's still painfully slow

 

I ended up doing all 2500 shows myself in the space of about 10 hours and emby scanned about 450 in 3 days

 

I genuinely think it's broken, it seems to go slow when it has to scan a large amount it's like it doesn't know where to start, I added 1053 4k movies did them in 30 mins, added 9000 movies a day ago and hasn't even got through half of them yet, it's stupid!

 

Somewhere along the way you guys broke your media scanner, before it would only add them as it has scanned them and it was fast, (this is proven with jellyfin an older version of emby) now it's borderline useless! It scans all folders and lists them, then at a super slow snail's pace scans 1 at a time

 

I really think someone needs to look into it, it's unusable in it's current state, but everyone doesn't seem to see the issue and I don't know why.

 

It can't be that every other media software is on average 6 times faster and emby is the slowest by a considerable amount, if I were new to emby and had a large library I would stay away for sure.

[Luke 42079]

Actually eliminating thumbnails will make all of the difference in the world. I must have missed that when reviewing the log.

[Happy2Play 9781]

Sorry but adding options will slow the process not matter who makes it.

But you appear to be doing "chapter" not "interval" image.  I have not done a clean identification of 500 series in years as I feel hammering a provider every build is really bad.  Saving metadata with media is a on stop shop that can be updated as need.  And rebuilds faster it is already identified.

But I can say doing 50 series on a test machine does not take that long.

Edited September 11, 2020 by Happy2Play

[Popeye2468 44]

Ok I'm wrong and it's perfect sorry to bother everyone!

[Luke 42079]

1 minute ago, Popeye2468 said:

Ok I'm wrong and it's perfect sorry to bother everyone!

Sorry that wasn't the intended reaction. Yes we are always looking to improve this. I'm just saying that thumbnail extraction is the one single event that will take the most time, so disabling it will make a major difference.

[Popeye2468 44]

But as I said the difference it makes is small, I have now done all the tv shows now by hand but for anyone else new comes along, they wouldn't stick around I have cos I'm a lifetime member, but I haven't used emby for the last few years, and the only thing that's let's it down is scanning new media is painfully slow.

 

I think it's something that needs to be looked at for new users, hopefully my movies will be in soon as I don't fancy manually adding 9000 movies

[Popeye2468 44]

22 minutes ago, Happy2Play said:

Sorry but adding options will slow the process not matter who makes it.

But you appear to be doing "chapter" not "interval" image.  I have not done a clean identification of 500 series in years as I feel hammering a provider every build is really bad.  Saving metadata with media is a on stop shop that can be updated as need.  And rebuilds faster it is already identified.

But I can say doing 50 series on a test machine does not take that long.

Yes having all the media in the folders is a perfect solution but not applicable to this discussion, also doing 50 series on a test machine not taking too long proves my point, please read above and you will see that I have said a small amount works well and fast but give it a huge library and watch it come apart

[Happy2Play 9781]

But at the same time you are hammering a provide and all that does is make Emby look bad to them.  I am sure Luke could code to to request every series, season and episode instantly but what do you think a provider site should do when hundreds of thousands of users do what you are doing?

[Popeye2468 44]

I'm not asking for it to request all the tv series you add at once but I think it should be quicker than what it is, as all the competition are much faster