New Statistics plugin

[Junglejim 385]

16 hours ago, DarkStar1977 said:

An btw, @Happy2Playrefreshing library metadata just for this is insane, I've only refreshed 1 of my TVshows libraries (I have 7), and took 3 hours and as result of this, the server is since 10 am this morning "Detecting intros" again because of this.

When the emby team will asume that the best way to handle episodes is to have the ones you have, the ones that are missing and the upcoming in the Emby database as it was on version 4.7 ?

This plugin worked like a charm in that version .....

I didn't refresh the library metadata, I just selected missing episodes in the Metadata Manager. It only took like 60 seconds to sort things out. Then I ran the statistics shedule.

A bit of a pain I know.  

[DarkStar1977 119]

11 minutes ago, Junglejim said:

I didn't refresh the library metadata, I just selected missing episodes in the Metadata Manager. It only took like 60 seconds to sort things out. Then I ran the statistics shedule.

A bit of a pain I know.  

Bit of a pain ?

Unusable on large libraries like mine ...

[crossfire13148 29]

6 hours ago, DarkStar1977 said:

Bit of a pain ?

Unusable on large libraries like mine ...

I agree. with over 1400 tv shows, and almost 14,000 movies with 49 users, the scan taking almost 5 hours i could deal with...
now finding out the 1 thing i use this for (to list missing episodes) does not work, i am calling this over.
just for shits and giggles, i started randomly clicking shows and selecting "missing episodes" and there is A LOT of shows missing new episodes that this plug in failed to find.

BUT EMBY can look at tvdb and tell me what is missing, but this plug in cant?

just like the "cannot search other folders" which it seems to find 1 of the 2 folders on my main system with tv shows.
ironically, it used to even search my tv shows AND my DVR shows to tell me i was missing things.

so if it links to theTVDB, but doesnt use it then what is the point of having it link to it in the first place?
if this is supposed to show stats of tv shows, and cannot do that then what is it purpose?
if i cannot even give useful stats of the movies it scans why waste hours on scanning the movies?
ESPECIALLY when i cant even unselect what it scans, or what users.

i only had this plug in, and tolerated its long scans, and useless stats JUST for the missing episodes.
if this cannot look for missing episodes in everything it scans (not just picking and choosing what to scan), then there is no reason for me to even use it anymore
 

[hackthis02 129]

7 hours ago, DarkStar1977 said:

Bit of a pain ?

Unusable on large libraries like mine ...

 

29 minutes ago, crossfire13148 said:

I agree. with over 1400 tv shows, and almost 14,000 movies with 49 users, the scan taking almost 5 hours i could deal with...
now finding out the 1 thing i use this for (to list missing episodes) does not work, i am calling this over.
just for shits and giggles, i started randomly clicking shows and selecting "missing episodes" and there is A LOT of shows missing new episodes that this plug in failed to find.

BUT EMBY can look at tvdb and tell me what is missing, but this plug in cant?

just like the "cannot search other folders" which it seems to find 1 of the 2 folders on my main system with tv shows.
ironically, it used to even search my tv shows AND my DVR shows to tell me i was missing things.

so if it links to theTVDB, but doesnt use it then what is the point of having it link to it in the first place?
if this is supposed to show stats of tv shows, and cannot do that then what is it purpose?
if i cannot even give useful stats of the movies it scans why waste hours on scanning the movies?
ESPECIALLY when i cant even unselect what it scans, or what users.

i only had this plug in, and tolerated its long scans, and useless stats JUST for the missing episodes.
if this cannot look for missing episodes in everything it scans (not just picking and choosing what to scan), then there is no reason for me to even use it anymore
 

Yeah, I'm sorry. I see where you guys are coming from. I'll look around. But I don't think, or at least I haven't heard, of a way to tell Emby to get the latest TVDB data from within the plug-in.

[Neminem 1516]

2 hours ago, crossfire13148 said:

i only had this plug in, and tolerated its long scans, and useless stats JUST for the missing episodes.
if this cannot look for missing episodes in everything it scans (not just picking and choosing what to scan), then there is no reason for me to even use it anymore

Just use Sonarr and Radarr to do this.
Also get of your high horse, and keep you tone civil.
Dev is not employed by Emby, and working on this in his free time.
I have seen dev like this quit developing plugins for the community,
Because of unsatisfied abusive user.

Is that really what you want !!!

[DarkStar1977 119]

2 hours ago, hackthis02 said:

 

Yeah, I'm sorry. I see where you guys are coming from. I'll look around. But I don't think, or at least I haven't heard, of a way to tell Emby to get the latest TVDB data from within the plug-in.

It's not your fault, this all was broken when the emby team removed upcoming and missing episodes from the DB.

We appreciate the effort you've done.

We're trying to get the attentinon of the emby team to revert this mess.

[TeamB 2438]

8 hours ago, hackthis02 said:

 

Yeah, I'm sorry. I see where you guys are coming from. I'll look around. But I don't think, or at least I haven't heard, of a way to tell Emby to get the latest TVDB data from within the plug-in.

First, there is absolutely no need for you to apologise for this.

I am not sure what it is with this community, you never get people just saying thanks, or it's all working great, it's always, "You suck, and your plugin has ruined my life"

I get the feeling that because the base product costs a reasonable amount of $$$ that users feel that should also cover the plugins and there should be no need for them to show gratitude to the 3rd party devs for the time, effort and expertise that they put into creating and keeping the plugins working.

Before everyone gets on their high horse, yes there are a lot of grateful and helpful users in this community, a lot have posted to this thread, it just feels like the loud minority can ruin your day as a 3rd party dev and that ruins it for everyone since that can kill your enthusiasm.

Edited February 14, 2025 by TeamB

[Luke 42077]

9 hours ago, hackthis02 said:

 

Yeah, I'm sorry. I see where you guys are coming from. I'll look around. But I don't think, or at least I haven't heard, of a way to tell Emby to get the latest TVDB data from within the plug-in.

I wouldn’t suggest looking at the json files directly. I would use the provider manager methods. You can get all episodes from Internet metadata from there.

[DarkStar1977 119]

2 hours ago, Luke said:

I wouldn’t suggest looking at the json files directly. I would use the provider manager methods. You can get all episodes from Internet metadata from there.

Yes let's gonna make the developer that made the plugin to improve emby now to study  as well Thetvdb api just to re-download all the information that is already in the emby database because the missing and upcoming episodes have been removed from there !!!

Potentially thousands of files every day needed to be downloaded or checked to see if had changed just to present proper values regarding missing episodes and emby team will give us all for free a 4TB SSD HD for that to every single user !!!!

(Sarcasm)

¬¬

I have a better idea, let's all emby users downgrade to version 4.7.13 and reinstall plugin version 3.0.0 that worked together like a charm with all the missing and upcoming episodes in the emby DB, and with the extras not placed in Season 0 and with the ability to decide if you want to see specials inside seasons or not and not just the ones that are labeled as "critial to story" because emby team decided that, and don't upgrade again until all this changes are reverted.

How does this sound ?

Edited February 15, 2025 by DarkStar1977

[Luke 42077]

4 hours ago, DarkStar1977 said:

Yes let's gonna make the developer that made the plugin to improve emby now to study  as well Thetvdb api just to re-download all the information that is already in the emby database because the missing and upcoming episodes have been removed from there !!!

Potentially thousands of files every day needed to be downloaded or checked to see if had changed just to present proper values regarding missing episodes and emby team will give us all for free a 4TB SSD HD for that to every single user !!!!

(Sarcasm)

¬¬

I have a better idea, let's all emby users downgrade to version 4.7.13 and reinstall plugin version 3.0.0 that worked together like a charm with all the missing and upcoming episodes in the emby DB, and with the extras not placed in Season 0 and with the ability to decide if you want to see specials inside seasons or not and not just the ones that are labeled as "critial to story" because emby team decided that, and don't upgrade again until all this changes are reverted.

How does this sound ?

I said use internal plugin api's, not query tvdb directly.

It will do is solve the flood of file not found errors that you always see from the stats operations.

[Luke 42077]

23 hours ago, Junglejim said:

I didn't refresh the library metadata, I just selected missing episodes in the Metadata Manager. It only took like 60 seconds to sort things out. Then I ran the statistics shedule.

A bit of a pain I know.  

If the plugin used the internal api's to get this information, then you wouldn't have to click on the metadata manager first in order to generate the json that it depends on.

            var libraryOptions = LibraryManager.GetLibraryOptions(series);

			// get all episodes from tvdb
            var allEpisodes = await ProviderManager.GetAllEpisodes(series, libraryOptions, cancellationToken).ConfigureAwait(false);

			// get episodes in library
			var episodesInLibrary = series.GetItemList(new InternalItemsQuery
    		{
       			 IncludeItemTypes = new[] { typeof(Episode).Name },
        			Recursive = true

    		});

 

[crossfire13148 29]

9 hours ago, DarkStar1977 said:

I have a better idea, let's all emby users downgrade to version 4.7.13 and reinstall plugin version 3.0.0 that worked together like a charm with all the missing and upcoming episodes in the emby DB, and with the extras not placed in Season 0 and with the ability to decide if you want to see specials inside seasons or not and not just the ones that are labeled as "critial to story" because emby team decided that, and don't upgrade again until all this changes are reverted.

How does this sound ?

Sounds Great, if i can get it to work like that.
roll back plugins, server auto updates them
so if we set server back to what worked, the plugins would still update and break it all...

[crossfire13148 29]

5 hours ago, Luke said:

If the plugin used the internal api's to get this information, then you wouldn't have to click on the metadata manager first in order to generate the json that it depends on.

This is one of the things we have been complaining about.
as well as the "lets pick which specials are important" and the "lets FORCE specials to be in the season folders" where before we could uncheck that box
and for months pointing out the wrong "math-ing" in the missing episodes where it is counting the specials as normal episodes

i am looking for just this to be working the way it was before, when it worked. Instead of having to go through manually to "trigger" what the plug in will look for

as i am NOT going to "refresh" 13,776 movies files (to include extras) and 85,053 Episodes (to include specials) every day to make sure this plug in does what it is supposed to be doing.

[DarkStar1977 119]

22 minutes ago, crossfire13148 said:

Sounds Great, if i can get it to work like that.
roll back plugins, server auto updates them
so if we set server back to what worked, the plugins would still update and break it all...

You can always download the plugin source code, modify the version number of the plugin that's quite simple and deploy a custom dll as I did in Gamebrowser:

If the version deployed is bigger than the update one, will not update

Edited February 15, 2025 by DarkStar1977

[crossfire13148 29]

1 minute ago, DarkStar1977 said:

You can always download the plugin source code, modify the version of the plugin that's quite simple and deploy a custom dll as I did in Gamebrowser:If the version deployed is bigger than the update one, will not update

 

Trust me, thought about it. Especially to strip out everything i didnt need.
but dont know the emby plugin programming as well as i would like to!
so just stayed hands off...for now anyway!

[hackthis02 129]

12 hours ago, Luke said:

If the plugin used the internal api's to get this information, then you wouldn't have to click on the metadata manager first in order to generate the json that it depends on.

            var libraryOptions = LibraryManager.GetLibraryOptions(series);

			// get all episodes from tvdb
            var allEpisodes = await ProviderManager.GetAllEpisodes(series, libraryOptions, cancellationToken).ConfigureAwait(false);

			// get episodes in library
			var episodesInLibrary = series.GetItemList(new InternalItemsQuery
    		{
       			 IncludeItemTypes = new[] { typeof(Episode).Name },
        			Recursive = true

    		});

 

Thanks @LukeI was going to hit you up to see if there was any demo project or documentation I missed that would help. I'll take a look at this and message you if I have any remaining questions.

[Brazer 42]

Hi @hackthis02. On my PROD Emby server is see there was a statistics plugin update to version 3.3.2.2, but now the task is failing. Sorry if this is not the correct place to report the error. As this is not a beta problem I did not want to post it in the beta channel. 
 

2025-02-22 00:00:00.008 Info App: Emby Server Version: 4.8.10.0
2025-02-22 00:00:00.009 Info App: Emby
	Command line: /app/emby/system/EmbyServer.dll -programdata /config -ffdetect /app/emby/bin/ffdetect -ffmpeg /app/emby/bin/ffmpeg -ffprobe /app/emby/bin/ffprobe -restartexitcode 3
	Operating system: Linux version 6.8.0-53-generic (buildd@lcy02-amd64-046) (x86_64-linux-gnu-gcc-13 (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0, GNU ld (GNU Binutils for Ubunt
	Framework: .NET 6.0.31
	OS/Process: x64/x64
	Runtime: app/emby/system/System.Private.CoreLib.dll
	Processor count: 48
	Data path: /config
	Application path: /app/emby/system
2025-02-22 00:00:00.009 Info App: Logs path: /config/logs
2025-02-22 00:00:00.009 Info App: Cache path: /config/cache
2025-02-22 00:00:00.009 Info App: Internal metadata path: /config/metadata
2025-02-22 00:00:00.009 Info App: Transcoding temporary files path: /appdata/transcode-temp/transcoding-temp
2025-02-22 00:00:00.009 Info App: Plugins:
	Backup & Restore 1.7.0.0
	Bluray Folder Support 1.0.2.0
	Chapter API 1.3.0.11
	Cinema Intros 1.0.47.0
	CoverArt 4.1.28.0
	Disk Space 1.0.6.4
	DLNA 1.4.7.0
	Dvd Folder Support 1.0.0.0
	Emby Guide Data 1.0.18.0
	Fanart.tv 1.0.16.0
	M3U TV Tuner 1.0.38.0
	MovieDb 1.8.0.0
	MusicBrainz 1.0.24.0
	Nfo Metadata 1.0.82.0
	OMDb 1.0.21.0
	Open Subtitles 1.0.63.0
	Playback Reporting 2.1.0.5
	Port Mapper 1.2.8.0
	Statistics 3.3.2.2
	Studio Images 1.0.3.0
	TheAudioDb 1.0.18.0
	TheTVDB 1.5.8.0
	Trailers 1.3.9.0
	Webhooks 1.0.35.0
	XmlTV 1.2.0.0
.......
2025-02-22 08:37:49.298 Info OpenSubtitles: Logging into OpenSubtitles-Emby
2025-02-22 08:37:49.302 Info HttpClient: GET https://api.opensubtitles.com/api/v1/subtitles?languages=en&moviehash=2a21c3391cc4f820
2025-02-22 08:37:49.328 Info TheMovieDb: MovieDbProvider: Finding id for item: The Departed
2025-02-22 08:37:49.328 Info HttpClient: GET https://api.themoviedb.org/3/search/movie?api_key=x_secret2_x&query=The Departed&language=en-GB&year=2006
2025-02-22 08:37:49.428 Info HttpClient: GET https://api.themoviedb.org/3/movie/1422?api_key=x_secret2_x&append_to_response=alternative_titles,reviews,casts,releases,images,keywords,trailers&language=en-GB&include_image_language=en-GB,null
2025-02-22 08:37:49.455 Info HttpClient: GET https://api4.thetvdb.com/v4/search?type=movie&q=tt0407887&remote_id=tt0407887
2025-02-22 08:37:49.600 Info HttpClient: GET https://api4.thetvdb.com/v4/movies/590/extended?meta=translations
2025-02-22 08:37:49.767 Info HttpClient: GET https://artworks.thetvdb.com/banners/movies/590/posters/2122523.jpg
2025-02-22 08:37:49.788 Info HttpClient: GET https://artworks.thetvdb.com/banners/v4/movie/590/clearlogo/6124dc988bd62.png
2025-02-22 08:37:49.804 Info HttpClient: GET https://artworks.thetvdb.com/banners/v4/movie/590/backgrounds/62bc02bf3c5e6.jpg
2025-02-22 08:37:49.823 Info HttpClient: GET https://webservice.fanart.tv/v3/movies/1422?api_key=x_secret3_x
2025-02-22 08:37:49.842 Info HttpClient: GET https://assets.fanart.tv/fanart/movies/1422/moviethumb/the-departed-503be9147a8de.jpg
2025-02-22 08:37:51.884 Info QuickImageSeriesExtractor: ProcessRun 'quick-extract-imageseries' Execute: /app/emby/bin/ffmpeg -f matroska -threads 1 -skip_interval 10 -copyts -i file:"/data/movies/The Departed (2006)/The Departed (2006) Bluray-1080p.mkv" -an -sn -vf "scale=w=320:h=133" -vsync cfr -r 0.1 -f image2 "/config/cache/temp/5ef8b1c81a4d40eaab040e35528d5565/img_%05d.jpg"
2025-02-22 08:38:19.668 Error TaskManager: Error
	*** Error Report ***
	Version: 4.8.10.0
	Command line: /app/emby/system/EmbyServer.dll -programdata /config -ffdetect /app/emby/bin/ffdetect -ffmpeg /app/emby/bin/ffmpeg -ffprobe /app/emby/bin/ffprobe -restartexitcode 3
	Operating system: Linux version 6.8.0-53-generic (buildd@lcy02-amd64-046) (x86_64-linux-gnu-gcc-13 (Ubuntu 13.3.0-6ubuntu2~24.04) 13.3.0, GNU ld (GNU Binutils for Ubunt
	Framework: .NET 6.0.31
	OS/Process: x64/x64
	Runtime: app/emby/system/System.Private.CoreLib.dll
	Processor count: 48
	Data path: /config
	Application path: /app/emby/system
	System.ArgumentNullException: System.ArgumentNullException: Value cannot be null. (Parameter 'key')
	   at System.Collections.Generic.Dictionary`2.FindValue(TKey key)
	   at System.Collections.Generic.Dictionary`2.TryGetValue(TKey key, TValue& value)
	   at Statistics.Helpers.Calculator.CalculateMovieQualityList()
	   at Statistics.ScheduledTasks.CalculateStatsTask.MediaBrowser.Model.Tasks.IScheduledTask.Execute(CancellationToken cancellationToken, IProgress`1 progress)
	   at Emby.Server.Implementations.ScheduledTasks.ScheduledTaskWorker.ExecuteInternal(TaskOptions options)
	Source: System.Private.CoreLib
	TargetSite: Void ThrowArgumentNullException(System.ExceptionArgument)
	
2025-02-22 08:38:19.668 Info TaskManager: Calculate statistics for all users Failed after 4 minute(s) and 47 seconds

 

[robiahuca 1]

3.3.2.2 update failure:

 

Value cannot be null. (Parameter 'key') at System.Collections.Generic.Dictionary`2.FindValue(TKey key) at System.Collections.Generic.Dictionary`2.TryGetValue(TKey key, TValue& value) at Statistics.Helpers.Calculator.CalculateMovieQualityList() at Statistics.ScheduledTasks.CalculateStatsTask.MediaBrowser.Model.Tasks.IScheduledTask.Execute(CancellationToken cancellationToken, IProgress`1 progress) at Emby.Server.Implementations.ScheduledTasks.ScheduledTaskWorker.ExecuteInternal(TaskOptions options)

[crossfire13148 29]

7 hours ago, robiahuca said:

3.3.2.2 update failure:

 

Value cannot be null. (Parameter 'key') at System.Collections.Generic.Dictionary`2.FindValue(TKey key) at System.Collections.Generic.Dictionary`2.TryGetValue(TKey key, TValue& value) at Statistics.Helpers.Calculator.CalculateMovieQualityList() at Statistics.ScheduledTasks.CalculateStatsTask.MediaBrowser.Model.Tasks.IScheduledTask.Execute(CancellationToken cancellationToken, IProgress`1 progress) at Emby.Server.Implementations.ScheduledTasks.ScheduledTaskWorker.ExecuteInternal(TaskOptions options)

the split tasks,
just ran the "tv series" and got a bunch of 0/0 on the shows
been trying the second task to run for users, and same issues as above,
even debug log isnt showing anything useful

[hackthis02 129]

I'm traveling this week. So It's possible  I won't be able to fix it in a timely manner. I've removed the newest version from the system. If you are having issues revert back and I'll push a fix soon.

Edited February 22, 2025 by hackthis02

[vincen 71]

Hi

 

Since few days it's no more able to generate statistics. I have an automated task for it, it runs during 90 minutes then fail with that error:

Value cannot be null. (Parameter 'key') at System.Collections.Generic.Dictionary`2.FindValue(TKey key) at System.Collections.Generic.Dictionary`2.TryGetValue(TKey key, TValue& value) at Statistics.Helpers.Calculator.CalculateMovieQualityList() at Statistics.ScheduledTasks.CalculateStatsTask.MediaBrowser.Model.Tasks.IScheduledTask.Execute(CancellationToken cancellationToken, IProgress`1 progress) at Emby.Server.Implementations.ScheduledTasks.ScheduledTaskWorker.ExecuteInternal(TaskOptions options)

Thanks

@vincen

Vincèn

[Neminem 1516]

Is that from this plugin, if it is post here

 

[crossfire13148 29]

22 hours ago, vincen said:

Hi

 

Since few days it's no more able to generate statistics. I have an automated task for it, it runs during 90 minutes then fail with that error:

Value cannot be null. (Parameter 'key') at System.Collections.Generic.Dictionary`2.FindValue(TKey key) at System.Collections.Generic.Dictionary`2.TryGetValue(TKey key, TValue& value) at Statistics.Helpers.Calculator.CalculateMovieQualityList() at Statistics.ScheduledTasks.CalculateStatsTask.MediaBrowser.Model.Tasks.IScheduledTask.Execute(CancellationToken cancellationToken, IProgress`1 progress) at Emby.Server.Implementations.ScheduledTasks.ScheduledTaskWorker.ExecuteInternal(TaskOptions options)

Thanks

@vincen

Vincèn

 

On 2/22/2025 at 3:29 PM, hackthis02 said:

I'm traveling this week. So It's possible  I won't be able to fix it in a timely manner. I've removed the newest version from the system. If you are having issues revert back and I'll push a fix soon.

 

[crossfire13148 29]

20 hours ago, Neminem said:

Is that from this plugin, if it is post here

 

kind of! lol
THAT plug in was left absent, @hackthis02then took over and revived it
since then, he has been amazing on it. unfortunately a few issues have crept in that a few of us and him have been working on fixing.
stay tuned, as he is traveling right now, but he has been in high gear trying to fix this!

[ianmcleish 4]

Dumb question I am sure, but I have been having issues with statistics schedule failing to update. I copied and google the error which brought me to the first page of this topic, which says this is no longter going to be supported since 2016. So that leaves me a little confused. I uninstalled the plugin and checked the one I had installed, it is the same one.

So. Is this still supported or not. I imagine it is, given what I have seen of the pages, but why does the first post on page one say differently?