Jump to content

Recommended Posts

Posted

Actually, there is two things going on there in that log. The 50 mb file would be correct. I have the upper limit for theme songs at 50ish. 

The other issue is the index one above where it's trying to find a file that no longer exists on the host. 

apachelance
Posted
5 minutes ago, radeon said:

Actually, there is two things going on there in that log. The 50 mb file would be correct. I have the upper limit for theme songs at 50ish. 

The other issue is the index one above where it's trying to find a file that no longer exists on the host. 

50 MB for a theme song would be very big. If you are using ffmpeg it should be possible to transform it into a small mp3 file (eg using 128 or 192 kbit/s)

Posted

Problem is some are an hour or so long which is what's prodicing the massive files. I'd be more inclined to bin off the 50 for something more like 25, remove those from the server and likely see them replaced for other people's themes at the smaller file size now they can get through the filters whilst the bigger files are now being blocked.

 

The problem is there is going to be a window where people are running the older version which will still allow the bigger files to be uploaded so I'll need to keep going onto the host and deleting the bigger files as they upload. Eventually it'll taper off and we'll be left with more manageable file sizes

Painkiller88
Posted
3 minutes ago, radeon said:

Problem is some are an hour or so long which is what's prodicing the massive files. I'd be more inclined to bin off the 50 for something more like 25, remove those from the server and likely see them replaced for other people's themes at the smaller file size now they can get through the filters whilst the bigger files are now being blocked.

 

The problem is there is going to be a window where people are running the older version which will still allow the bigger files to be uploaded so I'll need to keep going onto the host and deleting the bigger files as they upload. Eventually it'll taper off and we'll be left with more manageable file sizes

any chance to force people to update with a popup or deny uploading from old versions?
Or set an upload limit on the serverside for audio files, just an idea

Posted

Emby itself will prompt users to update fairly quickly and I think I might just stop the indexer from updating to log the new files for around a week then just go in and delete anything bigger than the limits. 

 

Theme videos have an upper limit of around 100mb

Theme Songs are set at around 50mb

Do you think I should reduce those limits at all? 

Painkiller88
Posted
6 minutes ago, radeon said:

Emby itself will prompt users to update fairly quickly and I think I might just stop the indexer from updating to log the new files for around a week then just go in and delete anything bigger than the limits. 

 

Theme videos have an upper limit of around 100mb

Theme Songs are set at around 50mb

Do you think I should reduce those limits at all? 

i just went through all my movie themes and i don't have any theme.mp3 files bigger than 10MB so i think 15-20MB for audio files should be more than enough as i don't think someone will use flac files or something else.

I also checked my trailers and i have indeed a trailer hitting 100mb (99.6MB for a 2:23min trailer) so maybe 150MB for movies would be good.

I would not focus too much on the movie trailers, because if someone thinks the trailer is too big or too long, he could easily download a smaller one manually from youtube for this special movie.

People have to decide how much space they have for trailers and themes but i think you agree with songs larger 20 or in the actual case 50MB must be enough for a theme song.

Posted

Ok cool, I'll push another release with a 20mb upload limit, give it a few days to roll out, flush out all the bigger themes, reindex and we should be good to go. 

  • Like 2
Posted
9 minutes ago, Painkiller8818 said:

I also checked my trailers and i have indeed a trailer hitting 100mb (99.6MB for a 2:23min trailer) so maybe 150MB for movies would be good.

I have had issues with the "download local movie theme videos" scheduled task when it comes to completing.  The thing will run for a few hours and then freeze.  I don't know what causes it to freeze, but I just stopped running the task because I got tired of seeing the process frozen.  Do you think it could be a video that is over the limit that is freezing things up?  Maybe you or @radeonmay know the answer to this one.

I did leave a post about this in the local movie theme videos section, but there is no resolution yet.

Posted

It'll likely be to do with these massive files which I'm removing so should help if not resolved your issue too. 😁

Painkiller88
Posted
1 minute ago, cbdudek said:

I have had issues with the "download local movie theme videos" scheduled task when it comes to completing.  The thing will run for a few hours and then freeze.  I don't know what causes it to freeze, but I just stopped running the task because I got tired of seeing the process frozen.  Do you think it could be a video that is over the limit that is freezing things up?  Maybe you or @radeonmay know the answer to this one.

I did leave a post about this in the local movie theme videos section, but there is no resolution yet.

if you are new using the plugin or if you have a lot of movies i could imagine it can take multiple runs to finish everything.

My suggestion is to set a schedule for the movie download once a day and just let it like that for a week.

if the process stucks, i am sure there is a normal timeout when the process gets killed due overtime, so just give it a week check the modified date for your movies, i am sure there will be more and more trailers over the time.

this is how i would handle this problem

Posted
40 minutes ago, Painkiller8818 said:

if you are new using the plugin or if you have a lot of movies i could imagine it can take multiple runs to finish everything.

My suggestion is to set a schedule for the movie download once a day and just let it like that for a week.

if the process stucks, i am sure there is a normal timeout when the process gets killed due overtime, so just give it a week check the modified date for your movies, i am sure there will be more and more trailers over the time.

this is how i would handle this problem

I do have a lot of movies.  About 1,200 of them.  That being said, I have movie theme videos for more than half of them.  I never let the process just run.  I suppose I could do that for a week and see how it goes.  After 2 days of the progress bar not moving, I just thought that the process was frozen.  Maybe that isn't the case.

Or maybe I wait until @radeondeletes all those large videos and then I kick off the process and see what happens.  

Painkiller88
Posted

The plugin seems to work now, but i recorgnized it is now downloading MKA files for all movies instead of mp3.

Maybe this is a coincidence but i never had mka files for my movies so maybe someone really uploaded mka files as audio theme files

Posted (edited)

After the update, I started running the plugins.  The "Download Local Movie Theme Videos" plugin has been at 49.8% for a few hours now.  I am going to wait more than a couple days this time and give it ample time to run.  Maybe it is indeed doing something.  Wish I could see a logfile or something that would tell me what it is doing, if anything.  I am checking the Emby logs now and I see that it is indeed doing something.

Edited by cbdudek
Posted
On 11/09/2024 at 07:50, Painkiller8818 said:

The plugin seems to work now, but i recorgnized it is now downloading MKA files for all movies instead of mp3.

Maybe this is a coincidence but i never had mka files for my movies so maybe someone really uploaded mka files as audio theme files

Ya, that was the matroska files that weren't being handled before. I presume someone has just added a load of mka's

apachelance
Posted
On 9/12/2024 at 8:39 PM, radeon said:

Ya, that was the matroska files that weren't being handled before. I presume someone has just added a load of mka's

Will you add a feature that transforms MKAs to MP3s in order to reduce file size?

Painkiller88
Posted

Another thing i recorgnized is, that the plugin starts downloading the theme song, and afterwards, it is checking of there already exists a theme.mp3, so it would improve the process and the speed a lot, if the check if the file already exists happens before the downloading, normalizing etc.

 

2024-09-20 09:30:13.546 Info App: Movie Theme Songs - Found movie theme song for Der König der Löwen
2024-09-20 09:30:13.547 Info HttpClient: GetTempFileResponse url: http://download1336.mediafire.com/s17w6kzhykpgHA1kKgAmayPy6dmu79sAA7YLCwVj8PvVOL0JClQj1yDfrrMoqzqAcqWX2US-uUzG1FxV0LwPs5Kh02DoTvGadnSv8Sleaon_-zlWXez3UyeLR5XFXrHLx5yqfDYXBi950w33XSobvaXPjDYI6TmUxe84cV13cgSZ/u1x8a07skft3r7a
2024-09-20 09:30:13.547 Info HttpClient: GET http://download1336.mediafire.com/s17w6kzhykpgHA1kKgAmayPy6dmu79sAA7YLCwVj8PvVOL0JClQj1yDfrrMoqzqAcqWX2US-uUzG1FxV0LwPs5Kh02DoTvGadnSv8Sleaon_-zlWXez3UyeLR5XFXrHLx5yqfDYXBi950w33XSobvaXPjDYI6TmUxe84cV13cgSZ/u1x8a07skft3r7a
2024-09-20 09:31:35.402 Info App: Movie Theme Songs - Moving C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata\cache\temp\5d411158-2698-4d8a-a332-64895bf58669.tmp to D:\Der Koenig der Loewen (2019)\theme.mp3
2024-09-20 09:31:35.403 Info App: Movie Theme Songs ffmpeg path : C:\Users\Painkiller\AppData\Roaming\Emby-Server\system\ffmpeg.exe
2024-09-20 09:31:35.403 Info App: Movie Theme Songs ffmpeg params : -i "C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata\cache\temp\5d411158-2698-4d8a-a332-64895bf58669.tmp" -t 10 -af volumedetect -f null –
2024-09-20 09:31:35.453 Info App: Movie Theme Songs ffmpeg path : C:\Users\Painkiller\AppData\Roaming\Emby-Server\system\ffmpeg.exe
2024-09-20 09:31:35.453 Info App: Movie Theme Songs ffmpeg params : -i "C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata\cache\temp\5d411158-2698-4d8a-a332-64895bf58669.tmp" -acodec libmp3lame -ac 2 -ar 44100 -ab 128000 -af "volume=0dB" "C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata\cache\temp\5d411158-2698-4d8a-a332-64895bf58669.tmp.mp3
2024-09-20 09:31:47.446 Info App: Movie Theme Songs - Volume Normalised Successfully
2024-09-20 09:31:47.469 Error App: Movie Theme Songs - Error downloading file from host
*** Error Report ***
Version: 4.8.8.0
Command line: C:\Users\Painkiller\AppData\Roaming\Emby-Server\system\EmbyServer.dll -noautorunwebapp
Operating system: Microsoft Windows 10.0.19045
Framework: .NET 6.0.30
OS/Process: x64/x64
Runtime: C:/Users/Painkiller/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll
Processor count: 16
Data path: C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata
Application path: C:\Users\Painkiller\AppData\Roaming\Emby-Server\system
System.IO.IOException: System.IO.IOException: The file exists.
at System.IO.FileSystem.MoveFile(String sourceFullPath, String destFullPath, Boolean overwrite)
at System.IO.File.Move(String sourceFileName, String destFileName)
at MovieThemeSongs.Search.LocalMovieThemeSongDownloader.DownloadMovieThemeSongForItem(BaseItem item, CancellationToken cancellationToken, String html, String data, String uploadedhtml, ILibraryManager libraryManager)
Source: System.Private.CoreLib

As you can see in the last few lines it is writing the file exists, but the download and all other stuff happens before this is checked.


Just an idea to improve and speed up this process :) 

  • Agree 1
Posted

I already do, in fact, I ask Emby to give me a list of all media without themes so there shouldn't be a case where the file already exists, that's just a final safety check. That's just a final check to confirm no file already exists. That would suggest you have something else going wrong or the request I make to emby isn't returning a valid request. Nothing to do with my plugin not being optimised 😉 

Painkiller88
Posted (edited)

Hi,

speaking about the theme.mka files that got downloaded in masses last time. I found out, those files got downloaded even if there is already a theme.mp3 file in the movie folder. In my case it was for the movie "Aquaman 2"

Edited by Painkiller8818
apachelance
Posted

@radeon Will you add a feature that transforms MKAs to MP3s in order to reduce file size?

Posted

It ran normally in the previous version, but the new version caused CPU overload and there was no progress. I don't understand why the transcoding function was added. It is a heavy burden for an embyserver like me without a GPU. In fact, the space occupied by the entire media library can be completely ignored compared to those topic videos.

embyserver-2.txt

Posted

Dear developers, if you want to add functionality to MKV-mp4, it should be made optional rather than mandatory. This troubles me very much.

Posted
在2024年9月15日晚上9:27,apachelance说:

为了减少文件大小,你会添加一个将MKA转换为MP3的功能吗?

Compared with those movie collections, compressing the space occupied by theme.mkv is meaningless, but causes a heavy burden on the CPU.

Posted
On 28/09/2024 at 11:54, Painkiller8818 said:

Hi,

speaking about the theme.mka files that got downloaded in masses last time. I found out, those files got downloaded even if there is already a theme.mp3 file in the movie folder. In my case it was for the movie "Aquaman 2"

That's something odd with emby then as it's reporting to me that a theme doesn't exist for that movie

Posted
On 28/09/2024 at 15:24, apachelance said:

@radeon Will you add a feature that transforms MKAs to MP3s in order to reduce file size?

Potentially, I'm thinking more about a server side processor that does it instead 

  • Agree 1
Posted
5 hours ago, zm098y said:

It ran normally in the previous version, but the new version caused CPU overload and there was no progress. I don't understand why the transcoding function was added. It is a heavy burden for an embyserver like me without a GPU. In fact, the space occupied by the entire media library can be completely ignored compared to those topic videos.

embyserver-2.txt 439.14 kB · 1 download

I don't do any additional transcoding, nothing has changed in that sense. 

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...