radeon 755 Posted September 10, 2024 Author Posted September 10, 2024 Actually, there is two things going on there in that log. The 50 mb file would be correct. I have the upper limit for theme songs at 50ish. The other issue is the index one above where it's trying to find a file that no longer exists on the host.
apachelance 12 Posted September 10, 2024 Posted September 10, 2024 5 minutes ago, radeon said: Actually, there is two things going on there in that log. The 50 mb file would be correct. I have the upper limit for theme songs at 50ish. The other issue is the index one above where it's trying to find a file that no longer exists on the host. 50 MB for a theme song would be very big. If you are using ffmpeg it should be possible to transform it into a small mp3 file (eg using 128 or 192 kbit/s)
radeon 755 Posted September 10, 2024 Author Posted September 10, 2024 Problem is some are an hour or so long which is what's prodicing the massive files. I'd be more inclined to bin off the 50 for something more like 25, remove those from the server and likely see them replaced for other people's themes at the smaller file size now they can get through the filters whilst the bigger files are now being blocked. The problem is there is going to be a window where people are running the older version which will still allow the bigger files to be uploaded so I'll need to keep going onto the host and deleting the bigger files as they upload. Eventually it'll taper off and we'll be left with more manageable file sizes
Painkiller88 248 Posted September 10, 2024 Posted September 10, 2024 3 minutes ago, radeon said: Problem is some are an hour or so long which is what's prodicing the massive files. I'd be more inclined to bin off the 50 for something more like 25, remove those from the server and likely see them replaced for other people's themes at the smaller file size now they can get through the filters whilst the bigger files are now being blocked. The problem is there is going to be a window where people are running the older version which will still allow the bigger files to be uploaded so I'll need to keep going onto the host and deleting the bigger files as they upload. Eventually it'll taper off and we'll be left with more manageable file sizes any chance to force people to update with a popup or deny uploading from old versions? Or set an upload limit on the serverside for audio files, just an idea
radeon 755 Posted September 10, 2024 Author Posted September 10, 2024 Emby itself will prompt users to update fairly quickly and I think I might just stop the indexer from updating to log the new files for around a week then just go in and delete anything bigger than the limits. Theme videos have an upper limit of around 100mb Theme Songs are set at around 50mb Do you think I should reduce those limits at all?
Painkiller88 248 Posted September 10, 2024 Posted September 10, 2024 6 minutes ago, radeon said: Emby itself will prompt users to update fairly quickly and I think I might just stop the indexer from updating to log the new files for around a week then just go in and delete anything bigger than the limits. Theme videos have an upper limit of around 100mb Theme Songs are set at around 50mb Do you think I should reduce those limits at all? i just went through all my movie themes and i don't have any theme.mp3 files bigger than 10MB so i think 15-20MB for audio files should be more than enough as i don't think someone will use flac files or something else. I also checked my trailers and i have indeed a trailer hitting 100mb (99.6MB for a 2:23min trailer) so maybe 150MB for movies would be good. I would not focus too much on the movie trailers, because if someone thinks the trailer is too big or too long, he could easily download a smaller one manually from youtube for this special movie. People have to decide how much space they have for trailers and themes but i think you agree with songs larger 20 or in the actual case 50MB must be enough for a theme song.
radeon 755 Posted September 10, 2024 Author Posted September 10, 2024 Ok cool, I'll push another release with a 20mb upload limit, give it a few days to roll out, flush out all the bigger themes, reindex and we should be good to go. 2
cbdudek 17 Posted September 10, 2024 Posted September 10, 2024 9 minutes ago, Painkiller8818 said: I also checked my trailers and i have indeed a trailer hitting 100mb (99.6MB for a 2:23min trailer) so maybe 150MB for movies would be good. I have had issues with the "download local movie theme videos" scheduled task when it comes to completing. The thing will run for a few hours and then freeze. I don't know what causes it to freeze, but I just stopped running the task because I got tired of seeing the process frozen. Do you think it could be a video that is over the limit that is freezing things up? Maybe you or @radeonmay know the answer to this one. I did leave a post about this in the local movie theme videos section, but there is no resolution yet.
radeon 755 Posted September 10, 2024 Author Posted September 10, 2024 It'll likely be to do with these massive files which I'm removing so should help if not resolved your issue too.
Painkiller88 248 Posted September 10, 2024 Posted September 10, 2024 1 minute ago, cbdudek said: I have had issues with the "download local movie theme videos" scheduled task when it comes to completing. The thing will run for a few hours and then freeze. I don't know what causes it to freeze, but I just stopped running the task because I got tired of seeing the process frozen. Do you think it could be a video that is over the limit that is freezing things up? Maybe you or @radeonmay know the answer to this one. I did leave a post about this in the local movie theme videos section, but there is no resolution yet. if you are new using the plugin or if you have a lot of movies i could imagine it can take multiple runs to finish everything. My suggestion is to set a schedule for the movie download once a day and just let it like that for a week. if the process stucks, i am sure there is a normal timeout when the process gets killed due overtime, so just give it a week check the modified date for your movies, i am sure there will be more and more trailers over the time. this is how i would handle this problem
cbdudek 17 Posted September 10, 2024 Posted September 10, 2024 40 minutes ago, Painkiller8818 said: if you are new using the plugin or if you have a lot of movies i could imagine it can take multiple runs to finish everything. My suggestion is to set a schedule for the movie download once a day and just let it like that for a week. if the process stucks, i am sure there is a normal timeout when the process gets killed due overtime, so just give it a week check the modified date for your movies, i am sure there will be more and more trailers over the time. this is how i would handle this problem I do have a lot of movies. About 1,200 of them. That being said, I have movie theme videos for more than half of them. I never let the process just run. I suppose I could do that for a week and see how it goes. After 2 days of the progress bar not moving, I just thought that the process was frozen. Maybe that isn't the case. Or maybe I wait until @radeondeletes all those large videos and then I kick off the process and see what happens.
Painkiller88 248 Posted September 11, 2024 Posted September 11, 2024 The plugin seems to work now, but i recorgnized it is now downloading MKA files for all movies instead of mp3. Maybe this is a coincidence but i never had mka files for my movies so maybe someone really uploaded mka files as audio theme files
cbdudek 17 Posted September 11, 2024 Posted September 11, 2024 (edited) After the update, I started running the plugins. The "Download Local Movie Theme Videos" plugin has been at 49.8% for a few hours now. I am going to wait more than a couple days this time and give it ample time to run. Maybe it is indeed doing something. Wish I could see a logfile or something that would tell me what it is doing, if anything. I am checking the Emby logs now and I see that it is indeed doing something. Edited September 11, 2024 by cbdudek
radeon 755 Posted September 12, 2024 Author Posted September 12, 2024 On 11/09/2024 at 07:50, Painkiller8818 said: The plugin seems to work now, but i recorgnized it is now downloading MKA files for all movies instead of mp3. Maybe this is a coincidence but i never had mka files for my movies so maybe someone really uploaded mka files as audio theme files Ya, that was the matroska files that weren't being handled before. I presume someone has just added a load of mka's
apachelance 12 Posted September 15, 2024 Posted September 15, 2024 On 9/12/2024 at 8:39 PM, radeon said: Ya, that was the matroska files that weren't being handled before. I presume someone has just added a load of mka's Will you add a feature that transforms MKAs to MP3s in order to reduce file size?
Painkiller88 248 Posted September 20, 2024 Posted September 20, 2024 Another thing i recorgnized is, that the plugin starts downloading the theme song, and afterwards, it is checking of there already exists a theme.mp3, so it would improve the process and the speed a lot, if the check if the file already exists happens before the downloading, normalizing etc. 2024-09-20 09:30:13.546 Info App: Movie Theme Songs - Found movie theme song for Der König der Löwen 2024-09-20 09:30:13.547 Info HttpClient: GetTempFileResponse url: http://download1336.mediafire.com/s17w6kzhykpgHA1kKgAmayPy6dmu79sAA7YLCwVj8PvVOL0JClQj1yDfrrMoqzqAcqWX2US-uUzG1FxV0LwPs5Kh02DoTvGadnSv8Sleaon_-zlWXez3UyeLR5XFXrHLx5yqfDYXBi950w33XSobvaXPjDYI6TmUxe84cV13cgSZ/u1x8a07skft3r7a 2024-09-20 09:30:13.547 Info HttpClient: GET http://download1336.mediafire.com/s17w6kzhykpgHA1kKgAmayPy6dmu79sAA7YLCwVj8PvVOL0JClQj1yDfrrMoqzqAcqWX2US-uUzG1FxV0LwPs5Kh02DoTvGadnSv8Sleaon_-zlWXez3UyeLR5XFXrHLx5yqfDYXBi950w33XSobvaXPjDYI6TmUxe84cV13cgSZ/u1x8a07skft3r7a 2024-09-20 09:31:35.402 Info App: Movie Theme Songs - Moving C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata\cache\temp\5d411158-2698-4d8a-a332-64895bf58669.tmp to D:\Der Koenig der Loewen (2019)\theme.mp3 2024-09-20 09:31:35.403 Info App: Movie Theme Songs ffmpeg path : C:\Users\Painkiller\AppData\Roaming\Emby-Server\system\ffmpeg.exe 2024-09-20 09:31:35.403 Info App: Movie Theme Songs ffmpeg params : -i "C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata\cache\temp\5d411158-2698-4d8a-a332-64895bf58669.tmp" -t 10 -af volumedetect -f null – 2024-09-20 09:31:35.453 Info App: Movie Theme Songs ffmpeg path : C:\Users\Painkiller\AppData\Roaming\Emby-Server\system\ffmpeg.exe 2024-09-20 09:31:35.453 Info App: Movie Theme Songs ffmpeg params : -i "C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata\cache\temp\5d411158-2698-4d8a-a332-64895bf58669.tmp" -acodec libmp3lame -ac 2 -ar 44100 -ab 128000 -af "volume=0dB" "C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata\cache\temp\5d411158-2698-4d8a-a332-64895bf58669.tmp.mp3 2024-09-20 09:31:47.446 Info App: Movie Theme Songs - Volume Normalised Successfully 2024-09-20 09:31:47.469 Error App: Movie Theme Songs - Error downloading file from host *** Error Report *** Version: 4.8.8.0 Command line: C:\Users\Painkiller\AppData\Roaming\Emby-Server\system\EmbyServer.dll -noautorunwebapp Operating system: Microsoft Windows 10.0.19045 Framework: .NET 6.0.30 OS/Process: x64/x64 Runtime: C:/Users/Painkiller/AppData/Roaming/Emby-Server/system/System.Private.CoreLib.dll Processor count: 16 Data path: C:\Users\Painkiller\AppData\Roaming\Emby-Server\programdata Application path: C:\Users\Painkiller\AppData\Roaming\Emby-Server\system System.IO.IOException: System.IO.IOException: The file exists. at System.IO.FileSystem.MoveFile(String sourceFullPath, String destFullPath, Boolean overwrite) at System.IO.File.Move(String sourceFileName, String destFileName) at MovieThemeSongs.Search.LocalMovieThemeSongDownloader.DownloadMovieThemeSongForItem(BaseItem item, CancellationToken cancellationToken, String html, String data, String uploadedhtml, ILibraryManager libraryManager) Source: System.Private.CoreLib As you can see in the last few lines it is writing the file exists, but the download and all other stuff happens before this is checked. Just an idea to improve and speed up this process 1
radeon 755 Posted September 20, 2024 Author Posted September 20, 2024 I already do, in fact, I ask Emby to give me a list of all media without themes so there shouldn't be a case where the file already exists, that's just a final safety check. That's just a final check to confirm no file already exists. That would suggest you have something else going wrong or the request I make to emby isn't returning a valid request. Nothing to do with my plugin not being optimised
Painkiller88 248 Posted September 28, 2024 Posted September 28, 2024 (edited) Hi, speaking about the theme.mka files that got downloaded in masses last time. I found out, those files got downloaded even if there is already a theme.mp3 file in the movie folder. In my case it was for the movie "Aquaman 2" Edited September 28, 2024 by Painkiller8818
apachelance 12 Posted September 28, 2024 Posted September 28, 2024 @radeon Will you add a feature that transforms MKAs to MP3s in order to reduce file size?
zm098y 3 Posted September 30, 2024 Posted September 30, 2024 It ran normally in the previous version, but the new version caused CPU overload and there was no progress. I don't understand why the transcoding function was added. It is a heavy burden for an embyserver like me without a GPU. In fact, the space occupied by the entire media library can be completely ignored compared to those topic videos. embyserver-2.txt
zm098y 3 Posted September 30, 2024 Posted September 30, 2024 Dear developers, if you want to add functionality to MKV-mp4, it should be made optional rather than mandatory. This troubles me very much.
zm098y 3 Posted September 30, 2024 Posted September 30, 2024 在2024年9月15日晚上9:27,apachelance说: 为了减少文件大小,你会添加一个将MKA转换为MP3的功能吗? Compared with those movie collections, compressing the space occupied by theme.mkv is meaningless, but causes a heavy burden on the CPU.
radeon 755 Posted September 30, 2024 Author Posted September 30, 2024 On 28/09/2024 at 11:54, Painkiller8818 said: Hi, speaking about the theme.mka files that got downloaded in masses last time. I found out, those files got downloaded even if there is already a theme.mp3 file in the movie folder. In my case it was for the movie "Aquaman 2" That's something odd with emby then as it's reporting to me that a theme doesn't exist for that movie
radeon 755 Posted September 30, 2024 Author Posted September 30, 2024 On 28/09/2024 at 15:24, apachelance said: @radeon Will you add a feature that transforms MKAs to MP3s in order to reduce file size? Potentially, I'm thinking more about a server side processor that does it instead 1
radeon 755 Posted September 30, 2024 Author Posted September 30, 2024 5 hours ago, zm098y said: It ran normally in the previous version, but the new version caused CPU overload and there was no progress. I don't understand why the transcoding function was added. It is a heavy burden for an embyserver like me without a GPU. In fact, the space occupied by the entire media library can be completely ignored compared to those topic videos. embyserver-2.txt 439.14 kB · 1 download I don't do any additional transcoding, nothing has changed in that sense.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now