bennymac 47 Posted June 28, 2020 Author Posted June 28, 2020 (edited) 19 minutes ago, softworkz said: @bennymac Very weird situation. I have no idea what it could be. Let's go brute-force. I have prepared 7 command lines for you: C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -map 0:0 -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\test1.mkv" C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -map 0:0 -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 -c:a:0 copy -max_delay 5000000 -avoid_negative_ts disabled "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\test2.mkv" C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -an -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\test3.mkv" C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -an -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\test4.mkv" C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -map 0:1 -an -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\test5.mkv" C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -map 0:1 -an -sn -c:v:0 libx264 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\test6.mkv" C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -map 0:1 -an -sn -c:v:0 libx264 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -crf:v:0 23 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\test7.mkv" Please run each one for about 30s. Watch the CPU load and the fps and speed values in the ffmpeg output: Hey, No worries i appreciate your help. All tests are 200fps+ and Speed 10-12x On the very fast run it drops to 170fps and 7x Looks like i might have to format.. Edited June 28, 2020 by bennymac
softworkz 5066 Posted June 28, 2020 Posted June 28, 2020 OK. now try this one: (the original) C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -print_graphs_file "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\logs\ffmpeg-transcode-5929b4b6-146a-4c9a-ba16-b86ac8d2a112_1graph.txt" -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -map 0:0 -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2.m3u8" -segment_list_type m3u8 -segment_time 3 -segment_start_number 0 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2_%d.ts"
bennymac 47 Posted June 28, 2020 Author Posted June 28, 2020 10 minutes ago, softworkz said: OK. now try this one: (the original) C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -y -print_graphs_file "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\logs\ffmpeg-transcode-5929b4b6-146a-4c9a-ba16-b86ac8d2a112_1graph.txt" -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -map 0:0 -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2.m3u8" -segment_list_type m3u8 -segment_time 3 -segment_start_number 0 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2_%d.ts" Ok progress, here the problems arise?
softworkz 5066 Posted June 29, 2020 Posted June 29, 2020 OK, next one, let's call it A1 C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -map 0:0 -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2.m3u8" -segment_list_type m3u8 -segment_time 3 -segment_start_number 0 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2_%d.ts" And one more - A2 C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -map 0:0 -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2.m3u8" -segment_list_type m3u8 -segment_time 3 -segment_start_number 0 -individual_header_trailer 0 -write_header_trailer 0 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2_%d.ts"
bennymac 47 Posted June 29, 2020 Author Posted June 29, 2020 5 minutes ago, softworkz said: OK, next one, let's call it A1 C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -map 0:0 -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2.m3u8" -segment_list_type m3u8 -segment_time 3 -segment_start_number 0 -individual_header_trailer 0 -write_header_trailer 0 -segment_write_temp 1 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2_%d.ts" And one more - A2 C:\Users\Media\AppData\Roaming\Emby-Server\system\ffmpeg.exe -loglevel +timing -copyts -start_at_zero -f matroska,webm -c:v:0 h264 -i "E:\Movies\Jungle Beat The Movie (2020)\Jungle.Beat.The.Movie.2020.1080p.WEB-DL.H264.AC3-EVO.mkv" -filter_complex "[0:1]scale@f1=w=720:h=298[f1_out0]" -map [f1_out0] -map 0:0 -sn -c:v:0 libx264 -g:v:0 72 -maxrate:v:0 1616000 -bufsize:v:0 3232000 -sc_threshold:v:0 0 -keyint_min:v:0 72 -pix_fmt:v:0 yuv420p -preset:v:0 veryfast -profile:v:0 high -level:v:0 3.0 -x264opts:v:0 "subme=0:me_range=4:rc_lookahead=10:me=dia:no_chroma_me:8x8dct=0:partitions=none" -crf:v:0 23 -c:a:0 libmp3lame -ab:a:0 192000 -ac:a:0 2 -metadata:s:a:0 language=eng -filter:a:0 "volume=2" -disposition:a:0 default -max_delay 5000000 -avoid_negative_ts disabled -f segment -map_metadata -1 -map_chapters -1 -segment_format mpegts -segment_list "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2.m3u8" -segment_list_type m3u8 -segment_time 3 -segment_start_number 0 -individual_header_trailer 0 -write_header_trailer 0 "C:\Users\Media\AppData\Roaming\Emby-Server\programdata\transcoding-temp\FDA4D2_%d.ts" Ok, So the A2 screenshot gets 22 fps and A1 gets 12. I notice that the CPU isn't doing anything, other than a small spike...which seems to be the 4-5secs. What do you think doctor? Will she ever dance again?
softworkz 5066 Posted June 29, 2020 Posted June 29, 2020 It's the file creation and renaming operations. A1 writes to a *.tmp file first and renames then, A2 writes directly. You can further confirm this by increasing the -segment_time 3 In A2 like 6 - 12 - 24 - 60
bennymac 47 Posted June 29, 2020 Author Posted June 29, 2020 (edited) 17 minutes ago, softworkz said: It's the file creation and renaming operations. A1 writes to a *.tmp file first and renames then, A2 writes directly. You can further confirm this by increasing the -segment_time 3 In A2 like 6 - 12 - 24 - 60 Ok, so with each increase the fps doubles, 44, 77, 122, 200+ And the actual number of segment parts between the writing process increases. The image is at 60 segment time. Edited June 29, 2020 by bennymac
Solution softworkz 5066 Posted June 29, 2020 Solution Posted June 29, 2020 OK, so it's not file writing performance, it's file creation delay. I can think of three things that can cause this: Virus Scanner - Do you have one active? Can you deactivate? Some extension in Windows File Explorer To test this: Keep your command prompt open Open Task Manager Go to Details End all explorer.exe processes => until even the Windows taskbar has gone away RETRY in the command prompt (let's take A2) A Windows File System Driver Open a command prompt - as Adminisrator Run fltmc filters Run fltmc instances Then we can see what you got there Other things to try Try running the A2 command line from an Administrative command prompt Try modifying the output path of the A2 command to a different location, like c:\temp (create it) to a different harddisk Restart Windows in safe mode and retry A2 command Create a fresh user account (with admin privileges) and try running the command there Review Programs and Features to check whether you have installed something like that
bennymac 47 Posted June 30, 2020 Author Posted June 30, 2020 (edited) On 6/29/2020 at 10:47 AM, softworkz said: OK, so it's not file writing performance, it's file creation delay. I can think of three things that can cause this: Virus Scanner - Do you have one active? Can you deactivate? Some extension in Windows File Explorer To test this: Keep your command prompt open Open Task Manager Go to Details End all explorer.exe processes => until even the Windows taskbar has gone away RETRY in the command prompt (let's take A2) A Windows File System Driver Open a command prompt - as Adminisrator Run fltmc filters Run fltmc instances Then we can see what you got there Other things to try Try running the A2 command line from an Administrative command prompt Try modifying the output path of the A2 command to a different location, like c:\temp (create it) to a different harddisk Restart Windows in safe mode and retry A2 command Create a fresh user account (with admin privileges) and try running the command there Review Programs and Features to check whether you have installed something like that Hey @softworkz So updated Antivirus components, which updated the night before these problems happened was the cause of it all. They've had a behaving monitoring tweak that must be causing the file writing process you described. I've been using the Trend Worry-Free Business Security for 15+ years and haven't seen it interfere like this before. I had to resort to uninstalling it. Now everything is transcoding at normal speed. I can't thank you and @cayars enough for all your help! Greatly appreciate it. Edited June 30, 2020 by bennymac 1
Carlo 4561 Posted June 30, 2020 Posted June 30, 2020 Awesome, glad you got it figured out. Hey now that you know what program was responsible, maybe you can reinstall it for security purposes and flag the directories Emby users as "ignore" directories. That way it keeps it's grubby hands off your media but still provides security to the machine as a whole. You SHOULD send them a message letting them know how bad this new release "crippled" your media server as well so they can work on a fix.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now