Baenwort 124 Posted Saturday at 05:42 PM Posted Saturday at 05:42 PM I've make sure CPU limit is 100, DMP is on, and I've set what I can figure out to Parallels processing. However, it doesn't seem to be using much resources on my server as I'm only seeing 15-20% resource usage. The server is at very low load at the moment with only ~4% cpu usage from other processes in other jails. The settings I've adjusted:
yocker 1841 Posted Saturday at 09:18 PM Author Posted Saturday at 09:18 PM (edited) @Baenwort Looking at number of threads you have available for that CPU 30% usage sounds about right. The FFmpeg usage is actually rather bursty so any CPU monitoring tool might not report it right either. I can look into making some more "dedicated machine" settings to really let everything stretch it legs. Like for example increase batch size, looking into getting it to work with multiple tesseracts instances at once. Atm. it's set rather conservative to make sure it wouldn't bog down peoples servers when running. For now you can increase the speed a bit by disabling "Optimized Predictive Sampling in the OCR OCR Enhancements tab. Edited Saturday at 09:53 PM by yocker
Baenwort 124 Posted Saturday at 10:43 PM Posted Saturday at 10:43 PM 1 hour ago, yocker said: @Baenwort Looking at number of threads you have available for that CPU 30% usage sounds about right. The FFmpeg usage is actually rather bursty so any CPU monitoring tool might not report it right either. I can look into making some more "dedicated machine" settings to really let everything stretch it legs. Like for example increase batch size, looking into getting it to work with multiple tesseracts instances at once. Atm. it's set rather conservative to make sure it wouldn't bog down peoples servers when running. For now you can increase the speed a bit by disabling "Optimized Predictive Sampling in the OCR OCR Enhancements tab. The CPU used percentage isn't 30% as the FreeBSD htop command doesn't use 100% as the max but rather 100 x number of threads. If you look at the top of the htop window you will see most threads are under 30%. The CPU% column is the percent of a thread that is being used by that process. If a thread is using multiple threads fully then the percentage will show greater than 100. I've disabled that and we'll see what the new calculation for time remaining levels out at.
yocker 1841 Posted Saturday at 11:02 PM Author Posted Saturday at 11:02 PM 16 minutes ago, Baenwort said: The CPU used percentage isn't 30% as the FreeBSD htop command doesn't use 100% as the max but rather 100 x number of threads. If you look at the top of the htop window you will see most threads are under 30%. The CPU% column is the percent of a thread that is being used by that process. If a thread is using multiple threads fully then the percentage will show greater than 100. I've disabled that and we'll see what the new calculation for time remaining levels out at. I meant to write 20% as you mentioned but guess i hit 3 instead of 2. Disabling it should speed it up a bit since it's an extra "detection method" used before the actual detection. I should make it disabled by default tbh. I've added what we discussed to my todo list and will start work on it next.
yocker 1841 Posted Sunday at 02:49 PM Author Posted Sunday at 02:49 PM @Baenwort did you see an improvement with the feature turned off?
yocker 1841 Posted 59 minutes ago Author Posted 59 minutes ago @BaenwortI have added some improvements, they are in the latest beta in the catalog. Biggest improvement is being able to run multiple instances of local Tesseract detections.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now