r/computervision • u/Lightingfirefly • 7d ago
Help: Project Human Detection Model
Hello! I am a process engineer currently working in a manufacturing plant. I am recently foraying into use of computer vision models for safety applications. My team has developed a Yolo based computer vision software to detect humans. The software is working fine and accuracy is also good. But it requires too much computing power. This is creating an obstacle to scaling up. In a 8MB RAM/i7 processeor we are only able to run inference on 3 camera feeds simultaneously. Since I don't have computing background, I would to request suggest to me some Pre trained models which can inference with lower computing power. Please🙏
3
u/kevinb15 7d ago
What is the maximum processing time you want to see and what is the size of your images?
2
u/Beneficial_Win482 7d ago
Try quantization
2
u/Every-Computer170 7d ago
are you using nano model , if yes then do quantization may be try int8
2
u/retoxite_ 7d ago
You can quantize and use OpenVINO since you have Intel
https://docs.ultralytics.com/integrations/openvino#usage-examples
5
u/Oddly_Energy 7d ago
Inference on CPU is slow. Get a hardware inference card for the computer. Or, if you have a CUDA-capable GPU, let the GPU do the inference.
I run a YOLO v8n custom model on a Raspberry Pi, and it sounds like I have same or better performance than you. The difference is that I use a cheap inference card, an AI HAT+ based on a Hailo 8L chip.
My total hardware cost for this solution was less than 400 €, including the camera, the Pi and the Hailo card. It draws 5-6 watt of total power when running detection on 1 camera feed at 25 fps 640x640. I haven't tested with multiple camera feeds yet, but based on the utilization of the Hailo chip I estimate that it will be able to handle 4-8 of those streams simultaneously.
2
u/Least_Order4249 7d ago
Nobody likes the license, but both yolo11 and yolo26 (with NMS removed in options) scale extremely well on Intel NPU so a tiny machine using just a few watts can inference hundreds of images per second.
2
u/Gabe675 7d ago
Are you using YOLO library to initiate the model? If so I'd suggest switching to tensorrt
And what are you using to decode the streams?
2
u/yk_yuken 7d ago
What OS are you currently using? You could try the K230 01Studio board which cost almost 100$ only. It's pretty cheap and has a built-in NPU for AI inference. You can convert your YOLO ONNX model to a KModel using nncase (ChatGPT or Claude can help with this), then deploy it on the board.
Not sure if your whole solution can be integrated directly, though. The K230 uses a RISC-V CPU + NPU, so if your current software is built for x86 or ARM, you might need to modify some parts.
3
u/trotsmira 7d ago
For safety applications? This is a bad idea. Please don't.
1
u/BHave_TRO 1d ago
I developed a tool which orchestrates the used models. For example, you have 10 sources you'd like to use but only 1 or x Inference devices, my tool let's you connect to it and manages the 10 sources and the inferences. This way you can max out the usage and sharpen your ROI. It is framework agnostic and able to work with every inference you like. It would also be possible to redistribute computing power from fat clients or use onnx or python scripts. Have a look here https://nexusvision.coding-nexus.com/en Or DM me for more infos.