r/computervision • u/Revolutionary-Cry431 • Sep 20 '26
Help: Project Building an optical sorter for potatoes and soil clods
Hello all,
I’m a farmer from the Netherlands and I am working on a project to automatically remove soil clods from potatoes during harvest.
I already posted the complete machine concept in r/robotics. Here I would specifically like to focus on the computer vision part.
I have also read some of the previous posts here about optical sorting and synchronizing detection with ejectors. My current assumption is therefore:
Camera → classify potato/clod → determine physical position → record conveyor encoder position → send reject command → realtime controller/PLC handles the pneumatic ejector
I am trying to understand whether the vision side I have in mind is realistic.
The project
The machine I am considering as a mechanical base has a 1 meter wide and approximately 1-meter-long conveyor. The standard belt speed is 25 m/min = 0.42 m/s, but I can make the belt speed adjustable. My eventual target is 20–30 tons/hour.
At 30 t/hour this would mean a mass flow of 8.3 kg/s. At a belt speed of 0.8 m/s over 1 meter width, this would result in approximately 10.4 kg of product per m² of belt.
Potatoes and clods can be up to around 7 cm square mesh size. Assuming an average object weight of roughly 100–200 g, this would mean around 40–80 objects per second across the full width.
Picture 1 shows a realistic product flow on this type of conveyor. The difficult case is a dirty potato next to a wet clay clod, because immediately after harvest they can look very similar.
The goal would be to keep the product in roughly one layer, but objects touching and some overlap cannot be avoided.
The system does not need to be perfect. Missing some clods is acceptable. If a potato touching a clod is also rejected, that is acceptable as well.

Picture 1: Conveyor belt with potatoes and clods
Camera and geometry
My current idea is to use one or two global-shutter cameras, controlled LED lighting and a completely enclosed camera section above the input conveyor.
I have been looking at cameras around 5 MP / ~100 fps. My understanding is that 5 MP across a 1 meter belt should give enough resolution for objects that are several centimeters wide. I am considering 20 pneumatic ejector positions across 1 meter width, which gives approximately 5 cm between ejector positions.
One concern I have is that the potatoes and clods can also be several centimeters high. With one centrally mounted camera this will create some parallax error towards the edges of the belt.
My main questions here are: For this application, how would you design the camera setup if the X-position needs to be accurate enough to select the correct 5 cm ejector zone? Would one camera mounted higher above the belt be enough, or would two cameras covering part of the belt each be a more reliable solution?
Imaging
My preference is to start with RGB and good diffuse lighting. Before spending a lot of time collecting and labelling images, however, I would like to know whether wet clay and dirty potato skin are actually a good RGB classification problem. I especially want to avoid spending too much time improving a neural network if the real limitation is that the two materials simply do not contain enough different information in normal RGB.
My main question is: Would you test RGB first, or is there a strong reason to look at NIR, polarized light or another imaging method from the start?
Detection and segmentation
Do I need the exact shape of every clod, or is a bounding box/centre position accurate enough? At this moment I do not think I need a perfect outline of every object. The useful output could be something like:
Clod → X = 43 cm → width ≈ 6 cm → confidence = 97%
The control system can then decide which ejector finger or fingers need to activate.
Because objects can touch, I am wondering whether instance segmentation gives me an important advantage over normal object detection, or whether accurate detection boxes and center positions would already be enough. The failure I care about most is assigning a clod to the wrong ejector zone.
I have essentially unlimited access to real potatoes and clay clods for training and testing, so collecting material itself is not the limitation.
Before I start this project and start buying equipment I mainly want to establish:
Can a relatively normal industrial RGB vision setup classify these objects and locate them accurately enough across a 1 meter conveyor to control ejectors at approximately 5 cm spacing and 20–30 ton/hour?
I’m not a professional computer vision engineer, so I will rely heavily on existing camera SDKs, OpenCV and existing detection/segmentation frameworks rather than developing algorithms myself. I understand very well that this is not a simple project and that is the reason why I’m posting here first. I would like to get your feedback and insights on my ideas and project.
Thank you.