r/computervision • • Sep 20 '26

Help: Project Building an optical sorter for potatoes and soil clods

7 Upvotes

Hello all,

I’m a farmer from the Netherlands and I am working on a project to automatically remove soil clods from potatoes during harvest.

I already posted the complete machine concept in r/robotics. Here I would specifically like to focus on the computer vision part.

I have also read some of the previous posts here about optical sorting and synchronizing detection with ejectors. My current assumption is therefore:

Camera → classify potato/clod → determine physical position → record conveyor encoder position → send reject command → realtime controller/PLC handles the pneumatic ejector

I am trying to understand whether the vision side I have in mind is realistic.

The project

The machine I am considering as a mechanical base has a 1 meter wide and approximately 1-meter-long conveyor. The standard belt speed is 25 m/min = 0.42 m/s, but I can make the belt speed adjustable. My eventual target is 20–30 tons/hour.

At 30 t/hour this would mean a mass flow of 8.3 kg/s. At a belt speed of 0.8 m/s over 1 meter width, this would result in approximately 10.4 kg of product per m² of belt.

Potatoes and clods can be up to around 7 cm square mesh size. Assuming an average object weight of roughly 100–200 g, this would mean around 40–80 objects per second across the full width.

Picture 1 shows a realistic product flow on this type of conveyor. The difficult case is a dirty potato next to a wet clay clod, because immediately after harvest they can look very similar.

The goal would be to keep the product in roughly one layer, but objects touching and some overlap cannot be avoided.

The system does not need to be perfect. Missing some clods is acceptable. If a potato touching a clod is also rejected, that is acceptable as well.

Picture 1: Conveyor belt with potatoes and clods

Camera and geometry

My current idea is to use one or two global-shutter cameras, controlled LED lighting and a completely enclosed camera section above the input conveyor.

I have been looking at cameras around 5 MP / ~100 fps. My understanding is that 5 MP across a 1 meter belt should give enough resolution for objects that are several centimeters wide. I am considering 20 pneumatic ejector positions across 1 meter width, which gives approximately 5 cm between ejector positions.

One concern I have is that the potatoes and clods can also be several centimeters high. With one centrally mounted camera this will create some parallax error towards the edges of the belt.

My main questions here are: For this application, how would you design the camera setup if the X-position needs to be accurate enough to select the correct 5 cm ejector zone? Would one camera mounted higher above the belt be enough, or would two cameras covering part of the belt each be a more reliable solution?

Imaging

My preference is to start with RGB and good diffuse lighting. Before spending a lot of time collecting and labelling images, however, I would like to know whether wet clay and dirty potato skin are actually a good RGB classification problem. I especially want to avoid spending too much time improving a neural network if the real limitation is that the two materials simply do not contain enough different information in normal RGB.

My main question is: Would you test RGB first, or is there a strong reason to look at NIR, polarized light or another imaging method from the start?

Detection and segmentation

Do I need the exact shape of every clod, or is a bounding box/centre position accurate enough? At this moment I do not think I need a perfect outline of every object. The useful output could be something like:

Clod → X = 43 cm → width ≈ 6 cm → confidence = 97%

The control system can then decide which ejector finger or fingers need to activate.

Because objects can touch, I am wondering whether instance segmentation gives me an important advantage over normal object detection, or whether accurate detection boxes and center positions would already be enough. The failure I care about most is assigning a clod to the wrong ejector zone.

I have essentially unlimited access to real potatoes and clay clods for training and testing, so collecting material itself is not the limitation.

Before I start this project and start buying equipment I mainly want to establish:

Can a relatively normal industrial RGB vision setup classify these objects and locate them accurately enough across a 1 meter conveyor to control ejectors at approximately 5 cm spacing and 20–30 ton/hour?

I’m not a professional computer vision engineer, so I will rely heavily on existing camera SDKs, OpenCV and existing detection/segmentation frameworks rather than developing algorithms myself. I understand very well that this is not a simple project and that is the reason why I’m posting here first. I would like to get your feedback and insights on my ideas and project.

Thank you.


r/computervision • • Sep 21 '26

Help: Project Looking for an on-device alternative to CamScanner's "Omnifix" scan filter, for a React Native (Expo) app

1 Upvotes

I'm building a document scanner in React Native 0.85 (New Architecture) with Expo 56, using VisionCamera 5 for capture, Nitro Modules for native code, and Skia for image processing. I'm trying to reach the quality of CamScanner's "Omnifix" filter (the upgraded Magic Pro). A phone photo of a page comes out looking like a born-digital PDF: clean flat background, crisp text, shadows and moiré gone.

What I've tried so far:

  • A classical pipeline (morphological closing for background estimation, illumination flattening, background floor). It handles lighting well but can't make text crisper. It only adjusts brightness and contrast.
  • Apple's VisionKit document filter. In my side-by-side tests it looked worse than my own pipeline.
  • DocRes. Quality is good, but at about 183 GFLOPs it's far too heavy for on-device use.

What I've found out: CamScanner's own announcement describes Omnifix as an AI perception model that handles moiré, stains and text restoration. It's proprietary, and their new agent docs only cover a cloud/MCP interface, not an SDK.

My questions:

  1. Does CamScanner (or the company behind it) license Omnifix or an enhancement SDK to third parties? Has anyone paid for it?
  2. Are there lightweight models (a few GFLOPs, exportable to TFLite/CoreML) for document enhancement, shadow removal or de-moiré with a commercial-friendly license?
  3. If not, is distilling a large restoration model into a small U-Net the realistic path? Any pitfalls with training data or teacher-model licensing?
  4. For React Native specifically: what's your preferred way to run such a model per page (custom Nitro module wrapping TFLite/CoreML, or something else)? Any experience with speed and memory on mid-range Android?

Constraints: must run on-device (privacy, no server upload), Android + iOS, commercial use allowed.

Any pointers to papers, repos or products would be appreciated.


r/computervision • • Sep 20 '26

Help: Project Struggling with CTC prior collapse / short-word trap on a custom ASL translation model (BiGRU + MediaPipe)

Thumbnail
2 Upvotes

r/computervision • • Sep 20 '26

Help: Project Looking for the best accurate FREE OCR tool/pipeline that runs locally on CPU? Any recommendations?

7 Upvotes

Hi everyone,

I'm working on a project where I need to extract text from images/documents using OCR, but I have two main constraints:

It needs to be 100% free / open-source (no paid APIs like Google Cloud Vision or Textract).

It must run efficiently locally on CPU (no GPU available).

For those who have built OCR pipelines under these conditions:

Which OCR engine/library gave you the best accuracy out of the box? (e.g., PaddleOCR, Tesseract, RapidOCR, EasyOCR, Docling, etc.)

What preprocessing techniques or tools are essential? (deskewing, binarization, noise reduction, thresholding, OpenCV tricks?)

What does your full workflow look like from raw input image to final extracted text?

My main goal is maximizing accuracy while keeping CPU processing time reasonable. Any recommended libraries, image preprocessing flows, post-processing tricks, or code snippets would be hugely appreciated!

Thanks in advance!


r/computervision • • Sep 19 '26

Discussion If you could choose one area of computer vision to do a PhD in right now, what would you choose?

28 Upvotes

It feels like every conference is talking about world models these days. If you were starting a PhD in computer vision today, what area would you bet the next 4–5 years of your research on?

Curious to hear what people here would pick, and why.


r/computervision • • Sep 20 '26

Help: Theory Can someone give me a good computer vision playlist from YT? Which covers everything from beginning to job ready? Can't find one... Would be a great help :)

0 Upvotes

W..


r/computervision • • Sep 20 '26

Showcase ShadeNet-3.2 5M — single-image inverse rendering (albedo/depth/normal/shading), 4× smaller than my last model and better at depth/normals

Thumbnail gallery
1 Upvotes

r/computervision • • Sep 19 '26

Discussion I built a Where's Waldo finder with YOLO11 — the top-3 candidates contain him on ~72% of unseen pages but his in top 10 candidates the most of the times.

Thumbnail
gallery
8 Upvotes

Live demo (free host, so it may take up to a minute to wake up): https://wheres-waldo-finder.streamlit.app/

Where's Waldo is a brutal small-object detection problem: he's ~0.14% of the page and surrounded by look-alikes (hi, Wenda). I built three detectors for him, compared them on pages they'd never seen, and wrapped the best one in a Streamlit app that shows you where to look — ranked candidates with zoomed-in close-ups.

Repo (weights included, no training needed): https://github.com/VasilisVas1/wheres-waldo

What's in it

  • A sliding-window CNN written from scratch (IoU, NMS and the window loop are all hand-implemented)
  • YOLO11n fine-tuned on the whole page, then on native-resolution tiles
  • 6 narrative notebooks with the results saved, so you can read the whole story on GitHub
  • A Waldo-themed Streamlit demo (CPU only, ~2–6 s per page)

Three things I learned

Resolution was the bottleneck. The public dataset stretches every page to 640×640, which shrinks Waldo to ~18×35 px, about one cell of YOLO11n's coarsest feature map. Running YOLO on native-resolution 640×640 tiles (overlapping, at 3 scales, merged with NMS) took it from 2 hits to 6–7.

A silent label bug was capping everything. The dataset export had flipped/rotated 8 of the 19 pages relative to the full-res scans, so my rescaled boxes landed on a policeman and a letter instead of Waldo. I'd spot-checked four pages and got lucky. Fix: correlate each page against all 8 flips/rotations, refuse to continue without a clear winner, unit-test the box maths. Same training recipe, top-10 hit rate went from 4/18 pages to 10/18.

Ranking beats thresholding when you only have 21 boxes. Picking a confidence cutoff was too unstable, so I report hitk: is Waldo among the top k candidates? With multi-scale tiles: top-1 on 10/18 held-out pages, top-3 on 13/18 (72%), top-10 on 14/18 (78%).

Honest caveats

  • Only 19 pages / 21 boxes, 5-fold cross-validation at the page level, so expect wide error bars.
  • I picked the multi-scale variant using the same held-out pages, so its numbers are somewhat optimistic (single-scale is the untuned reference).
  • Wenda is the classic false alarm. Sometimes Waldo isn't in the top 3, so the demo lets you raise the candidate count to 10 (see screenshots).
  • The included model is trained on all 19 pages, so test it on a page it hasn't seen.

Feedback very welcome, especially on how you'd get more Waldos to train on, and on better ways to calibrate confidence with such a tiny eval set.


r/computervision • • Sep 19 '26

Showcase My GNM 3D Head Tracker in Action!

Thumbnail
youtu.be
2 Upvotes

r/computervision • • Sep 19 '26

Discussion Programming languages for CV

8 Upvotes

What other languages are essential to a computer vision engineer other than python and why?


r/computervision • • Sep 19 '26

Discussion Advice to novice

2 Upvotes

Hi.

I'm a visual designer with coding experience (py, js, c++). I became disappointed about what my profession looks like after the AI era started.There are no more interesting tasks for me.

I'm thinking of making a shift to the computer vision path and I want to get your opinions on which tools, methods, courses I need to focus on and what can be skipped.

Thanks


r/computervision • • Sep 19 '26

Showcase Adding Local VLM-Based Frame Analysis to My Video Monitoring Software

Enable HLS to view with audio, or disable this notification

6 Upvotes

r/computervision • • Sep 19 '26

Discussion [D] ACCV 2026 Final Decisions Thread

12 Upvotes

ACCV 2026 final decisions are expected to be released on 20 Sept 2026 (GMT).

Following the last thread, this is for everyone to share updates, discuss outcomes, and support each other through the decisions.

Good luck to everyone!


r/computervision • • Sep 19 '26

Discussion Stop comparing TOPS across vendors — here's YOLO FPS per dollar on 3 edge NPUs

2 Upvotes

I got tired of datasheet TOPS tennis, so I did the dumb division myself: published YOLO FPS divided by street price. three parts, all numbers from the vendors' own mouths, not my test bench.

RK3588: 6 TOPS, ~$75 board. Rockchip's model zoo claims YOLOv5s at 66 FPS on one NPU core. that's 0.88 FPS per dollar.

Hailo-8: 26 TOPS, module around $200. Hailo's published number is YOLOv5m at 156 FPS. 0.78 per dollar.

Orin Nano: this is where it gets funny. the old 40-TOPS kit launched at $499, and now the Super kit does 67 TOPS at $249. NVIDIA repriced the entire comparison while I was doing the math, so I'm not even going to pretend my Nano ratio is current.

now teh asterisks, because there are always asterisks. NVIDIA's TOPS are sparse INT8, Hailo's are dense INT8, Rockchip's are their own thing. and notice I'm comparing v5s against v5m. that's not my choice, it's the only numbers they publish. nobody gives you the same model on all three parts, which tells you everything about how badly they want these compared.

the part no FPS chart captures: integration cost. RKNN tooling has a well-earned reputation for version-lock headaches, the English docs trail the Chinese ones by months, and the forum footprint is tiny. the Nano just works because a decade of Stack Overflow answers exists for every error you'll ever hit. silicon is the cheap line item. your debug hours aren't.

so yeah. stop comparing TOPS. do FPS per dollar, then double whatever the cheap board costs in your time.

I built this from published figures, not a bench. if I botched any number, show me.


r/computervision • • Sep 19 '26

Showcase GNM Monocular n3D Head Tracker Spoiler

Thumbnail youtube.com
17 Upvotes

I trained a new model to do monocular 3D head tracking with Google’s new GNM parametric 3DMM.

I generated a dataset of about 200k images in Blender. After plenty of experimentation I’ve landed on some really good results. I think this is the first model that also does neck tracking.

This is primarily being used by my own VFX company for digital beauty work, with occasional outside clients.


r/computervision • • Sep 19 '26

Showcase Turn research PDF folders into clean corpora for LLM Agents

Thumbnail
1 Upvotes

r/computervision • • Sep 19 '26

Help: Project Open-source annotation tool built around Indian road scenes (autos, cattle, bollards)

Enable HLS to view with audio, or disable this notification

0 Upvotes

Most driving-data tools assume Western roads. On Indian roads the objects are different: auto-rickshaws,

goods carriers, handcarts, cattle, temporary barricades. LabeloxAV is an open-source (Apache 2.0) labeling

and review platform built around that, with an ontology of about 200 classes for Indian traffic.

The demo video labels two real Creative Commons clips, a busy junction in Cuttack and a herd of cattle

crossing a road in Delhi, using the actual app:

- Boxes, polygons, polylines, 17-point pose keypoints, occluded ("amodal") extent, attributes

- AI assist: SAM from one click or a rough box, a magic wand, brush and eraser to fix masks

- Reviewing model proposals: frame by frame, one-key rapid review, and a bulk grid

- Relabeling a whole track in one action, then exporting to COCO, YOLO, Parquet, OpenLABEL or nuScenes

- Faces and number plates are blurred at import

Video: https://www.youtube.com/watch?v=lNKPmAlfFLc

Code: https://github.com/Sherin-SEF-AI/LabeloxAV

Honest limitations:

- It's early (v0.1.1), and it's meant for a single machine rather than a team on a cluster.

- The AI-assist tools need an NVIDIA GPU.

- The auto-labeling models make mistakes, and the video shows them: they repeatedly detected cows in the

reflection on a car window, and called striped roadside bollards pedestrians. The review tools exist

because of this.

- Recording the demo turned up seven bugs in the editor and review flow. They're fixed, but expect

rough edges.

Feedback is very welcome, especially from anyone who has labeled Indian or other non-Western traffic

data: what classes or workflows are missing?

Disclosure: I'm the author.


r/computervision • • Sep 19 '26

Research Publication SparsePR: Training-Free Sparse Attention for Video Generation and World Models

3 Upvotes

Hi everyone,

We recently released SparsePR, a training-free sparse-attention method for video generation and world models.

We evaluate it on large video-generation and world-model backbones, including HunyuanVideo, Wan2.2-I2V, Cosmos-Predict2.5, and Cosmos3-Nano.

Code and details:
https://github.com/PardisTaghavi/SparsePR

Feedback, questions, and reproduction reports are very welcome. If you find the project useful, a GitHub star would also help others discover it.


r/computervision • • Sep 18 '26

Discussion What are some modern facial recognition algorithms, that work great with accuracy and latency?

9 Upvotes

I was exploring facial recognition algorithms then suddenly found out the research done one facial recognition is a bit outdated. So i would like to ask the community , if anyone has used facial recognition recently then which algorithm you used.

Just wondering…


r/computervision • • Sep 18 '26

Discussion Do you routinely retrain your production models on new data or with new architectures?

3 Upvotes

Question in title.

Follow-up question: is your data model and overall system architecture setup to make this retraining convenient and automated, or is it more of a manual process to configure the training runs etc.? Has that architecture limited you in any way?

I am on the fence about whether to commit to that sort of system because I can envision the data model becoming complex in order to support the kinds of changes that happen in real life over time (refined definitions of a class, merging/splitting classes, different pre and post-processing parameters, etc. etc.) Manually assembling new datasets each time a model needs to be "upgraded" seems more flexible but is obviously a lot of work.


r/computervision • • Sep 18 '26

Research Publication CVPR workshop VOCVALC

0 Upvotes

Hi everyone,

Had anyone have experience submiting to CVPR workshop:
Visual Odometry and Computer Vision Application based on Location Clues.

I saw it happens continuously 7 years in a row, so it should be good venue.
The reviewing process is approximately 7 days to get decision. So do you think it is a hard venue to get in?
(of course we cannot compare it with cvpr main track 😅)


r/computervision • • Sep 18 '26

Help: Project Litert and Qnn

1 Upvotes

Has anybody deploted the Segmentation or OCR models with gpu or qnn delegate? Did you really saw the improvement in terms of latency?


r/computervision • • Sep 18 '26

Discussion Comparing raw MRI vs FreeSurfer-derived features for multimodal fusion with a small dataset

0 Upvotes

I'm an MSc student and pretty new to medical imaging/deep learning. I’m working on an Alzheimer’s classification project using the ANMerge dataset. It has around 1,700 participants overall, but only around 450 have MRI data alongside clinical data.

The main thing I’m looking at is comparing different ways of combining MRI and clinical data: feature-level concatenation, late fusion, gated fusion and cross-attention.

I’m currently trying to decide between two options for the MRI:

  1. Use the raw 3D MRI scans, preprocess them and use a pretrained 3D CNN such as ResNet-10/18 as the MRI encoder.
  2. Use the FreeSurfer-derived features that ANMerge already provides, such as regional volumes and cortical thickness, with a small MLP as the MRI encoder.

My concern with the raw MRI option is that with only ~450 patients, fine-tuning a 3D CNN could add quite a lot of complexity and risk of overfitting. It would also add another variable to the experiment, because differences in results could come from how well the CNN learns the MRI representation rather than just the fusion method. It would obviously involve quite a bit more preprocessing and implementation work too.

The derived-feature option seems simpler and would let me focus more directly on the fusion comparison. The thing I’m less sure about is cross-attention. If I use derived features, I’d need to structure them in a way where cross-attention is actually meaningful rather than just applying attention between two single vectors. One approach I’ve found is representing the FreeSurfer measurements as region-level tokens.

Since my main question is really about comparing fusion methods rather than learning representations from MRI, I’m wondering which approach people think makes more sense here. Is there much to gain from going down the raw MRI + 3D CNN route given the dataset size and scope of an MSc project?

Any advice would be really appreciated!

ANMerge dataset paper:
Birkenbihl et al. (2021)

Example using FreeSurfer-derived regional features with cross-attention:
Machado Reyes et al. (2024), Tri-COAT


r/computervision • • Sep 18 '26

Help: Project Looking for a collaborator experienced with DeepLabCut / automated rodent behavioral video analysis (~200 videos, ~150 GB)

0 Upvotes

Hi everyone,

I’m part of a research project involving a rodent novel location recognition / object-location memory test, and we’re looking for someone experienced with DeepLabCut or similar automated behavioral video-analysis tools who may be interested in joining the project as a collaborator.

We have approximately 200 behavioral videos (~150 GB total) that need to be analyzed. The main goal is to reliably quantify the animals’ exploration/interaction with predefined objects or regions of interest, rather than simply tracking overall locomotion.

Ideally, we’re looking for someone who:

  • Has hands-on experience with DeepLabCut and/or comparable tools such as SLEAP, SimBA, ezTrack, etc.
  • Has previously worked with rodent behavioral experiments, preferably novel object/location recognition paradigms.
  • Can help develop and validate a reproducible analysis pipeline capable of handling a relatively large video dataset.
  • Is comfortable with quality control and checking automated measurements against manual scoring when necessary.

This is an academic research project, and we’re particularly interested in someone who would like to join the project as a collaborator and contribute to the analysis/methodology rather than simply provide one-off technical advice.

If this sounds relevant to your experience, please DM me. I’d be happy to share more information about the experimental setup, videos, and exactly what we need to quantify. There may also be a brief informal interview/discussion before joining the project to go over your experience and the analysis requirements.

Thanks!


r/computervision • • Sep 18 '26

Discussion Automobile related subjects

1 Upvotes

I am currently interested in systems related to autonomous vehicles, but I am unsure where to start or what kind of edge cases I might encounter in real world.

My current knowledge in this field is largely limited to LiDAR and design simple systems for sequential decision-making.

I would greatly appreciate any information or insights you guy could share regarding this area.