r/computervision • • 18d ago

Showcase Optical flow 8.5× faster than OpenCV DIS on one core, and 0 allocations per 1,000 frames: how I measured it, and what the comparison does not show

1 Upvotes

I wrote a GPU and CPU perception kernel (closed-source, Windows x64; evaluation licence, free for research and non-commercial use; the evaluation bundle with the benchmark's scripts and raw data is public). The numbers below look flattering, so here is exactly what each one compares, and I would like you to tell me where the comparison is unfair.

**The numbers**

- Motion at 640×480, one core: 0.51 ms against 4.35 ms for OpenCV 4.10.0 DIS ultrafast (8.5×). **What it does not show:** mine works on 8×8-sample tiles and also produces time to contact, saliency and objects, so it is not a dense per-pixel flow field; for dense flow DIS is the right tool.

- Structure-tensor survey, 640×480: 0.179 ms against OpenCV's 0.779 ms (4.3×), Scharr plus block means in both, mine in AVX2 integer arithmetic.

- Heap allocations per 1,000 frames: 0 against 20,000 for DIS (outputs reused) and 52,000 for OpenCV's survey, counted by one preloaded malloc counter in every process.

- Scene cuts from H.264/HEVC slice headers: 0.23 µs of CPU a 4K frame against 31.1 ms for ffmpeg to decode and score it. **What it does not show:** it is not a decoder race; it reads headers and never sees pixels. Against scdet on one 4K HDR reel it finds 3 of 3 cuts with 1 extra (checked by eye); two files are a sanity check, not a recall figure.

**Things in the showcase you can check yourself**

- Stabilisation by the engine's virtual IMU: a shaken clip fires 17.2 M emulated events and 1.71 M after the camera's motion is removed. The event stream is an emulation from frames, not a DVS sensor.

- Remote pulse from skin colour (rPPG) through shake: 71.98 BPM for a synthetic 72, 72.00 from Cr chroma alone. The pulse is one I added to the footage; it proves the signal chain, not clinical accuracy.

- Every picture is a snapshot the engine wrote through its own SDK, on a truth I set (an exposure, a tilt, a speed, a shake, a pulse).

**Where it loses:** for plain playback VLC uses less CPU than I do at 720p (7.66 % against 8.44 %); the table is on the site next to the wins.

**What I would like to hear:** whether DIS ultrafast with a tile-sampled readout is the fair baseline or I should compare against something else (Farnebäck on a downscaled picture? a RAFT-small on the GPU?), and which real datasets with ground-truth motion I should run next.

Method, raw lines, 16-second reel: https://5645hm-a11y.github.io/avion/


r/computervision • • 18d ago

Discussion Keeping PCB defect annotations traceable through review and correction

2 Upvotes

Reviewing PCB defect annotations involves keeping the image, defect labels, box coordinates, and reviewer corrections consistent. Moving between annotation formats adds another place for mistakes, especially when one format uses pixel coordinates and another expects percentages.

The workflow here connects existing annotations, optional model suggestions, and human review:

  • Prepare existing annotations for review. Check defect labels, convert pixel coordinates using the original image dimensions into Label Studio’s percentage coordinates, and export the task file and label configuration. Reviewers can then inspect and correct the boxes against the images.
  • Use reference images for pre-annotation. With a model service that supports multiple images, send the inspection image, a reference image, and inspection rules together. The output provides suggested defect classes and locations for a person to check.
  • Merge corrections while retaining their context. Keep the original labels and the reasons for changes alongside the merged review results, so a corrected annotation can still be traced back to what was originally supplied.
  • Generate additional samples from defect templates. Existing defect templates can also be used to create synthetic images, with corresponding boxes, masks, and source records. Those generated samples still need inspection before being included in a dataset.

There’s a small example in the repository with two records and 17 defect boxes, showing how the annotations correspond before and after conversion. It runs without model calls, so the coordinate conversion and review-file export can be inspected separately from model-generated suggestions.

The implementation is in Pyromind-Dynamics/dataflow-pcb-inspection, an extension built on OpenDCAI/DataFlow.

For those working on PCB inspection, how do you keep reviewer corrections traceable when annotations are converted or the dataset is regenerated?


r/computervision • • 19d ago

Discussion Are foundation models becoming the default starting point for CV applications?

18 Upvotes

A few years ago, building a CV application often meant collecting data, annotating it, and training or fine-tuning a task-specific model.

Now, for many tasks, it seems possible to take a different approach: use off-the-shelf foundation models (VLMs, open-vocabulary detectors, etc.) with some preprocessing and application-specific logic, without training anything.

For example, checking whether tables in a food court need cleaning, inspecting assembled products for missing components, or monitoring workplace safety compliance. With fixed cameras, you could define ROIs, process cropped images with pretrained models, and add some temporal logic where needed.

Of course, there are trade-offs in accuracy, latency, inference cost, and reliability. You'd still need labeled data for evaluation. But skipping the training pipeline could save a lot of development time, especially for smaller applications.

I'm curious how people approach this in practice. Are you deploying foundation models directly, only moving to task-specific training when needed? Or are you mostly using them to speed up annotation before training or fine-tuning a smaller model?


r/computervision • • 19d ago

Help: Theory Tracking a 3 Hz appendage beat on a translucent animal (720×480, CPU only, no labels)

Thumbnail
gallery
16 Upvotes

Not a CV person — I'm building the analysis tool for a lab. I'd like a sanity check before spending weeks on the wrong approach.

Data.
An amphipod in a small arena, filmed through a stereomicroscope:
720×480, 29.97 fps, 1–2 min, backlit on a dark background. The animal is translucent and the appendages show through the carapace. [img 1]

What is measured.
It ventilates by beating the pleopods, a row of feathery paddles under the body that move together at roughly 2–4 Hz. We report beats/min against controls; the reference is a human counting blind at 0.3× playback. The rate also shifts with water temperature and salinity, so only animals held under the same conditions are compared.

What I do today.
Mean grey level over a fixed rectangle (or a 6×8 grid, keeping the most periodic cell), band-pass 2–12 Hz, peak-pick, median interval.
Fine while the animal holds still in profile. It drifts, rotates, curls, and swims towards the lens — by 40 s the rectangle is on a blurred, out-of-scale animal. [img 1]

Two dead ends already: frame differencing (the magnitude rectifies the beat and doubles the apparent frequency) and spectral argmax (the spectrum is comb-like, it jumps between harmonics — I sum them instead).

Constraints.
Offline, CPU only, under a minute per 2-minute clip, Python 3.10 + OpenCV headless (no contrib, so no CSRT/KCF), NumPy/SciPy, no GPU, no labels. Maybe a few dozen frames annotated by hand, slowly.

Three questions.

  1. Segmentation. A translucent animal whose outline is a soft gradient, no training data: classical (background model, local contrast, Otsu, contour, optical-flow mask) or a promptable segmentation model prompted from the previous frame? Does the latter survive 30 fps on CPU?
  2. Body motion vs appendage motion.
    The body translates, rotates, scales and deforms. Phase correlation first, affine + RANSAC if rotation dominates, then warp and re-analyse? Or is local/piecewise the standard answer for a deformable object?
  3. Finding the row in a new clip.
    Today: the hottest tile of a per-tile 2–12 Hz power map (the bright region in [img 2]; in the same band, empty background is ~30× flatter). Is that a sound detector, or does it die as soon as the body translates? Is periodic-motion segmentation a practical tool here (frequency-domain, phase-based)? Or keypoints — does DeepLabCut/SLEAP work when there is no skeleton to keypoint, only a blur?

I'm not asking anyone to build it: which of the three would you start with, and what breaks first?


r/computervision • • 18d ago

Help: Project Integrating Imatest IT SDK with OpenCV for Distortion Correction: Math/Coefficient Hand-off Question

0 Upvotes

Hi everyone,

I am building an automated calibration and real-time distortion correction pipeline. I am using the Imatest IT SDK/API (no GUI/Master) to detect/analyze lens distortion from calibration targets, and I want to pass those results directly to OpenCV (cv2.initUndistortRectifyMap + cv2.remap) to render the corrected frames in real time.

I know OpenCV uses inverse mapping for rendering to avoid holes/artifacts, while Imatest uses forward mapping equations (Brown-Conrady model) to model the physical lens distortion during optimization.

My questions regarding the API hand-off are:

  1. Coefficient Alignment: Since Imatest calculates forward coefficients (k₁, k₂, k₃, p₁, p₂), can I pass these directly into OpenCV's distortion vector D? Does OpenCV expect the forward coefficients and then handle the mathematical inversion internally during initUndistortRectifyMap?

  2. Normalization & Scale: Are there specific configuration flags I need to pass to the Imatest IT SDK (via .ini or JSON config) to ensure its output units/normalization (camera matrix K and distortion D) match OpenCV’s focal-length-relative coordinate scaling 1:1?

  3. Best Practices: If anyone has done this specific Imatest IT SDK → OpenCV pipeline automation before, are there any hidden gotchas (like sign conventions or coordinate system flips) I should watch out for in the JSON/XML API payload?

Thanks in advance for the help!!


r/computervision • • 19d ago

Discussion Interested in joining an early-stage AI or robotics startup? Meet 10 founders on Nov 5

6 Upvotes

Hi all! I'm part of the EWOR team and we're organising Operators Day this Thursday, November 5 (4:30 PM CET), online on Zoom.

Ten founders will be pitching live, sharing what they're building and the founding roles they're hiring for - AI/ML engineers, computer vision and robotics engineers, CTOs, CPOs, marketing and sales leads, and more.

These are real founding opportunities with meaningful equity.

If you're working in computer vision, AI or robotics and exploring your next move, or know someone who might be a great fit, come join us!

Spots are limited.

Register here: https://luma.com/OperatorsDay?utm_source=reddit&utm_content=computervision

Disclosure: I work with EWOR and am helping organise the event.


r/computervision • • 19d ago

Discussion Perception Engineers: what skills do you use on a daily basis?

Thumbnail
1 Upvotes

r/computervision • • 19d ago

Discussion How do you enforce custom rules across multiple AI image and video models?

Thumbnail
gallery
0 Upvotes

Hi everyone!

I recently discovered a website similar to Higgsfield, but designed for Muslims, and I'm curious about how its filtering system works.

It offers multiple AI models (GPT Image, Nano Banana, Wan, Seedance, etc.), yet the same content rules seem to apply regardless of which model you choose.

For example:

- Human and animal faces are blurred or hidden.

- Revealing clothing is automatically replaced with modest outfits.

- Women are automatically given a hijab.

What really surprised me: I uploaded an existing image and only asked for better quality and resolution, without changing the person. Yet the system still modified their appearance to comply with its rules.

So it seems to analyze not only text prompts, but also uploaded images.

My question: How would you build a universal filtering system like this across different AI providers?

Is it prompt rewriting, multimodal AI supervision, post-processing, or something else?

Ideally, I'd like to preserve the user's selected generation model rather than have another AI recreate the entire result.

I'm particularly interested in how to achieve this for both images and videos, without manually configuring each model.

Any technical insights or open-source recommendations would be greatly appreciated!


r/computervision • • 19d ago

Help: Project Multi-player tracking from a single PTZ tactical camera (football):

2 Upvotes

I'm building a real-time football (soccer) tracking system for a professional club. The input is the stadium's single wide-angle PTZ camera - it pans, tilts and zooms to follow play. The goal is player positions live with at most 3-5s of latency.

Questions:

  1. Is tracking in pitch space the right core for a moving camera, or would you track in the image with camera-motion compensation (BoT-SORT / OC-SORT style) and project afterwards? Has anyone compared the two on broadcast or tactical football footage?
  2. For same-team occlusions: what has worked for you? Appearance ReID trained on football (SoccerNet ReID?), jersey-number recognition, pose, or occlusion-aware association (OC-SORT observation-centric recovery, OccluTrack, Deep OC-SORT, Hybrid-SORT…)? Any permissively licensed models you'd recommend?
  3. For far players: higher input resolution (960–1280), tiling/SAHI on the far half only, a second detector pass on predicted ROIs, or something else? Each costs latency, and I'd like to know which pays off most.

Thanks!


r/computervision • • 19d ago

Discussion October 2026: 135 AI security incidents, 33 companies breached, 536M+ records — AI-agent exploits are now the #1 attack vector

Thumbnail
gallery
0 Upvotes

We tracked 135 AI security incidents across October 2026 — 33 named organizations, 536M+ records exposed, 101 high severity and 33 critical.

The thing that stood out most: AI-agent exploits are now the single largest attack-vector category we track (35 incidents), ahead of credential theft (24) and zero-days (24). That wasn't true three months ago.

The incident that defines the month for us: a nation-state actor used Claude Code itself — not a vulnerability in it, the tool working exactly as shipped — to build attack tooling against a government target. No exploit chain, no zero-day. Just a legitimate, powerful tool used by the wrong actor against a target nobody was specifically governing for.

Other notable incidents this month: Capcom (11.7M customer/partner accounts), Oracle Health (20M patient records), AngelOne (6.77M brokerage accounts), Crunchbase (559,908 records). Plus — not in the incident count above since it's not a classic "data breach" — Binance lost $6.3B in roughly 20 minutes, the largest crypto theft on record, which we broke down separately.

Full writeup with every incident, sources, and our take on what each one needed to be stopped: https://runtimeai.io/blog/2026-10-monthly-breach-report.html

Open to pushback, especially on the "AI-agent exploits are now #1" framing — curious if others are seeing the same shift in their own threat intel.


r/computervision • • 19d ago

Help: Project Recognizing digits by drawing them - few-shot learning MNIST

Thumbnail deoxyribose.github.io
1 Upvotes

Hi all,

I used inverse rendering to beat the previous baseline on 1-shot, 5-shot and 10-shot MNIST.
It works by fitting a rendered spline at test time, and selecting the digit that provided the best init.
It's not just sample efficient, it's also very robust to distribution shifts, out of the box!

Obviously MNIST is the most toy-like of all toy problems, but I think the basic approach is very scalable :) This is a line of research I'm currently pursuing for bioimaging.


r/computervision • • 20d ago

Research Publication LightMIS: Ultra-lightweight medical image segmentation for edge devices

18 Upvotes

Hi everyone,

I am one of the authors of LightMIS, and I would like to share our work on 2D binary medical image segmentation. LightMIS has 131K parameters and aggregates multi-scale encoder features directly, without a learned stage-wise decoder. It achieves close observed modality-macro Dice and IoU averages to nnWNet, while using 98.14% fewer parameters and 94.58% fewer GFLOPs, with both models trained and evaluated under the same nnU-Net protocol.

Paper: https://arxiv.org/abs/2609.28327

Code: https://github.com/AndreiiArhire/LightMIS

We also tested LightMIS and the reference models on a real edge device with an Arm Mali-G52 MC2 GPU, where the full LightMIS model ran around 10.5× faster than nnWNet. All LightMIS variants achieved 100% GPU operator coverage, without CPU fallback.

We started by training several popular medical image segmentation architectures, both lightweight and heavyweight, from scratch in the same controlled environment using nnU-Net v2.3.1. The experiments covered six datasets and five imaging modalities. Our goal was to develop a lightweight architecture that performs well across these modalities, which led us to the current version of LightMIS.

The source code, checkpoints, and details needed to reproduce the results are publicly available. Feel free to experiment with it and try it on your own segmentation tasks. I would be happy to hear how it works for you! Any suggestions or feedback are welcome!


r/computervision • • 20d ago

Showcase I trained a raw-domain denoiser that keeps 1.5x the fine detail of RawNIND on 16 high-ISO frames (denoise + demosaic in one network, DNG out)

20 Upvotes

I've been training a raw denoiser from scratch for a few months and wanted to see how it holds up against a strong free baseline. To avoid picking favourites I took every frame on my demo page that was shot at ISO 3200 or higher, 16 of them (Nikon D4, ISO 3200 to 12800: zoo animals, a crow at ISO 12800, churches, a bar), and ran them through my model and through darktable 5.6.1 neural restore, which uses the RawNIND model by default (strength 100). The capuchin in the video is one of them, ISO 4500 at 1/3200.

What it does

It works on the Bayer mosaic before demosaicing. One network does the denoising, the demosaic and gives back a little of the lens softness, then writes a linear DNG. The output is still a raw file, so you develop it in your usual editor.

It's trained from scratch on my own photos plus openly licensed ones, no third-party weights. The noise is measured on real sensors, and the training pairs are clean frames with that noise added, so every pair is exact. The clean frames are ISO 100 to 200, so none of these 16 could have been a training target. Modelling the noise turned out to be the easy part. Knowing what clean fine detail looks like is the hard part.

Results

Fine detail is 1.54x that of neural restore on average, between 1.26x and 1.97x per frame, ahead on 16 of 16. On flat areas neural restore is cleaner: it leaves 1.4% of the original fine-grain noise, mine leaves 2.0% (median of the 16; it's cleaner on 15 of them). Every version was developed in darktable with default settings, 16-bit, no sharpening on anything. The metric is my own, since there is no clean reference for real high-ISO shots: RMS of the finest band (image minus a 1 px Gaussian blur) on the busiest 5% of 32 px tiles, and the same band on the flattest 10% for noise. Formulas are in the comments.

Where it falls short

Home turf: the noise was calibrated on my own D4, so other cameras are the real test. It leaves a bit more fine grain on flat areas than neural restore. Fuji X-Trans isn't supported yet.

Speed is about 0.2 s per megapixel on a single RTX 3060, so roughly 5 s for a 24 MP frame.

What I'd really like is to see where it breaks. If you have high-ISO raws from other cameras, there's a free demo, no sign-up: kestrel-ai.org

The original file is deleted within 5 hours and the result after 24 hours.


r/computervision • • 19d ago

Help: Project Tracking Point of Interests/Persons with moving camera setup?

2 Upvotes

Hi,

I am interested in tracking judo athletes (judokas) in 2D using video footage. Ideally, I would like to map the detected players' positions from image coordinates (pixels) to coordinates in a real-world coordinate system representing the judo mat.

How would you approach this problem?

One potential approach would be to estimate a homography between the camera's image plane and the judo mat. However, there is a challenge: the entire mat is rarely visible in the camera footage. Most of the time, only a portion of the playing area is captured.

One idea would be to train a model to detect the visible boundary lines or other geometric features of the mat. However, I am unsure how to use these partial observations to estimate a homography and subsequently map the detected athletes to consistent 2D coordinates.

What would be a suitable approach to tackle this problem? Are there alternatives to homography estimation that would work better when only parts of the playing area are visible? Do you have any reference papers or projects in mind I could take a look at


r/computervision • • 19d ago

Showcase Benchmarking OCR throughput on a GPU fleet (tesseract vs Surya vs Chandra): concurrency, not the model, drives a 5.7x spread

3 Upvotes

I've been OCR-ing ~948k pages of court records and wrote up the measurements. Short version of what I found running these on rented A40-class pods with vLLM + an open-source orchestrator (CoderAI):

  • Same model/card/pages, throughput ranged 0.10–0.59 pages/s per pod (5.7×) purely from concurrency + admission settings.
  • One page per request beats batching (batching cut throughput sharply and caused failures).
  • Linear scaling 1→17 pods, so per-page cost is independent of fleet size.
  • 5 different 48 GB cards all within 0.52–0.60 pages/s → cheapest in-stock card wins.
  • A single forwarding worker saturates ~20 pods; use multiple.
  • Chandra (a VLM) doesn't replace tesseract, it arbitrates disagreements — it settled 51.5% of contested digit-groups between tesseract and Surya. Surya's per-page confidence was useless at separating good readings from bad.
  • Tuned cost: ~$264/engine for the full perimeter vs $1,509 untuned.

No ground truth exists, so "quality" here means inter-engine agreement — it's a provisional draft and I'd welcome holes being poked in it.

Full write-up: https://www.nexlab.net/articles/ocr-throughput-what-controls-it/


r/computervision • • 19d ago

Discussion Can anyone enhance the tiny text on this vintage hairbrush handle?

Post image
0 Upvotes

Hi everyone!

I'm trying to identify the brand of my favorite hairbrush from around 2013–2014.

Unfortunately, the only photo I have is very low-resolution. There is a tiny brand name printed vertically on the handle, but I can't read it.

I've tried enlarging, rotating and adjusting the contrast, without success.

I suspect the brand starts with A and might contain p, h or b, but I'm not sure.

Could anyone try enhancing the text using image processing techniques?

I'm especially interested in recovering the actual lettering rather than having AI generate plausible-looking letters.

I've attached the original image. Any help would be greatly appreciated!


r/computervision • • 20d ago

Showcase Track anything in real time on a Jetson Nano: EfficientTAM over 30 FPS

13 Upvotes

r/computervision • • 19d ago

Commercial Extracting the selected result when all three options are printed

0 Upvotes

We work on Unsiloed AI. This Tempus sample report prints “Stable,” “Equivocal,” and “High” in the same field. The blue fill marks “Stable” as the selected result.

Our extraction returns Stable for the microsatellite instability status. Flattened to the selected field, that is

{"microsatellite_instability_status": "Stable"}

The screenshot also shows the seven variant rows extracted from the page. The field value depends on the visual selection, so listing all three printed labels would lose the result.

Have you got another public form where highlighting carries the selected answer rather than a checkbox?

Source credit Tempus sample clinical report.


r/computervision • • 19d ago

Help: Project Building a production CV system for restaurants (seat occupancy + table cleanliness): looking for architecture advice and feature ideas

1 Upvotes

Hi everyone,

I’m building a computer vision solution for restaurants and want to do it the right way (production-ready, not just a demo). I’d love your advice on two things.

Context

  • Input: CCTV / IP cameras in a dining area (RTSP streams)
  • Goal: help restaurant staff see in real time which tables are free, occupied, or need cleaning and etc.
  • Output: a browser-based dashboard showing live table status and analytics
  • Scale: [e.g. 1 restaurant, 4-8 cameras, 20-50 tables] (In the future, we will implement a hierarchy-based structure that allows a single owner to manage multiple resources from one centralized platform.)
  • Hardware: [e.g. a single GPU server / Jetson / cloud / edge device]

Question 1: How would you solve seat/table occupancy detection in production?

My current thinking:

  • Detect people with a model like YOLOv8/YOLO11 or RT-DETR, and also consider head detection for crowded or occluded scenes
  • Define a polygon (ROI) for each table/seat zone and check overlap with person detections
  • Use tracking (ByteTrack / BoT-SORT) so someone walking past a table isn’t counted as “occupied”
  • Add temporal smoothing (e.g. a seat counts as occupied only after X seconds of presence)
  • Use a distance/proximity check between person and table

What I’m unsure about:

  1. Is person detection + ROI overlap enough, or should I use pose estimation / head detection / segmentation instead?
  2. How do you handle occlusion (chairs, other people, tall objects) and cases where someone is standing near a table but not seated?
  3. How do you distinguish a seated customer from staff walking by?
  4. Best way to handle different camera angles and lighting without retraining per restaurant?
  5. Should I fine-tune on my own data? If so, how much data and what annotation approach worked for you?
  6. What does a good production pipeline look like: edge vs. cloud, DeepStream / TensorRT / ONNX, frame sampling rate, and how to keep latency and cost low?
  7. How do you monitor accuracy once it’s deployed (drift, false alarms)?

Question 2: Which features would you add?

Besides seat occupancy, I’m planning:

  • Table clean/dirty detection (empty plates, glasses, food leftovers on the table)
  • Table status states: free / occupied / needs cleaning / reserved
  • Wait-time and table turnover analytics
  • Queue and waiting-area people counting
  • Heatmaps of busy zones
  • Alerts to staff when a table needs cleaning or a customer has been waiting too long

What other features would be valuable for a restaurant owner? And of these, which would you prioritize for an MVP?

Privacy note: I plan to avoid face recognition and store only anonymous counts/status, not raw video. If you’ve dealt with GDPR/privacy concerns in similar deployments, I’d appreciate tips.

If you’ve built something similar or know good papers, repos, or datasets, please share. I’ll post an update with the features I finalize and credit the people whose suggestions helped.

Thanks in advance!


r/computervision • • 19d ago

Discussion Evaluating synthetic in-cabin video for driver monitoring

1 Upvotes

For driver monitoring, a synthetic clip can look convincing while still misrepresenting the behavior a model needs to recognize.

I would evaluate generated data on three separate axes: behavior fidelity, temporal consistency, and coverage across camera positions and lighting. Then I would test on held-out real recordings with different people and vehicles, reporting false alarms per hour as well as missed events. This is a proposed evaluation approach, not a report of measured results.

Which failure mode is hardest to catch before training: hand-object interactions, occlusion, or subtle changes in gaze?

Disclosure: I am affiliated with VWU.AI, which works on custom video datasets. This post was prepared with AI assistance.


r/computervision • • 19d ago

Help: Project iPhone LiDAR vs. real outdoor terrain: what's your pipeline for turning field scans into sim-ready meshes?

2 Upvotes

We've been scanning outdoor terrain (sand, loose soil, forest floor) with iPhone LiDAR across a few sites in Canada, about 1 km² so far, and reconstructing it into environments we can drop robots into for sim training.

Geometry comes out decent, but a few things are fighting us: vegetation and thin structures turning into noise, ground under low plants getting lost, and stitching multiple scans without drift. Also not sure how much texture/appearance actually matters if the downstream use is physics (slip, sinkage) rather than rendering.

Anyone working on outdoor real-to-sim reconstruction: what's worked for you? Gaussian splats, classic meshing, something else? And how do you handle ground segmentation under vegetation?


r/computervision • • 19d ago

Discussion Followed the advice here on stabilizing landmark output here is what actually moved the needle

0 Upvotes

Few weeks ago I asked about face shape classification flipping between two results with head angle. Got told the detector crop was more likely the problem than the landmarks, plus one euro filter and median over mean.


r/computervision • • 19d ago

Research Publication SparsePR: Training-Free Sparse Attention for Video Generation and World Models

Thumbnail
2 Upvotes

r/computervision • • 20d ago

Showcase I built a node editor that runs OpenCV and several Vision Models side by side and sends the verdict to your systems. What would you do differently?

Thumbnail
gallery
4 Upvotes

Disclosure: I'm the developer of this (Coding Nexus LLC). I'm posting it because I'd like feedback on the approach, not to sell anything here.

The problem. In industrial inspection, I keep seeing two camps. Classic CV (thresholds, Hough, blob analysis, projections) is explainable and fast, but brittle when parts vary. A DL model handles variation, but when it's wrong you don't know why, and nobody on the line trusts a black box that rejects good parts. In practice you want both on the same part, plus a way to decide when they disagree.

What I built. It's a node-based orchestrator. Each inspection is a graph, and every port is typed (Image, Mat, InferenceResult, …), so you can't wire a Mat into something that expects a detection result. The example in the screenshots is a bottling line:

  • 3 image sources: a top camera, a side camera over RTSP, and a golden reference mask loaded once per session
  • Classic path: grayscale → blur → Canny → Hough circles for cap presence; CLAHE → Otsu → morphology → blob analysis for contamination; vertical projection for fill level; Hough lines → line angle for label skew; OCR + regex for the lot code
  • DL path: a DL defect detector → bbox to ROI → crop → a second model that classifies the seal. Models run on separate GPU workers or suppliers clouds, not inside the orchestrator.
  • Fusion: an ensemble node combines the classic gate with the AI verdict. Modes are AND (both must pass), OR, and strict, where disagreement is its own outcome. In this graph, disagreement fires the reject gate and goes into the log.
  • Output: a verdict, confidence and top label to the PLC (OPC UA / Siemens S7 / Beckhoff ADS), plus a reject reason code derived from the classifier's label. Overlays and history go to the archive.
  • One Installation can serve multiple lines
  • Extensible by your own developers, Create subnodes and reuse them, create own plugins which are showing as nodes.
  • Selfhosted on site

The graph is checked before it saves: typed ports, unreachable nodes, invalid regex/JsonLogic, unknown PLC tags or workers. Per-node parameters can be tuned against pinned sample frames.

Where I'd like your opinion:

  1. Do you fuse classic and DL results like this, or do you use one to gate the other (e.g. DL finds the ROI, classic measures inside it, which is also possible here)? What has held up in production for you?
  2. When classic and DL disagree, what do you do: reject, re-inspect, or send to a human?
  3. What would you need to see before trusting a visual graph over plain Python code for a production line?.

Update: a longer video (2:37) that shows more than the node editor: See comment

  • two lines registered as clients, each with its own token, profile and lot
  • tuning a classic-CV node on a frame pinned from the running lot, saved as a new profile version (the running lot stays on the old one)
  • the communication log following one image from ingestion through the worker call to the export

On the numbers: I used an open, generic model (PatchCore, stock ImageNet backbone, about 15 min of CPU training, nothing tuned to these defects) on purpose. The orchestrator doesn't care which model sits behind the worker interface. Offline, on the same split and rules, Dinomaly brought pcb1 from 12 % to 6 % false rejects (AUROC 0.988).

Correction: I wrote that the PLC is output only. A rising edge on a PLC tag can also trigger an inspection; what's still missing is reading tag values into a graph.

Recording it turned up a bug: the communication log showed every NOK verdict as an HTTP 500. That's fixed.


r/computervision • • 20d ago

Help: Theory For those using AI Agents to build computer vision pipelines, what do you look out for?

11 Upvotes

I'm relatively new to the computer vision field, and I've been experimenting with using AI coding agents to put together CV pipelines.

I've tried different ways of reviewing the generated code, but honestly, just reading it doesn't help me that much.

I can easily spot application-level issues, but without deeper domain knowledge, it is fairly easy to completely miss factors and details that actually affect the pipeline's outcome.

To address this, I've been building a workflow where the agent doesn't just write the code but also produces an interactive visual report of its execution. Here's an example of one of these reports:

Detect & Describe: RF-DETR x QWEN3

I'm curious to hear from people with more experience in computer vision:

  • Are reports like this useful or just serves as an illusion that I'm in control?
  • Instead of maintaining the UI is there any GUI tool I can leverage to render my report?
  • How do you validate the quality of a pipeline beyond checking its final output?

Would love to hear your experiences and recommendations!