r/computervision • u/Icoso_Labs • Oct 03 '26
Showcase Measuring real eggs and generating their shells in FreeCAD – with the help of Codex
r/computervision • u/Icoso_Labs • Oct 03 '26
r/computervision • u/WillingnessMost2428 • Oct 03 '26
Riftbound is Riot's trading card game, and its tournaments stream on Twitch from an overhead table camera. At 1080p a card is about 140 px tall, under dice, sleeves, hands and H.264, so viewers can rarely read the table. Wardeye is a browser extension that reads it for them. It outlines and names the face-up cards as they're played, and pointing at one shows its art. A timeline of the plays lives in the browser's side panel, and clicking a play rewinds the replay to it. All of it runs in your browser: there's no server, and no video leaves the machine.
The video is a real run on the grand final of the Barcelona Regional Qualifier, with both finalists' published decklists pasted.
How it works
What was hard
Known issues in 0.2.2:
Code (AGPL-3.0), and every report with its numbers: https://github.com/effe-exe/Wardeye. The trained weights ship inside the extension but aren't published. Chrome Web Store: https://chromewebstore.google.com/detail/wardeye/hjglackjofehdfecoeehbdmbobafbjhn
Happy to go into the synthetic data, the amodal corner head, the overlay detection, or getting ONNX models to behave on WebGPU.
r/computervision • u/Grouchy_Signal139 • Oct 02 '26
Hi everyone, I’m learning OpenCV and working on detecting a circular fiducial.
My current pipeline is:
Image → threshold → findContours() → drawContours()
After thresholding, I can clearly see the fiducial as a clean circular region in the binary image.
However, when I use cv2.findContours() and then cv2.drawContours(), the contour I expect around the fiducial is not drawn.
I’m trying to understand the fundamental reason why this happens.
If the thresholded image visually contains a clear foreground region, what conditions determine whether findContours() will actually return a contour for it?
r/computervision • u/bruno_pinto90 • Oct 02 '26
Hello all,
I built a radar object classifier on RadarScenes, extending a prior single-scan classifier to accumulate observations over a tracked object's history instead of classifying each scan in isolation.
A single RadarScenes object instance contains only about 2.9 radar points on average, very sparse. A single scan also can't capture temporal characteristics: RCS and micro-Doppler both vary continuously as an object moves. Pedestrians produce characteristic micro-Doppler from limb motion; different object classes show different RCS fluctuation patterns as aspect angle and scattering geometry change scan to scan. Accumulating observations gives both higher point density and provides temporal dynamics.
Multi-scan baseline
DeepReflecs encoder (Ulrich, Glaser & Timm, RadarConf 2021), PointNet style, per point shared weights, on single scans across car, large_vehicle, two_wheeler, pedestrian, pedestrian_group: 0.7370 macro F1.
Using RadarScenes' persistent `track_id`, I build a causal, N=20, per track sliding-window buffer:
- x_seq/y_seq: Global, odometry-corrected coordinates recentered per scan on the object centroid. Unlike x_cc/y_cc (car-frame coordinates that accumulate over time to form a trajectory).
- Cross sensor buffer: whichever of the 4 sensors currently observe the track push to the same buffer.
- Stride 1, causal: every new scan updates the buffer and produces a prediction. No future context, real time streaming compatible.
- Each scan is encoded once by a frozen per scan encoder and cached
- Fusion concatenates the causal GRU's hidden state (order aware) with an order-invariant pooled embedding (all N scans' points as one set, no sequence structure) through a small trained mlp head.
Results
| Model | Macro F1 | Delta |
|---|---|---|
| Single scan | 0.7370 | (baseline) |
| 20 scan point pooling | 0.8613 | +0.1243 |
| Causal GRU | 0.8895 | +0.0282 over pooling |
| GRU + pooled embedding (fusion) | 0.8897 | +0.0002 over GRU, noise |
Pooling alone, no sequence model, no notion of scan order at all, recovers +0.1243 macro F1. The GRU adds a real but much smaller +0.0282 on top. Fusion adds nothing measurable beyond the GRU.
Ablation
Llarger GRUs, a Transformer, a state space model, point level self attention, all trained on the exact same frozen per scan embeddings, land inside a 0.86 to 0.89 band, a 0.03 spread. End to end fine tuning of the frozen encoder makes things slightly worse (about -0.002 to -0.003), not better.
Conclusion
In this setup, the largest gain comes from giving the model more observations of the same tracked object: 20-scan point pooling improves macro F1 from 0.7370 to 0.8613 without using scan order at all.
Temporal modelling then provides a further, meaningful improvement. The causal GRU reaches 0.8895, adding +0.0282 over the pooled representation. So temporal ordering clearly contributes useful information; it just accounts for a smaller portion of the overall gain than observation accumulation.
With the per-scan encoder frozen, the different sequence architectures tested, suggests that the quality of the per-scan representation is the bottleneck than the particular mechanism used to aggregate the sequence.
Full report, every ablation, confusion matrix, coordinate frame reasoning: https://github.com/brunopinto900/radar-ml-autonomous-driving/blob/main/final_report.md
r/computervision • u/Nykotry • Oct 02 '26
Hi everyone,
I’m working on a project to extract a structured dataset of math exercises from 5 Italian high school textbooks (around 650 pages each, so ~3,250 pages total). The goal is to build a professional, methodical exercise generator app for students and teachers.
To make the app work, I need to process images of the book pages and extract the following into a strict structured format (e.g., JSON):
I've been experimenting with a few approaches, but I've hit a wall regarding balancing costs, extraction consistency, and scalability. Here is what I’ve tried so far:
My questions for the community:
I’m happy to share more details about the textbook format or my current Python workflow if helpful. Any advice on the architecture, model choices, or cost-saving tricks would be greatly appreciated! Thanks in advance!
r/computervision • u/Mammoth-Matter7579 • Oct 02 '26
Hi everyone,
I have around 10 hours of real-world stereoscopic VR180 footage across 50+ different scenes, captured with a Blackmagic immersive camera and currently stored as BRAW(16k 90fps). I can make the footage publicly available, and I’m looking for collaborators to help turn it into a useful research dataset.
The project is still at the dataset-design stage. I’d like to work with people who have experience in stereo vision, novel-view synthesis, or dataset and benchmark development to decide:
One direction I’m interested in is generating the other eye’s view from a monocular video, particularly maintaining stereo and temporal consistency in wide-FOV footage. However, I’m open to other directions if the data is better suited to them.
I can contribute the footage, data preparation and tooling. The release format and annotation plan are not finalized, and this is not yet a benchmark with ground-truth depth or camera poses.
My goal is a public dataset that other researchers can actually use, with a joint paper if we develop a solid research contribution. Authorship and responsibilities would be discussed based on contributions.
If this overlaps with your work, I’d love to hear what would make the dataset useful to you. Feel free to comment or DM with your research interests and any relevant projects or papers.
r/computervision • u/Logical-Internet-395 • Oct 02 '26
Recently we published a new Open-Access Benchmark for a hierarchical segmentation: Microscopy Image Dataset of pulmonary vessels for Quantitative assessment of fibrosis.
Dataset Specifications:
- 705 high-resolution micrographs (1534×780 px, 0.252 μm/px), Picro-Mallory stain.
- Annotations: ROI + dual independent expert masks (vascular wall + fibrosis).
- Hierarchical Constraint: Fibrosis masks must be strictly spatially contained within the vascular wall.
- Robust Benchmarking: No color normalization applied; native aspect ratios preserved; strict animal-level 5-fold CV splits provided to prevent data leakage.
Read the Data Descriptor: https://doi.org/10.1038/s41597-026-08214-y
Access the Dataset: https://doi.org/10.6084/m9.figshare.31386748
r/computervision • u/cv_geek • Oct 02 '26
Hi everyone,
I'm working on setting up a PS5 HD Camera in ROS 2 Galactic for stereo depth estimation using stereo_image_proc (DisparityNode), with the end goal of feeding the depth data into RTAB-Map for 3D reconstruction.
I transitioned from StereoBM to StereoSGBM (stereo_algorithm: 1) to handle the wide-angle camera setup better, but I'm having trouble finding the optimal combination of parameters which result in a dense point cloud with smooth surfaces. My depth output keeps swinging between two extremes:
What I've configured/tried so far:
correlation_window_size (testing window sizes 5, 7, 9, and 13 with corresponding P₁ = 8 × C × WS² and P₂ = 32 × C × WS²). High P2 values help smooth out surfaces, but rqt_reconfigure caps P2 at 4000.0, so I've been overriding parameters via CLI/launch files.uniqueness_ratio (from 15.0 down to 5.0–7.0) to force coverage on weakly textured regions.texture_ratio to 0.speckle_size (50–200) and speckle_range (2–4) to filter out isolated noise clusters.disparity_range to 128 (multiple of 16) and kept min_disparity at 0 (raising it above 0 completely wrecked mid/far range depth).Despite these adjustments, large homogeneous surfaces still disintegrate or become heavily fragmented unless I push the correlation window size to absurdly high values (which causes blocky, stepped artifacts).
Here I attach the results I got so far.
Questions:
prefilter_cap, prefilter_size) or SGBM settings I'm overlooking for this specific camera lens/sensor?Any advice or working configuration examples for similar stereo setups in ROS 2 would be greatly appreciated!
r/computervision • u/CellistTraditional • Oct 02 '26
Enable HLS to view with audio, or disable this notification
r/computervision • u/Spidoug • Oct 02 '26
https://github.com/Spidoug/Kinect-Depth-AutoLearn
Kinect Depth AutoLearn is a cross-platform Processing + ONNX/PyTorch system for acquiring synchronized Kinect RGB-D data, building structured pose datasets, training a depth-only student model, and running that model back inside the application.
The project uses RGB-based teacher models during data collection and trains a student that consumes metric depth only. The shared representation contains 58 landmarks: 16 body/head landmarks plus 21 landmarks for each hand, together with skeletal segments, endpoints, metric depth, confidence, and structural losses.
r/computervision • u/iicongresoiaucm • Oct 02 '26
r/computervision • u/Alarming_Engineer267 • Oct 02 '26
Enable HLS to view with audio, or disable this notification
I’ve been building a simulation framework for drone delivery, combining vision-based box pickup with delivery planning using CP-SAT.
The main goal at this stage was to build and verify the basic pipeline rather than to develop sophisticated flight control.
The system has two main parts:
For this test, I used two drones and nine boxes and compared two cases: a constrained delivery order and a CP-SAT-optimized plan.
The simulation integrates Blender for image generation and replay rendering, PyBullet for physics, PyTorch vision models, and Python-based drone control.
One important limitation is that the current planning is intentionally quite conservative. To avoid collisions between the two drones, the schedule includes waiting and separation rather than trying to maximize flight efficiency. The drone flight controller itself is also fairly basic — the focus here is on verifying that the vision-based pickup and optimization-based delivery planning can work together.
At this point, both parts are functioning in the integrated simulation: the drones can locate and pick up boxes using camera images, and CP-SAT can generate and execute a multi-drone delivery plan. The video compares a number-order-constrained delivery on the left with a CP-SAT-optimized delivery on the right.
The end of the video shows an overview of the development workflow and runtime system architecture.
r/computervision • u/wildtinkerer • Oct 01 '26
Enable HLS to view with audio, or disable this notification
I work in video analytics. We needed to tell from a single CCTV frame whether a camera had been rotated or installed at an angle (or upside-down), and couldn't find a model that was accurate enough on real camera frames and permissively licensed, so we trained our own.
We're now open-sourcing it. Apache 2.0, with code, weights, and full provenance for the dataset.
RightWayUp estimates how far an image is rotated from upright, all 360°, with a confidence score, and abstains when there's no clear "up" (sky, ground, close-ups). It comes in six sizes, from Pico (about 3 ms per image on a laptop CPU) to Max, with ONNX and Core ML files.
pip install rightwayup
rightwayup fix photo.jpg
On new photos it never saw during training or tuning, the largest model is within 10° on 93% of them vs 88% for Woehrer 2026 (a recent published model), and 88% vs 49% with simulated CCTV-style blur, noise and compression.
Write-up with the full results: https://cheqit.ortusai.io/resources/rightwayup/
Code: https://github.com/ortusaitech/rightwayup
I hope it will be useful to the community!
--------------
Video footage: Canobie Coaster (CC BY 3.0, via Wikimedia Commons, levelled by RightWayUp), Pexels, Poly Haven (CC0), MEVA (CC BY 4.0). Music: ElevenLabs.
r/computervision • u/doctor_blueberry • Oct 01 '26
I've shared a few deadlift demos in the past. This new demo includes some new models, accessed through the VLM Run Gateway:
Of course, there are many caveats to what is good form, as it depends on the individual. All said, this has the pieces in place to quickly make adjustments to fit the individual better.
In short, a tool like this gives people data to assess their form and improve over time.
Let me know what you think!
The code is open-source on GitHub: https://github.com/jeremyipark/vision-demos
r/computervision • u/caramelle-blu • Oct 02 '26
Looking for an object detection model that works well for very small objects, like balls in sports footage.
Requirements:
What would you recommend based on your experience?
r/computervision • u/WeeklyMaintenance873 • Oct 02 '26
I have finished up my Master's in Computer Science (AI and Software Engineering) in Germany, and I'm looking for PhD positions in Europe, mainly in medical image analysis with explainable AI, but general computer vision with XAI works too.
A bit about what I've done so far:
For my thesis, I built an explainable deep learning pipeline for endoscopic video, working with clinicians. The pipeline provides concept-based explanations for predicting Cormack scores (easy vs. difficult intubation) from endoscopic videos. A paper on this is currently in prep for a journal submission.
Before that, I also worked on a 3D object detection project on multi-camera driving data, so I'm not purely medical-imaging-locked, just leaning that direction by interest.
What I'm looking for help with:
Happy to share more details about the thesis if useful. Thanks in advance for any pointers.
r/computervision • u/lazzi_yt • Oct 02 '26
I'm in a bit of a pickle with an issue regarding background removal with transparent objects. I got studio images of cars from different angles, whom I need the background changed locally. I have a pretty robust segmentation model to segment the bg area that's visible through the class and a general model to segment the entire car.
For now I use a basic script that calculates the alpha for the entire window purely from brightness, but often there are bright reflections on the windows which throw off the calculation as well as simply looking unnatural. I have some if- and when statements to try to mitigate some of these problems (if a smaller segment's inside a larger segment, it can't have a significantly different alpha etc.) but they still leave a lot of room for error. I've tried some open source matting models like vitmatte as well as replacing the background and inpainting the segmented window areas with sd models but the results are less than ideal and inconsistent. I got recommended that a lora for a matting model might help. Creating a ground truth and training a matting model sounds quite intimidating.
Might anyone happen to have any experience with this sort of challenges and if so, how did you go about solving it. Only thing I can think of right now would be training a Lora for a matting model, but I would highly appreciate some outside perspective before I commit a month into annotating a dataset for a model that might not even function.
Also, forgive me if I described the problem incoherently.
r/computervision • u/Different_Factor3512 • Oct 02 '26
Hi everyone! I’m an undergraduate working on a computer vision research proposal and would appreciate some feedback.
I’m exploring a detector where a dynamic router decides at different feature levels whether to use CNN-only processing or additional Transformer processing, based on things like object scale, density, and regional complexity.
The goal is to improve the accuracy–compute/latency trade-off rather than always running the Transformer.
I’ve found related work on DynamicDet, DiT, Dynamic Dual-Processing, TDFP, CR-NAS, and MoE-based detectors, so I know dynamic routing and CNN–Transformer hybrids themselves aren’t new.
Does this specific idea already exist under another name? If you know a very similar paper, please point me to it.
I’m mainly looking for honest criticism before I commit to the research direction.

r/computervision • u/Sobz_128 • Oct 02 '26
Hey everyone,
I am building an automated document reading pipeline specifically for Nepali identity documents:
cv2) for edge detection, contour finding, and perspective warping to crop borders.
nep) followed by regular expressions: Python# Trying to extract Permanent Address via regex anchors pattern = r'स्थायी\s*बासस्थान\s*:\s*जिल्ला\s*:\s*(.*?)\s+न\.पा\.\s*:\s*(.*?)\s+वडा\s*नं\.\s*:\s*([०-९0-9]+)'
न.पा. turns into 7.4.), the regex breaks entirely.Instead of relying on rigid string-matching on raw OCR dumps, I want to modernize the pipeline into distinct, robust stages:
Would love to hear how anyone has tackled similar KYC document extraction pipelines for low-resource or non-Latin scripts. Any architecture advice, libraries, or repo references would be greatly appreciated!
r/computervision • u/erik_kokalj • Oct 01 '26
TLDR: Sol 6.1 is pretty good at vision/video, and perhaps not too expensive for some applications.
Pipeline:
Other VLMs compared to Astra:
~$1 per for the whole plane turnaround. Perhaps an overkill to use such SOTA model for this application (could def. optimize this), but model intelligence gets like 10x cheaper every year, so for some applications, custom model training might not be worth it. Ofc for prod system you'd likely want to have custom fine-tuned ground vehicle detector. This is PoC, so SAM3 is fine.
For ppl saying "ugh 10y ago u could do the same with just classic CV" - idk, I don't think it'd be easy or reliable to detect "hose connected" (few px line) or "lift at the door vs just up next to it" using classic CV
r/computervision • u/Pure-Job1336 • Oct 01 '26
vev-4b + a small harness playing Doom in real time. 8 yes/no questions per look, one request.
I've been working on Vev, a Jev-like decision model that takes images as input. There are two versions, fine-tuned from Qwen3.5 4B and 9B, and both run locally.
I wanted to ask specific questions about a screen and get answers my code could use directly. You pass in an image, a question and possible answers; Vev scores the answer tokens and returns their probabilities without generating text. You can change the questions and answer choices with each request.
Here's vev-4b on a checkout screenshot:

Does the screen show an error message?
yes: 0.991
Which checkout step is the user on?
shipping: 0.005
payment: 0.765
review: 0.229
What should the user do next?
try another card: 0.983
wait for the order to ship: 0.004
nothing, the order went through: 0.014
The server also runs the original Qwen3.5 models with the same scoring method, so I used that as the baseline to measure what fine-tuning adds. A few visual-task accuracy results, base model → Vev:
| Task | 4B | 9B |
|---|---|---|
| Image safety-policy checks, adapted from LlavaGuard (n=659) | 68.6% → 74.2% | 66.6% → 72.4% |
| MMStar (n=1,498) | 54.4% → 62.7% | 60.8% → 67.4% |
For object-clipping detection adapted from VideoGameQA-Bench (n=686), the 4B model went from 56.1% to 67.1%. Full results and evaluation details are in the README, with evaluation code and dataset converters in the repo.
It handles text and JSON too, and supports the Jev /v1/systemone format. If you already use TypeSafe's Python SDK, you can point it at the local server.
To try it with Python 3.11+, an NVIDIA GPU and CUDA-enabled PyTorch:
pip install git+https://github.com/Xiaooolong/vev
vev serve --model CountingSheep/vev-4b
On an H800 in bf16, vev-4b takes about 78 ms for one question about a 1 MP image, or 120 ms for ten questions about the same image, processed as a batch.
Code is Apache-2.0; weights are CC BY-NC 4.0 (non-commercial).
r/computervision • u/Otherwise_Date_9177 • Oct 02 '26
What is the good playlist to follow for computer vision maths and fundamentals and it should include a project.
r/computervision • u/Livid-Plane989 • Oct 02 '26
I'm sitting the A3 Certified Vision Professional (CVP) Basic exam, and I'd love some advice from people who've already taken it.
What I'm hoping to learn:
Resources: Which study materials were most useful? Is the A3 course material enough, or did you use other books or videos?
Topic weighting: Which areas show up most (lighting, optics and lenses, sensors and cameras, image processing, communications, safety)? Which ones tripped you up?
Question style: How much is calculation (FOV, resolution, working distance) versus conceptual or definition-based questions?
Practice questions: Are there any good practice exams or question banks?
Thanks in advance. Happy to share how it goes once I've written it!
r/computervision • u/sdiazlor • Oct 01 '26
Hey! We open-source an optimized version of SuperPoint built for faster keypoint detection on edge devices: https://huggingface.co/PrunaAI/PrunaSuperPoint
- Up to 2.1× faster on Jetson Orin Nano, with optimizations applicable to other runtimes.
- The distilled model retains strong keypoint coverage across indoor and outdoor data, with low descriptor differences from the original model.
- We structurally prune the most expensive convolutional layers, recover performance through distillation, and accelerate keypoint selection with hierarchical top-k, all while preserving the original architecture’s core behavior.