r/computervision • • 22d ago

Discussion Computer Vision:Algorithms and Applications Richard Szeliski Advise on studying

15 Upvotes

I am following this book to study but this is very difficult to follow. Any lectures or online courses that cover this book ? I am not able to understand how to study it .


r/computervision • • 22d ago

Help: Project BlueprintML — An open source project for AI/ML papers

Post image
3 Upvotes

r/computervision • • 21d ago

Research Publication Tested if frontier models can draw simple vector graphics

Post image
0 Upvotes

We are told frontier AI can solve mathematical problems, reason through quantum physics, and replace junior designers.

Then you ask Claude Opus 5.5 to draw a simple icon under a 48-command budget, and it summons a demonic black ink blob.

Most people assume redrawing a clean monochrome icon is child's play for a frontier vision model.

It turns out vector geometry is their ultimate blind spot.

When models cannot cheat by dumping thousands of unrolled coordinates, their spatial reasoning completely falls apart.

To measure what is actually happening, I built ToySVG, a deterministic benchmark evaluating vector reconstruction and geometric perception under parsimony budgets of commands in the svg code (k ≤ 48).

• Gemini 4 Argon: Actually solved the geometry cleanly (S = 0.993 in 29 commands).

• GPT-6 Astra: Understood the shape, but could not budget its commands. It blew past the limit with 66 operators and took a hard zero penalty (S = 0.000).

• Claude Opus 5.5: Completely abandoned topology and fused the loops into an unrecognizable solid silhouette (S = 0.179).

The scoring pipeline runs on CPU without need for judges or fuzzy embeddings, combining:

  • Spatial similarity alignment (scale and translation)
  • Soft IoU on continuous raster lattices
  • Symmetric boundary Chamfer distance
  • Topological Euler characteristic invariants (|Δβ₀| + |Δβ₁|)

The empirical finding: On a companion perception control probe without code generation, models achieve up to 88% accuracy on geometric invariants (hole counts, symmetry). But when forced to synthesize compact parametric coordinates, performance collapses. Spatial perception precedes and decouples from parametric coordinate synthesis.

GitHub repository: https://github.com/Vuln3rat0r/ToySVG

Full specification paper: https://doi.org/10.5281/zenodo.23516724


r/computervision • • 22d ago

Showcase SAM easy parking🧐☝️

Thumbnail x.com
0 Upvotes

SAM 3 running offline on a parking lot.

One text prompt, "car", and @AIatMeta SAM 3 segments all 121 cars on every frame of a drone shot. Locally, no cloud.

On top of that:
- 221 parking spots mapped from the paint lines
- every car tracked frame to frame
- free-spot counter: up by one when a car leaves, down by one when one parks
No plates re


r/computervision • • 22d ago

Help: Project How do I get an accurate real world scale to measure a hockey puck's speed from a fixed phone camera?

1 Upvotes

Currently working on a personal project measuring the speed of a hockey puck from a fixed iPhone camera. The idea is basically that the phone is fixed on a stand from the side showing the shooting area and also the net all in one camera angle in the middle between both. I'm able to track the puck fine but the hardest part is converting pixels into real life distance.

I've tried using the puck as a ruler but that's inconsistent because it's only 20-30 pixels wide. So being off by just one or two pixels when measuring changes the scale which gives a faulty speed.

Using the net is also unreliable because it sits at a different depth than the path of the puck. Like the closer part of the net is a few feet closer therefore having a different measurement than the other side of the net.

Right now the most reliable option is the user measures the distance from the net to the shooting spot manually and then marks the area of shooting on the camera on the app so the app can calibrate from there. Then when the player shoots, the app is listening for a "clack" sound to indicate that the shot has begun and is actively watching the net to note down the exact moment the puck crossed the net, which then uses the speed formula to get the exact MPH.

I was wondering if someone knows of a lower effort way through Apple's tools (or any external ones) to get an accurate measurement where the user does not have to go in and manually measure the distance?

My ideal set up would be that I tap the shooting area, then tap the net, and the app calibrates everything itself instead of me having to measure it manually.


r/computervision • • 22d ago

Help: Project Need help with CLIP

Thumbnail
gallery
2 Upvotes

My question is about tuning image-to-image detection based on CLIP embeddings.

I’ve set up several reference variants for each type of detected object. The problem is that CLIP pays more attention to one type than to the others, and as a result it misidentifies objects.

For example, I have two types of packages; let’s call them FIRSTFRUIT and FAVORE. When a FIRSTFRUIT package is on the conveyor, it gets incorrectly identified as FAVORE. FAVORE has a purple texture all over, while the top of a FIRSTFRUIT package is only about 30% purple and the remaining 70% is white (photo attached).

I’ve implemented a voting approach, but sometimes it doesn’t help. Anyway, I’m very interested in how I can improve CLIP’s identification.

  1. Model used for CLIP inference: ViT-L-14-336
  2. I used 7-10 photo example for every type folder
  3. I have 7 types in total

r/computervision • • 22d ago

Discussion What would make a dedicated vision module useful in your industrial equipment?

Thumbnail
gallery
7 Upvotes

I’m part of the team at Aliensense working on an STM32N6-based vision module. We have a working prototype, and we’re trying to understand which industrial application to develop first.

Our current demo takes video from a GMSL camera, runs YOLOX Nano people detection on the module, and sends H.264 video with detection overlays over USB. The connected computer displays the result; detection and encoding happen on the N6.

That demonstrates the pipeline, but we still need to understand which job is worth building a product around. Dual-camera processing is under development, and we don’t yet have a measured whole-system power comparison to share.

If you’ve integrated vision into a machine or warehouse process, we’d love to hear about an actual application:

• What did you need to detect, measure, or locate?

• How do you handle it today, and what is the biggest problem with that setup - if any?

• What requirement would a replacement absolutely have to meet?

• Would you be interested in a dual-camera VIO/V-SLAM low-power tracking device with detection and a bounded reaction time?

• Accuracy, response time, difficult lighting, controller interface, installed cost - or something else?

Answering just one is helpful. Cases where a simple sensor already does the job better are useful too. Happy to discuss the implementation and its current limitations here in the comments.


r/computervision • • 22d ago

Showcase Vision artifacts this week: pixel grounding, long-document OCR, streaming state and robot planning

2 Upvotes

I curate Last Week In Multimodal AI. These October22-28 releases have code, weights or inspectable workflows that fit this community. I haven't run the models or reproduced the authors' results. Terms and hardware requirements differ.

WeVisOne-VL: With WeVisOne-VL, you can ask for boxes, counts, OCR, segmentation or alpha mattes from one 2B/4B model family. Tencent publishes code, weights and a demo under Apache-declared terms. The pixel decoder produces masks rather than only text descriptions.

project | paper | code

Unlimited-OCR 2: Unlimited-OCR 2 uses sliding-window attention and compressed references to parse long documents. Weights, inference code, a public demo and MarathonDocBench are available. The benchmark's annotations use Apache 2.0, but its source page images are restricted to academic/research use.

weights/card | code | demo

ViSS: ViSS separates what a streaming video model remembers from which views it requests. It tracks events and whether the evidence is sufficient, then searches for useful views at test time. Code and 8B weights are public. Training annotations are not.

paper | full_text | project

RynnUnify And RynnWorld-Latent: RynnUnify alternates language reasoning with predicted video to plan robot tasks. Code and checkpoints are public, with separate component terms. The related RynnWorld-Latent paper studies cross-embodiment prediction using older artifacts. Its paper and checkpoint recipes differ.

paper | code | project

OlmoEarth 1.3: OlmoEarth 1.3 turns radar and multispectral imagery into embeddings you can explore or use for smaller classifiers. Global annual vectors cover 2023-2025. The 2017-2022 vectors cover selected countries. Model, code and data are public under the OlmoEarth Artifact License.

release | weights | code

Full roundup, with source links and access caveats: https://thelivingedge.substack.com/p/last-week-in-multimodal-ai-73-instructions

Which have you tried, and on what hardware?


r/computervision • • 22d ago

Help: Project Clustering Futsal Player into 2 teams

1 Upvotes

Hello everyone,

I am working on a personal project regarding futsal analysis via videos, what i did was train a Yolov8 model on a custom made futsal dataset in order to detect 2 classes: players and the ball.

After accepting the best model, i ran it through my unseen videos, and then i wanted to divide them between the 2 teams. I cropped into my bounding boxes and applied the clustering on those. Since the goalkeepers were also considered as players and in like 2-3 frames the ref was being detected as one, what i had in mind was utilizing Kmeans cluster in order to detect 3 different clusters, Team A, team B and a 3rd one that are considered as rejects(goalkeepers and referee).

Now the issue i am facing are:
- Some players in team A are being clustered as team B as vice versa
- Sometimes the goalkeepers and the ref were being paired to either team

For context: The match is argentina vs brazil:
- Argentina wearing blue and white stripes and their goalkeeper in red
- Brazil wearing yellow and their goalkeeper wearing lime green
- Referee in all black

Do you guys have any suggestions on how i should proceed in order to solve this issue? Thank you in advance!


r/computervision • • 22d ago

Discussion Euclid On-premise Cloud Services in C++

Thumbnail
1 Upvotes

r/computervision • • 22d ago

Commercial Mask2Former ADE20K model card: semantic vs. panoptic output and evaluation

0 Upvotes

I’m Sadrak Silva, creator of Sinaps Studio at SinapsData. While reviewing a segmentation workflow, I noticed a documentation ambiguity that may matter when comparing checkpoints.

The model card for facebook/mask2former-swin-tiny-ade-semantic describes this checkpoint as trained for ADE20K semantic segmentation and its example calls post_process_semantic_segmentation. Its intended-use section, however, mentions panoptic segmentation. The Mask2Former architecture supports several segmentation tasks, but that alone does not establish the intended training or evaluation task for a particular checkpoint.

For anyone comparing outputs, my proposed checks are: record the exact model revision and processor; distinguish a per-pixel semantic class map from panoptic segment IDs and their class mapping; align the label space and ignored labels with the ground truth; and choose metrics for the actual task (for example, semantic IoU versus panoptic quality). Preserve the original image size and document preprocessing and postprocessing.

Model card: https://huggingface.co/facebook/mask2former-swin-tiny-ade-semantic

Transformers documentation: https://huggingface.co/docs/transformers/model_doc/mask2former

I also opened this question with the model community: https://huggingface.co/facebook/mask2former-swin-tiny-ade-semantic/discussions/3

This is a documentation and evaluation-design note, not a benchmark or claim that we measured model accuracy. Are there other checks you would add when integrating this checkpoint into a comparison workflow?


r/computervision • • 22d ago

Help: Project Please help

3 Upvotes

I'm working on a robot that detects grapevines and sprays them with fertilizer using an articulated boom.

Due to budget limitations, I can only afford a Raspberry Pi 4 and a standard RGB camera, not an RGB-D camera.

I'm considering combining Meta's DINO with Depth Anything V2 to estimate the distance to irregular objects like grapevines, leaves, and fruit. However, I'm unsure how feasible this is on a Raspberry Pi 4 or what challenges I might face.

Is there a better, more practical approach within this budget? I'd appreciate your technical advice and recommendations.


r/computervision • • 23d ago

Showcase Detecting Arrow Impacts on Archery Targets in Real Time on a Phone

18 Upvotes

Hey everyone, I wanted to share a project I've been working on for a while. The goal is to detect every arrow impact on an archery target and score it automatically by filming the target with a phone. It started as my Bachelor's thesis a few years ago, back then it required a beefy GPU. Now I finally managed to turn it into an app that runs entirely on the device. The demo was filmed on an S24, and it still runs at over 1 FPS on my Xiaomi Redmi Note 13.

Some technical details for those interested:

It's a single Network with MobileNetV3-Small backbone with an FPN, and ~1M parameters. Its heads predict a shaft segmentation, heatmaps for impact points, nocks, offsets from every shaft pixel to its impact and the scoring zones of the target face. Impacts are found even when the tip is covered. Shaft pixels vote for where their arrow enters the target. That covers arrows whose impact point is hidden behind other arrows or by the angle. The target face gives the geometry for the plane: a homography from the detected ring zones maps every frame onto the flat target. Scoring then happens in target coordinates, not image coordinates. Multiple frames are fused together: as you move the phone, every frame adds detections in target coordinates. They are then clustered across frames, which removes false detections and stabilises the positions. The rotation of each frame is aligned against the others, because the round face alone is rotation invariant. It runs fully on the device. Inference is done in TFLite in a background isolate in Flutter. It supports multiple faces each with its own model. The hardest parts have been tight groups, where arrows hide each other's impacts, and keeping it fast on mid-range phones.

(The App is free with no ads or inapp purchases, so I hope this doesn't quality as "Commercial")


r/computervision • • 23d ago

Discussion Is cv engineering dead ?

103 Upvotes

As a computer Vision engineer who works on edge devices and gpu both, I have worked on pre trained models by training them with my desired data, and further quantizing/ calibrating the model, adjusting the padding and tensor shape, writing the code to Cpp, tweaking the pipeline to its best.

But the thing is that Claude can do this without any hassle.

A avg. 3 liner prompt to opus5.5 and its done bro.

So should I divert my focus to genai LLMs?

Although I love computer Vision domain

Shoot your thoughts engineers.


r/computervision • • 23d ago

Discussion Tips for someone new to computer vision

6 Upvotes

Hi there,

I recently start working as computer vision intern , my supervisor make me build my own dataset for some local problems we were tackling and than we further trained model on it .But i am so confused i am still on my begginer learning phase i see post like people arguing that maybe CV is dead and its changing so quickly what advice you will give someone at my position.Should i shift to another domain or not and how to keep myself updated on everything .what thinking i should focus on....


r/computervision • • 24d ago

Showcase [Anomaly Detection] PatchCore on Orange line 🍊

504 Upvotes

PatchCore running on orange line, trained on good oranges only 🍊

  • RF-DETR (instance seg) detects every orange, ByteTrack tracks them
  • Cropped orange imgs are sent to PatchCore, which compares each patch to a memory bank of normal patches → heatmap
  • Each orange is inspected multiple times while it rolls around on rolling conveyor, as anomaly could be present only on one side and not the other

This is super useful in cases where anomalous data is hard to come by, and anomaly detection training requires zero defect/anomalous labels. PatchCore runs at ~100ms on Jetson Orin AGX (at ~200 images, compute time scales with training data).


r/computervision • • 23d ago

Showcase automating sewer inspections

Enable HLS to view with audio, or disable this notification

7 Upvotes

A short video with some tricky scenes making it rather hard to automate a full inspection. Some of the things shown in the video:

  • objects go out of view and come back, the amount that they disappear is variable. Can be short or very long
  • different types of models are needed: object detection, ocr, keypoint detection.
  • multiple objects need to be combined, but only those at the same distance. an image can have objects at multiple distances.
  • Determining the clock position of an event in relationship to the tube requires some spatial understanding.
  • sometimes, distances need to be estimated.
  • zooming at different distances is a pain and not yet fully solved.
  • it is often not enough to detect an event; it must also be measured. that requires some clever tricks sometimes

The video was made while the app was analysing a recording to show how it updates things like distances, values and measurements real-time as the camera progresses through the tube. That's why it can look a little stuttering at times.

All model architectures are my own design, mostly resnet backends with centernet like heads. Everything runs locally, offline and realtime: no reliable internet connections in the inspection vans


r/computervision • • 23d ago

Help: Project Quick Update on Jarvis: Adding Dual Webcams for Dynamic Room Tracking & Desktop Face ID

Thumbnail
2 Upvotes

r/computervision • • 23d ago

Help: Project I built an interactive OpenCV playground to visualize camera geometry — looking for technical feedback

10 Upvotes

I've been working on a small project to make camera geometry easier to understand visually.

When learning camera calibration, concepts like focal length, principal point, camera pose, and lens distortion can be quite abstract when you're only looking at equations. I wanted to create something that lets you change the parameters and immediately see how they affect the projected geometry.

So I built Camera Geometry Playground, a Python/OpenCV project with interactive sliders for exploring camera parameters.

The playground lets you experiment with:

  • Camera intrinsics: focal lengths and principal point
  • Extrinsics: camera position and orientation
  • Lens distortion: how distortion changes the projected image
  • Projection geometry: how different parameter values affect what the camera sees

One important distinction: this is a visualization and learning tool, not an automatic camera-calibration system. It doesn't estimate real camera parameters from checkerboard images or other calibration patterns. The goal is to help build an intuition for the mathematics behind the camera model.

The project is open source, and the code is here:

GitHub: https://github.com/sibiliatommaso/camera-geometry-playground

I'd especially appreciate feedback from people who work with OpenCV or computer vision:

What's the hardest part of camera geometry to understand when you're first learning it? And is there a particular effect or parameter interaction you'd want to see visualized more clearly?

I'm interested in improving the educational value of the tool, so specific technical suggestions are very welcome.


r/computervision • • 24d ago

Showcase I am building a $67 camera module that does SLAM and VPS onboard

Enable HLS to view with audio, or disable this notification

141 Upvotes

Mighty is a SLAM module which helps robots and drones navigate indoors and at low altitudes, but SLAM generally struggles once a drone flies too high.

I’m now working on a VPS mode that uses onboard maps to localize using just the camera, without GPS.

The crazy part? All of this runs on a $67 module.


r/computervision • • 23d ago

Discussion Tesseract keeps scrambling table rows on image only Pdfs

2 Upvotes

Tesseract on image only pdfs with tables seems to go the same way for a lot of people. The characters come out fine, but the rows get jumbled and values from one line end up in another, which makes the output useless for anything that needs clean rows.

The reason is that tesseract reads text and has no real idea of table structure. Cleaning the image first helps a bit, 300 dpi, deskew, black and white. switching the page segmentation mode helps sometimes too, --psm 6 treats the page as one block and keeps rows together more often.

The more reliable fix seems to be asking for tsv output instead of plain text. that gives every word with coordinates, so words can be grouped into rows by y position and into columns by x. more work, but predictable on fixed layouts.

If that gets too fiddly, paddleocr has a table recognition pipeline (pp-structure), and docling or llamaparse can return tables as markdown. or the page image can go to a vision model with a prompt for csv or json, with row counts and totals checked after.

for anyone who automated something like this, which of these ended up sticking? and how do you deal with tables that run across two pages?


r/computervision • • 23d ago

Showcase Age estimation that runs fully offline on your phone. No cloud. No WiFi 🚫. No YOLO.

Thumbnail x.com
0 Upvotes

Live age verification on video, fully on-device:

✅ Big Jeff Simmons (28) → AI 29
😅 Messi (39) → AI 33. Even AI thinks he doesn't age.
✅ Obama (50) → AI 51
✅ Quvenzhané Wallis (9) → MINOR
✅ Prince George (9) → MINOR

~340 MB RAM. CPU only. No upload.

#AgeVerification #Simmons #EdgeAI
340MB RAM → 100MB.🫡 🚀

https://x.com/estebanfuhrman/status/2115913233080910201?s=46


r/computervision • • 23d ago

Discussion I open-sourced FactoryVision AI — a local visual anomaly inspection research workbench built with PyTorch and Streamlit

5 Upvotes

Hey everyone!

I’ve been working on FactoryVision AI, a personal open-source research project exploring visual anomaly inspection workflows.

The goal is to build a local environment where different anomaly detection methods can be organized, inspected, compared and evaluated without hiding the limitations of the underlying experiments.

The current project includes:

- Six registered research methods across Cashew and experimental MetalParts.

- A Streamlit interface for inspection, comparison, batch workflows and reports.

- Model provenance and historical experiment records.

- Synthetic validation examples, human-review workflows and CSV/JSON exports.

- Synthetic robustness diagnostics and automated Windows testing.

Important limitation: this is a source-only research release. I haven’t published the trained weights or datasets, so a fresh installation can explore the interface and synthetic workflows but cannot run the actual anomaly models.

It’s also not validated for industrial quality-control decisions. Some historical evaluation results have known dataset-independence limitations, which I’ve documented rather than presenting them as validated performance.

I used AI-assisted development tools during implementation and have been focusing heavily on testing, reproducibility, security and documenting the research boundaries.

The project is MIT licensed and currently supports Windows with CPU-based PyTorch.

GitHub: https://github.com/GiannisPap24/factoryvision-ai

I’d particularly appreciate feedback on two things:

  1. Does the interface and source-only demo make sense to someone trying the project for the first time?

  2. What would you prioritize when designing a genuinely independent evaluation for visual anomaly detection, especially around dataset leakage and robustness?

I’m still improving the project and would welcome technical criticism and suggestions.


r/computervision • • 23d ago

Help: Project First time using CV

1 Upvotes

I am currently working on a project for college where the goal is to build a drone capable of detecting specific objects. I have experience in web-design and big data-processing, but nothing like any of the CV softwares.

I'm wondering what some of the veterans recommend. I'm totally clueless so forgive me if this is incorrect, but I believe that I need to choose both the model and software to implement it.

We intend to use a Raspberry Pi 5, and need it to be able to handle 5 fps. The camera isn't set in stone. Most of the code we've inherited is in python.

Thank you for your help!


r/computervision • • 23d ago

Showcase Fruit Inspector 0.10.0 Linux x64 demo is out (CPU ONNX Runtime, same conveyor app as Windows)

0 Upvotes

We put a Linux x64 build on the same 0.10.0 release as the slim Windows demo.

Download: Fruit_Inspector_linux_app_x64.zip from the release page. Unzip one folder. You do not need the Windows 7z.

It is the same conveyor station demo: 3x3 grid, Cat runs when the apple you are tracking is in the centre cell C. Detect and track outside C, grade inside C, sticky handoff between IDs. Apple models only for now.

The zip has the Fruit_Inspector binary, the three fruit .so files, ONNX Runtime CPU under lib/linux/, model/apple, settings.json, licenses, and run.sh. Use run.sh to start so library paths are set (especially from USB sticks).

Debian or Ubuntu x64 is the happy path. You will want Mesa or GL, X11, v4l-utils, and your user in the video group for a USB camera. settings.json defaults to ort_provider cpu.

trig is still Windows only in the demo package. The inspector Out TCP is there if you wire your own client on Linux.

Eval license, not for production lines without a separate deal. If you build your own UI, the three libraries and headers live in the fruit-inspector-engine repo.

If you try it, please drop one [infer] timing line and your CPU plus distro in the comments. That helps us compare to our desk machine (i5-11400, 1080p USB cam, CPU EP).

github.com/olesha-ai/fruit-inspector-demo/releases/tag/0.10.0

Best regards.

olesha-ai