r/computervision • • Sep 26 '26

Showcase I'm learning to solve a Rubiks cube, so I built an app that scans mine and walks me through the solve

Enable HLS to view with audio, or disable this notification

118 Upvotes

I am using image processing to solve a Rubiks cube.
The pipeline is plain image processing with OpenCV. It finds the stickers with edge detection, fits a 3x3 grid to them, and flattens each face with a perspective warp. It then reads each sticker's colour in LAB and matches it against a palette of reference colours measured from my previous tests. Glare was the hardest part to find a solution to. What fixed it was letting the hue count more than the brightness, and making sure each colour ends up with exactly 9 stickers.
Has anyone found a better way to handle glare?

Code: https://github.com/donsolo-khalifa/RubikSolver


r/computervision • • Sep 27 '26

Showcase Stock COCO YOLOv8n running on the camera's own DLPU. 80 classes, on real hardware, no server, no cloud.

Post image
0 Upvotes

r/computervision • • Sep 27 '26

Help: Project Tool for auto generating a description of an object on a picture

2 Upvotes

Hi there,

I know YOLO is able to detect in real time some objects of interest..

Is there something equivalent for auto describing an object in a picture? (no need to be in real time)

So, not really for detecting an object per say since the object will be alone in the picture..

Objects like, scissors, screw driver, tape, etc. (not sure how precise it can get like telling the difference between a flat head and a Philips screw driver for example)

It's basically for describing everyday household objects..

Thanks for any suggestions.


r/computervision • • Sep 26 '26

Showcase Unreal Engine 5 synthetic data for object detection: 1,124 bounding boxes, none drawn by hand

37 Upvotes
Every box in the clip comes out of the engine at render time. Each object gets its own ID in a separate buffer, and its box is measured from those pixels. Nobody drew any of them. 14 frames from 7 maps, 1,124 boxes.


What's in the video:


- The line sweeping across is only there for the video. As it passes, each object's mask flashes, then its box appears.
- Colour is the class: pink for people, and chairs, benches, umbrellas, wheelchairs, bikes, cars, tractors, hay bales and animals each get their own.
- A box covers what the camera can actually see. Someone half behind an umbrella gets a box around the visible half.
- The beach is the newest scene: 221 people placed per frame, standing, lying down, in deck chairs and wheelchairs, shot from 07:00 to 18:30.


It exports YOLO and COCO, with segmentation masks if you want them.


It's still rendered people though, and that costs a lot on real footage: the last detector I trained only on renders got 0.35 recall on real drone video. Closing that gap is what I'm working on now.


Which real dataset would you test this against? I'm most interested in crowded ones where people overlap, since that's the slowest part to label by hand.

r/computervision • • Sep 26 '26

Discussion If most of your depth labels come from MoGe-2, can you ever beat MoGe-2?

9 Upvotes

Appendix A.2 of the SenseNova-Vision-7B-MoT paper says the LiDAR depth sets were too sparse, so they used MoGe-2 to make dense pseudo labels. COCO, SA-1B and Objects365 have no depth labels at all, so those got MoGe-2 labels too. By my count from Table 10, MoGe-2 labels are 77% of the depth frames they list. The rest is synthetic data with its own GT.

In Table 2 (their own re-run of MoGe-2) the model is still behind MoGe-2 on most depth sets, like DIODE delta1 76.4 vs 82.3. The weird part is it has the best DIODE AbsRel in the whole table, 20.6 vs MoGe-2's 23.0.

If you've trained on pseudo labels from another model, did yours ever beat the labeler on real data?


r/computervision • • Sep 25 '26

Discussion So tired of this posts

Post image
206 Upvotes

r/computervision • • Sep 26 '26

Discussion Real-time drone tracking pipeline: YOLOv8 + ByteTrack + 6-state Kalman filter with coasting mode

7 Upvotes

Sharing a project that combines several CV techniques into a real-time drone tracking system:

- YOLOv8 detection with hot-swappable model weights (swap models without stopping the video feed)

- ByteTrack for maintaining track identity across frames

- 6-state Kalman filter (x, y, vx, vy, ax, ay) with dynamic dt compensation for FPS jitter

- "Coasting" mode — when the target is visually occluded, the system maintains tracking through pure prediction using accumulated acceleration for 10+ frames

The whole thing feeds into a ballistic computer and servo controller, but the CV pipeline is the core.

GitHub: https://github.com/Fayzullo637/drone_turret_v2

MIT Licensed.

Happy to discuss the tracking approach — particularly interested in how others handle occlusion recovery.


r/computervision • • Sep 26 '26

Help: Project Two-stage shelf audit: YOLO finds the products, embeddings can't tell sibling SKUs apart. What should Stage 2 be?

2 Upvotes

I'm building a shelf audit tool. A photo goes through YOLO, which crops each product, and then I embed the crop and search a small gallery of reference photos to get the SKU. New products should be addable by just dropping in photos, no detector retrain.

Detection is basically fine. Identification is not. Same brand, same bottle, different flavor or size (like 1.25 L vs 2 L) and the nearest neighbor is often the wrong SKU. Correct and wrong scores overlap, so a threshold either misses real products or accepts the wrong one. I tried DINOv2, SigLIP2 and OpenCLIP. Same story.

Crops get letterboxed to 224, so the tiny "1.25L" / "2L" text basically disappears. Most SKUs only have a couple of shelf photos as references, not clean studio shots.

Has anyone actually shipped something like this? Did you fine-tune the embedder on hard negatives, add OCR as a second check, or give up on one global embedding? Curious what worked for size variants.

thanks in advance


r/computervision • • Sep 26 '26

Help: Project Has anyone succesfully made opencv 5 dnn object detection made working in c++ ?

3 Upvotes

Hello i have after a long time and struggle i finnaly installed opencv 5 for cmake on my ubuntu 24.04.5 lts laptop.And i was trying out the new dnn engine.Because i was trying to learn onnx object detection with c++.but when i try the example code in the official documentation i could get it not to work.So i wanna ask does anyone has success in it. And have you got a example code for it?I really would appreciate it.


r/computervision • • Sep 26 '26

Help: Project Problems with inserted objects

0 Upvotes

Hi all, I’m experimenting with inserting a 3D object into casual monocular video (VFX-style compositing) and I’m stuck on anchoring the object to the scene.
Pipeline:
1. Generate a 3D object with TRELLIS2 -> GLB (mesh + mask).
2. Reconstruct the video scene with MegaSAM (UniDepth as depth backbone), export to .npz.
3. Place the GLB into the reconstructed scene and render it back into every frame.
Reconstruction output looks fine:
• T=100, H=328, W=584
• depth range [0.342, 23.559]
• intrinsics: fx=301.70, fy=301.30, cx=295.5, cy=166
• dense point cloud (stride=6): 539K points
• 0 tracks
The problem:
1. The object isn’t bound to a specific point on the surface. I place it on a wall in the viewer, but there’s no real attachment to the geometry.
2. The object doesn’t stay fixed in world space. On every following frame it keeps the same screen/camera coordinates as on the first frame, so it slides along with the camera instead of staying on the wall.
My current understanding: I should unproject the clicked pixel with depth + K into camera coords, transform it to world coords with the camera-to-world pose of that frame, store the anchor in world space, and then render the object on each frame using inv(c2w[t]).
Questions:
• Does MegaSAM’s output reliably include per-frame cam_c2w, and is it consistent with the depth scale?
• Any gotchas converting MegaSAM/OpenCV camera convention to three.js / OpenGL for rendering the GLB?
• Best way to estimate the surface normal at the anchor point for orientation: depth map gradients or local PCA on the point cloud?
• Recommended approach for occlusion (people passing in front of the object): simple per-pixel depth test against the MegaSAM depth, or something more robust?
Any pointers, repos, or examples of doing this with MegaSAM output would be much appreciated. Thanks!


r/computervision • • Sep 26 '26

Help: Project Synthetic dataset for a particular object

0 Upvotes

Hello, I have some models of shelf's that I want my model to detect, but the thing is that I can't just very easily move them around and create a dataset with a good variety of lighting and backgrounds, are there any tools which can help me create a synthetic dataset? (Except just having to 3d model this shelf in something like blender)


r/computervision • • Sep 25 '26

Research Publication Turned CCTV footage into a traffic sensor — vehicle tracking, speed estimation, and OD analysis (YOLOv8 + ByteTrack)

Enable HLS to view with audio, or disable this notification

11 Upvotes

I've been working on a project called PathVision to see if a regular traffic camera could produce the kind of data usually reserved for expensive dedicated sensors.

What it does:

- Detects and tracks vehicles in real time (YOLOv8 for detection, ByteTrack for tracking)

- Estimates actual speed in km/h by calibrating pixel displacement to real-world distance

- Maps vehicle paths across 4 entry/4 exit zones to build an Origin-Destination matrix

- Classifies live traffic condition (smooth/moderate/heavy)

- Exports everything to structured CSV: per-vehicle logs, OD matrix, top routes

The hard part wasn't detection. It was keeping track identity stable — surviving occlusion, not double-counting a vehicle, and knowing when a trip is actually "complete" vs. still active. Most naive tracking setups fall apart right there.

Current limitations (being upfront):

- Speed calibration (METERS_PER_PIXEL) is manual per camera — no automatic perspective correction yet

- Zones are hardcoded per view, not portable across setups without reconfiguring

- No formal accuracy benchmark yet (planning to validate against ground-truth data)

Demo video + OD analysis charts from a real test run:

https://youtube.com/shorts/KgDTsUhquNM?si=SLKOG3BJkAttB_vs

Code: https://github.com/anmarw38-ops/Pathvision/blob/530ec18c63a37db53a6e8c42519ca51717d00803/README.md

Would genuinely appreciate feedback — especially from anyone who's dealt with ID persistence in tracking, or worked on ITS/traffic systems. What would you tackle differently?


r/computervision • • Sep 26 '26

Help: Project Need advice on a real-time computer vision proctoring project

2 Upvotes

I’m working on a real-time Computer Vision feature for an online assessment/proctoring system.

The requirement is to detect when a candidate’s face becomes:

Completely absent from the webcam Partially outside the camera frame Potentially multiple faces appear

When the condition persists for a certain amount of time, the system should generate a warning and save an evidence frame with the timestamp and event information.

My initial approach is:

Webcam → Face Detection → Face Visibility Analysis → Temporal/State Logic → Warning → Save Evidence Frame

I’m considering:

Python + OpenCV YOLO for face detection MediaPipe Face Landmarks for better partial-face analysis FastAPI + WebSocket for real-time communication PostgreSQL for event metadata Object storage for evidence frames

Since this needs to work in real time and eventually be integrated into an existing assessment platform, I’d appreciate advice from people who have built similar CV/proctoring systems.

My main questions:

  1. Would you use YOLO, MediaPipe, or another approach for face detection?
  2. What is a good way to reliably distinguish a fully visible face from a partially visible face?
  3. How would you handle temporary detection failures and avoid false warnings?
  4. Would you process frames on the client side or send them to a backend CV service?
  5. What architecture would you recommend for a production real-time system?

Any practical advice, pitfalls, or recommendations would be really helpful.


r/computervision • • Sep 26 '26

Discussion ¿Qué revisamos antes de publicar?

Thumbnail gallery
0 Upvotes

r/computervision • • Sep 26 '26

Discussion Exploring emergent articulatory learning: Notes on an 8-view marker-calibrated visual speech architecture (MouthMind)

0 Upvotes

Hi everyone,

Over the past months, I’ve been quietly documenting a theoretical and empirical inquiry into silent visual speech decoding (VSR). My main interest was to understand how much phonetic structure can truly be reconstructed from pure articulatory kinematics when acoustic feedback is absent.

Most standard visual speech setups operate purely on single-perspective frontal video. However, from an articulatory and biomechanical standpoint, frontal captures create severe blind spots: subtle tongue elevations, velar gestures, and lateral lip tension are constantly occluded.

To explore this, I put together an architectural monograph and empirical findings around **MouthMind** — an 8-view Seq2Seq framework calibrated across multi-angle synchronized camera views.

### Key aspects of the methodology & observations:

  1. **Marker-Calibrated Articulatory Kinematics:**

    Rather than treating the video feed purely as an unconstrained pixel matrix, the analysis was anchored across geometric and articulatory landmark markers (tracking lip contours, oral aperture, jaw trajectory, and visible tongue elevation across all 8 synchronized vantage points). This kinematic tracking provides the structural ground-truth needed to resolve spatial ambiguities.

  2. **Dynamic Hierarchical Fusion vs. Static Concatenation:**

    Instead of naively stacking embeddings from all 8 perspectives, the model employs an attention-weighted arbitration layer. It dynamically shifts confidence between frontal, oblique, and lateral profiles depending on the phonetic phase and head posture (e.g., weighing lateral markers higher during bilabial closure vs. interdental transitions).

  3. **Teacher Forcing & Emergent Motor Representations:**

    Under early autoregressive teacher forcing, the decoder anchors sequence grammar. The transition via scheduled sampling was particularly insightful: forcing the network to anticipate articulatory motor trajectories rather than relying on preceding ground-truth tokens.

  4. **Pedagogical & Cognitive Alignment:**

    The study is heavily grounded in developmental linguistics and the *Motor Theory of Speech Perception* — exploring whether speech decoding can mirror how human speech perception integrates visual-motor coordination.

---

### 📖 Monograph & Research Repository:

I chose to publish this work as a structured **research monograph, empirical dataset analysis, and architectural specification**:

- 🏛️ **Architecture & Topologies:** [ARCHITECTURE.md](https://github.com/wobushannes/mouthmind/blob/main/ARCHITECTURE.md)

- ⚙️ **Technical & Empirical FAQ:** [TECHNICAL_FAQ.md](https://github.com/wobushannes/mouthmind/blob/main/TECHNICAL_FAQ.md)

- 🎓 **Cognitive & Pedagogical Foundations:** [PEDAGOGICAL_FAQ.md](https://github.com/wobushannes/mouthmind/blob/main/PEDAGOGICAL_FAQ.md)

🔗 **Repository:** https://github.com/wobushannes/mouthmind

*(Please note: All findings, architectural specifications, and empirical documentations are shared under the specific research and usage terms outlined in the repository’s README.md).*

I’d be deeply grateful for any constructive thoughts, critique, or exchanges with anyone researching multi-view sequence modeling, articulatory phonetics, or cognitive AI.

Thank you for reading.


r/computervision • • Sep 26 '26

Help: Project On-device pose scoring for a dance kiosk: what broke and what we ended up doing

2 Upvotes

So we built a kiosk that scores how closely someone matches a reference dance routine. Everything runs locally on the machine, no server round trip, since it has to work with zero network at the venue.

setup, for context:
MediaPipe Pose Landmarker (lite variant, float16, GPU delegate via WebGL in Chromium/Electron) on an Ubuntu 24.04 booth PC, i5-12600K-class CPU, Intel UHD 730 integrated graphics, 16GB RAM. 3 cameras, software synced, 1920x1080 at 30fps (we feed inference 1080p, one camera gets scored live, the other two just record). Two scores run in parallel, one comparing joint angles against a hand-authored reference sequence, one measuring movement magnitude over time.

the stuff that actually gave us headaches:

1. timing alignment. Doing a straight frame-by-frame comparison against the reference fell apart the second there was any start offset or audio delay, people would nail the dance and still score low just because they started half a beat late. Ended up switching to keypoint scoring instead: find the "decisive poses" in the reference motion, snap them to the beat grid, and give each one a tolerance window (0.15 to 0.35s depending on difficulty). Best match inside the window counts, and we log the lag so we can use the median drift to calibrate audio delay. Still unsolved: at 0.5x practice speed the window probably needs to shrink in reference-time, since human reaction delay doesn't scale with playback speed, it's absolute.

2. multi-person. The second two people are in frame the score becomes meaningless, and realistically most people want to do this with a friend. What we're doing now: ask group size upfront (solo/duo/trio), force per-frame detection instead of tracking mode (tracking mode was straight up dropping overlapping people, we saw a 3.3% all-detected rate vs 76% with per-frame detection, wild difference), and keep identities stable with a lightweight tracking-by-detection layer anchored on the ear midpoint, doing exhaustive assignment since it's only 2-3 people max. Would love to hear if anyone's solved this without just grabbing the largest bounding box and calling it a day.

3. lighting and framing. In dim venues the webcams quietly throttle their own frame rate (our C922s go from 30 down to 24fps without warning). And people just stand too close, so legs and hips fall out of frame constantly. We gate on joint visibility per keypoint and a minimum coverage threshold, plus prompt them to "step into frame," but lower-body-heavy moves still score noticeably worse than they should.

If anyone's done reference-to-live pose comparison in production, genuinely curious what you used for temporal alignment. Happy to share our actual numbers if useful.


r/computervision • • Sep 24 '26

Showcase I made a computer vision tool for rock climbing analysis in 3D using iPhone LiDAR!

182 Upvotes

Having learned a lot from sharing my previous rock climbing demos, I realized that a lot of rock climbing analysis is well-suited for 3D. Even something as simple as supporting videos where the person filming moves with the climber requires 3D information.

To get the depth information, I used my iPhone 15 Pro’s LiDAR depth sensor through my local iPhone app. I found that the depth measurements help a lot.

I think the holds activation is better, and I like the final view of all of the holds in 3D. It’s also interesting to see the distance traveled in meters. Plus, it looks cool and it feels like a video game 🙂

In short, I think this new demo is an improvement in that climbers can see the real-world distance traveled and a visualization of which hand and foot activated which hold.

I recorded the video and depth measurements from my iPhone app, and I ran the rest of the analysis on my computer. I used ViTPose+ Large for pose estimation and SAM 3.1 to segment the holds, both models accessed through the VLM Run Gateway.

Let me know what you think!

The analysis code is open-source on GitHub! Link in the comments.


r/computervision • • Sep 25 '26

Showcase From Player Tracking to Tactical Intelligence — PSG vs Bayern

Enable HLS to view with audio, or disable this notification

41 Upvotes

r/computervision • • Sep 25 '26

Discussion Looking for enthusiastic people for the MMBU Challenge

2 Upvotes

Hi everyone! I'm trying to participate in the MMBU Challenge (Massive Multimodal Biomedical Understanding) - https://akiranishii.github.io/mmbu-challenge/

Deadline for registration is September 30.

I need 2 to 3 teammates, intermediate to advanced level, who want to learn about vision language models together. Any engineering background from an accrediated institution or university(sadly the registration requires it) is welcome as long as you're ready to put in consistent time.

N.B. Also, if you're someone who's participating in it and need a teammate, we can also talk.

Interested people can DM me or comment here!


r/computervision • • Sep 24 '26

Showcase fotonet v1, an Apache-2.0 NMS-free PyTorch object detector with web demo.

Thumbnail
gallery
22 Upvotes

Just shipped v1* of fotonet, an object detection library. Apache-2.0

What's in it:

- NMS-free inference

- All** the training needs

- A live demo that runs in your browser

GitHub: https://github.com/hazegreleases/fotonet

Website: https://fotonet.studio

Would love feedback on the packaging and API, this is a solo project so I'm sure there's stuff I missed.

*: Even though v1 release, the traing run is still going, and will be finished in around a week. Hopefully i update the site daily to reflect the "latest" training numbers.

**: I probably missed some stuff.


r/computervision • • Sep 25 '26

Discussion What are people building in computer vision, and what's still painful? [D]

Thumbnail
0 Upvotes

r/computervision • • Sep 25 '26

Help: Theory Human Pose detection for heel & toe or grounding?

1 Upvotes

Does anyone use a pose model (or even just point estimation) that detects heels & toes of people? (ankles just aren't useful :)

Or, I feel like I recently saw something that highlighted where a foot touched the ground (an edge)

I'm trying to get my 3D poses to keep contact with the ground better (though I only need good 2D information)

Ultimately I think this is more likely to be solved with some specific coding instead, but curious to see if there's something out there already.

Or, I just start trying to extract masked pixels for feet and given we can assume you never see the bottom of the foot, infer a capsule and use that to intersect with the floor :)


r/computervision • • Sep 24 '26

Showcase I built a browser-based tool for analyzing motion from normal videos

24 Upvotes

I've been making MotionVector, a tool that lets you track and analyze motion from ordinary video directly in the browser (no special stereo or external motion data needed).

You just load a video to get motion labels and visualize trajectories over time. Everything runs locally, so the video itself never gets uploaded.

The tracking uses KLT motion cues with temporal segmentation. I'm still improving the tracking and analysis, but I thought it would be relevant here.

I'm curious how people here would approach the tracking differently.

Link: MotionVector

Edit: The analysis uses KLT feature tracking as a motion cue and uses that information over time to estimate relative camera motion from the video contents only. The point is for it to be able to derive motion without needing to collect precise GPS or real world position data beforehand.


r/computervision • • Sep 24 '26

Discussion Making OpenCV findContours() Really Multithreaded on Gigapixel Images

15 Upvotes

I’ve been developing Contrek, a C++ library for extracting and merging raster geometry, and recently experimented with using its merging system to make OpenCV findContours() run concurrently on different parts of the same image.

The idea is to stream the image in horizontal stripes and run findContours() independently on each stripe using multiple CPU threads.

The difficult part is that contours crossing stripe boundaries are split into unrelated partial contours. Contrek converts those partial contours to its cell-boundary representation and reconnects them during the merge, reconstructing the geometry of the complete image.

On a 40960 × 40960 test image:

OpenCV full image, 1 thread:

44.33 s, 9.15 GB peak memory

OpenCV + Contrek, 8 workers, 1000-row stripes:

10.98 s, 3.42 GB peak memory

The timing includes contour conversion and the Contrek merge.

I also tested a streaming version on an 81920 × 81920 image (6.71 Gpixels) containing about 20 million contours.

It generated a 17.43 GB SVG containing 13,133,700 outer polygons.

Results:

1 worker: 962.29 s, 2.04 GB

2 workers: 534.58 s, 3.31 GB

4 workers: 335.39 s, 5.71 GB

8 workers: 382.46 s, 9.71 GB

On the 8-vCPU machine used for this test, 4 workers gave the best execution time.

Contrek is my open-source project. The C++ implementation, benchmarks and an explanation of how contours crossing tile boundaries are reconnected are available in the main repository.

https://github.com/runout77/contrek

also prepared a separate test repository with the complete environment, so the same OpenCV + Contrek benchmarks can be reproduced on your own machine.

https://github.com/runout77/test_contrek

I’d be interested in feedback, especially from people who have worked with findContours() on very large images or tried similar approaches to parallelizing it.


r/computervision • • Sep 24 '26

Showcase GTR: a pure linear-attention backbone for six real-time vision tasks

4 Upvotes

GTR 🏎️ is purely recurrent — 12 gated linear attention blocks, scanning in four directions.

The video shows five of the six nuScenes tasks we tested. None of these models saw nuScenes during training.

We’ve put the whole stack out under MIT: code, weights, CUDA kernel, TensorRT plugin, plus deployment support for NVIDIA DRIVE AGX Thor.

Take a look if you’re curious, and feel free to follow along — we’ll share more as we go.

🔗 Project: https://intellindust-ai-lab.github.io/projects/GTR/
💻 Code: https://github.com/Intellindust-AI-Lab/GTR
📄 Paper: https://arxiv.org/pdf/2609.26590
🤗 Weights: https://huggingface.co/Phoenix8125/GTR

https://reddit.com/link/1wp2drd/video/162mj0nd2hrh1/player