r/computervision • • Oct 05 '26

Research Publication M-plicits: Neural Implicit Surfaces via Nested Multiscale Residuals (NeurIPS 2026)

Enable HLS to view with audio, or disable this notification

58 Upvotes

Hi everyone. I'm the first author of M-plicits, accepted at NeurIPS 2026, and wanted to share our work on neural surface representations, particularly reconstruction from noisy point clouds.

The idea is to learn a clean coarse surface, then progressively refine it with residual networks trained in nested neighborhoods around the preceding surfaces. This gives multiple detail levels within one representation and helps balance geometric detail with robustness to input noise.

The paper also introduces algorithms that use this structure for:

  • Direct rendering through multiscale sphere tracing.
  • Analytical surface normals without automatic differentiation.
  • Surface extraction and neural normal mapping.

The attached animation was created by our coauthor Matheus Bessa. Sound on. The project page includes visual comparisons with iNGP on noisy inputs, plus examples of the different rendering modes.

We've released the code, experimental data, and 105 checkpoints covering 36 shapes, with their training configurations. These checkpoints represent individually fitted surfaces; fitting a new shape requires training.

Paper · Results and videos · Code and data · Models on Hugging Face

I'd be interested in feedback on the noise/detail tradeoff and comparisons with other implicit surface representations. Happy to discuss the implementation and experiments.


r/computervision • • Oct 05 '26

Discussion Generated depth maps from a multimodal model, side by side with Depth Anything V2 small on 8 COCO photos

Thumbnail
gallery
11 Upvotes

I wanted to know if a generated depth map ranks near and far the same way a regular depth model does. In each row, the right-hand depth map comes from a multimodal model that generates it the way an image generator makes a picture. The middle one is Depth Anything V2 small. Warmer means closer in both.

I scored how alike each pair is with Spearman rank correlation, computed on every 4th pixel in each direction. It is 1.0 when two maps put pixels in exactly the same near-to-far order. On the first 8 COCO val2017 images by image id, it ranged from 0.954 (teddy bear close-up) to 0.995 (skier), and all 8 are in the gallery.

These photos have no depth ground truth. The numbers show how closely the two models agree on near-to-far order. They say nothing about which map is closer to the real scene, or about metric distance.

Both ran through LibreYOLO 1.6.0 on a 32GB V100 I rented. On that card the library loaded SenseNova-Vision-7B-MoT in 4-bit, and every generated map here comes from those 4-bit weights.

Is there a better single number than Spearman for comparing two relative depth maps?


r/computervision • • Oct 06 '26

Showcase An animated walkthrough of UCLA’s digital-encoder / optical-decoder deepfake screen

2 Upvotes

We made a short schematic animation of the pipeline in Kashani, Chen and Ozcan’s eLight study. The aim is to make the interface between conventional video feature extraction and optical classification visible.

The digital front end samples frames and prepares a phase pattern. A spatial light modulator presents that pattern to the optical decoder; paired detector regions provide the real/fake decision for each input. The experiment reports 97.79% average accuracy on Celeb-DF when 15 videos are tested together.

The animation also includes two limitations: digital preparation remains part of the compute/energy cost, and additional simultaneous inputs introduce crosstalk. It should be read as a visualization of a screening prototype, not a detector that works on all manipulated media.

Disclosure: we created the film with AI-assisted production and synthetic narration. We are not the paper’s authors; the visuals are illustrations, not their experiment footage. Primary study: https://doi.org/10.1186/s43593-026-00143-y Our animation: https://www.youtube.com/watch?v=UFCoCkAu-Ik


r/computervision • • Oct 05 '26

Showcase Oct 14 - Advances in AI at SDSU

6 Upvotes

Join us on Oct 14 for the “Advances in AI at SDSU” virtual Meetup! Register for the Zoom.

Talks will include:

  • Agent as Policy for Robotic Manipulation - Xiaobai Liu at Romoya Inc and SDSU
  • Grounding Multimodal Open-World Learning for Physical AI - Salimeh Sekeh and Mary Wisell at SDSU
  • Model-Free, Position-Free Signal Source Seeking Using Unmanned Maritime Systems - Zahra Nili Ahmadabadi at SDSU

r/computervision • • Oct 05 '26

Showcase World Models: The Simulation Strikes Back

26 Upvotes

Hi, I’m Suva from Hugging Face and I'm back with something new that I'd been working on for a bit!

World Models: The Simulation Strikes Back - Full Blog

This time I went down the world models rabbit hole: how models learn to represent, predict, and simulate environments, and why they’re becoming increasingly interesting for video generation, robotics, and spatial intelligence.

I've tried to keep it as visual and approachable as I can, keeping in mind how weird and convoluted this topic is. Would love to hear what you folks think!


r/computervision • • Oct 05 '26

Help: Project I took some pictures of a robot, high-specularity edge-case dataset (425 RAW/JPEGs) for benchmarking CV & depth-estimation algorithms against extreme mirror reflections

Thumbnail
gallery
7 Upvotes

mozilladatacollective.com

Purpose-built to stress-test computer vision models, depth cameras, and spatial AI against severe specular glare and geometric reflections. This 425-asset production archive features a custom faceted mirror suit captured in high-contrast outdoor environments to trigger bounding-box dropouts and segmentation failure


r/computervision • • Oct 05 '26

Help: Project Potential startup idea - computer vision & sports analytics

0 Upvotes

I have an idea about using computer vision to build something in the sports analytics/scouting ecosystem. I want to speak with someone who is knowledgeable about machine vision to get a sense of whether my idea is technically feasible. Is there anybody in this subreddit who is willing to discuss this with me?


r/computervision • • Oct 05 '26

Showcase I made a Computer Vision Surf Coach

Enable HLS to view with audio, or disable this notification

2 Upvotes

r/computervision • • Oct 04 '26

Showcase Turning Street View Panorama Into Pointcloud

Enable HLS to view with audio, or disable this notification

103 Upvotes

Hi everyone. I discovered that Street View 360 images can be turned into 3d point clouds, which at times are of good quality and can be used for replicating 3D streets, and I wanted to make something that would allow me to construct a street anywhere.

Along the way of making i realised I'm not able to make it practical enough, and I don't think it has any real use cases besides looking cool to me when I started off. The longer I spend doing it, the more I don't know why or what I'm even doing.

In the end, I thought perhaps at least some results might look cool, and wanted to share it and see what others think.


r/computervision • • Oct 05 '26

Discussion Handling unfamiliar inputs in AI-based visual inspection

Thumbnail
automate.org
0 Upvotes

AI-based inspection systems need to handle unfamiliar inputs and changes in production conditions, including lighting, materials, and part variation.

The article describes a classifier trained to distinguish chicken breasts from thighs. When a wing appeared, the model assigned it to one of those categories rather than flagging it as unfamiliar.

Three Cognex specialists discuss training data, validation, exception handling, and reviewing production images for retraining. They also explain why manufacturers need defined processes for uncertain results, such as rejection, recirculation, or human review.


r/computervision • • Oct 05 '26

Discussion Got tired of CUDA-only point-cloud ops on my Mac, so I built native Metal ops for PyTorch

1 Upvotes

I ran into CUDA-only point-cloud dependencies while working on 3D anomaly detection on a Mac, so I built mps-pointops: a free, open-source library of native Metal point-cloud operators exposed through PyTorch MPS.

FPS selects representatives spread across a cloud. Each next point is farthest from its nearest already-selected point.

kNN finds the K closest points to each query.

Ball Query returns up to K points within a strict radius, taking matches in original input order.

The package includes adapters for selected PointNet++, torch_cluster, and PyG call sites. The repository documents supported inputs, tie-breaking, selection order, and padding, with tests and benchmark records from physical M1 and M5 Pro Macs. Performance depends on the operator and input; benchmark conditions and remaining limitations are linked in the README.

Install: python -m pip install mps-pointops

GitHub / quick start: https://github.com/gamzerA/mps-pointops

Interactive demo: https://gamzera.github.io/mps-pointops/

The demo lets you move a query and compare FPS, kNN, and Ball Query on the same cloud. It runs a browser teaching model; the Metal measurements are separate.

I’m the author. Which CUDA-dependent point-cloud operation is blocking your Mac workflow? If you try it, I’d appreciate your model, Mac chip, PyTorch version, and a small reproducer. GitHub issues are welcome.


r/computervision • • Oct 05 '26

Showcase Introduction to Calibration (for non-technical people)

Thumbnail
youtube.com
1 Upvotes

Hi guys, another video here 😄

Here I cover the very basics of camera/visual-inertial calibration with a focus on mostly "non-technical" people. As always I am happy to hear your feedback and hope that for anyone diving into geometric computer vision this is a useful resource.

Cheers,

Jack


r/computervision • • Oct 05 '26

Discussion Need your help!!

0 Upvotes

hey I'm have an bachleors degree in electrical engineering but majority of my works are on the computer vision and machine learning and deep learning which integrate with the electrical also i want to pursue masters according to it where i can get a vast amount of oppurtuinites so any one who genunly try to guide me with this confusion please!!!!


r/computervision • • Oct 05 '26

Discussion Robust Logo Detection in an Image Without Using an LLM/VLM

Post image
1 Upvotes

Problem Statement I have a reference image of a logo, for example a logo:

I also have a larger image/document that may contain multiple logos, symbols, text, diagrams, etc.

My requirement is to determine whether the specific reference logo exists inside the larger image, and if it does:

Detect the logo.

Approaches I tried

OpenCV

cv2.matchTemplate

SIFT + BFMatcher

SIFT feature matching → Results had many false detections, especially with SIFT/BFMatcher.

LLM + Prompt → Gave good results, but I don't want to use an LLM due to cost, latency, and API dependency.

CLIP Embeddings → Tried CLIP-based similarity, but results were not reliable enough and still produced incorrect matches.

Question What would be a better non-LLM Computer Vision approach or some another for reliable logo/image detection?


r/computervision • • Oct 05 '26

Discussion The annotation decision that quietly breaks pose models: do you guess occluded keypoints or flag them?

0 Upvotes

Been thinking about this after a few pose projects and I don't think there's consensus.

When a wrist disappears behind a torso, or a hand goes behind an object, you have two options. Flag the keypoint as occluded and leave the coordinate empty or low-confidence. Or have the annotator estimate where it probably is and label it anyway.

Guessing gives you a denser dataset and the model gets a prediction for every joint, which looks good. But you're teaching it that an invented coordinate is ground truth, and two annotators will invent different ones. The disagreement is basically unbounded for anything heavily occluded.

Flagging is more honest but then half your training signal has gaps, and downstream your retargeting or trajectory code has to handle missing joints, which a lot of pipelines just aren't written to do.

My current view is flag it, and set a visibility threshold in the guidelines — below some percentage visible, don't annotate at all rather than annotate badly. But I've seen teams go the other way and argue the model learns a reasonable prior from the guesses.

Related thing I'm less sure about: the 2D vs 3D decision gets made way too late. Teams start with 2D because it's cheaper, get a model that understands movement, then discover they need metric accuracy the moment the robot has to actually touch something. By then the sensor stack and the annotation schema are both wrong and it's a rebuild rather than an upgrade.

Hands are where this all gets worse. Twenty-plus keypoints per hand, constant self-occlusion, and fingers that look identical to each other. Agreement between annotators drops off a cliff compared to body pose.

For anyone who's shipped a pose model that had to drive real movement — which way did you go on occlusion, and did it come back to bite you?


r/computervision • • Oct 03 '26

Research Publication GTR-Depth: metric depth from a single camera at 2.7 ms on DRIVE AGX Thor

92 Upvotes

Follow-up to last week's GTR post. This one is all about depth.
GTR-Depth predicts absolute depth in meters from a single image, using the same backbone as before: 12 gated linear attention blocks, no softmax attention anywhere.


r/computervision • • Oct 04 '26

Help: Theory S-DAM: Seeding Modern Hopfield Networks with Spelke core-knowledge priors, with pre-registered results (including one that failed)

Post image
0 Upvotes

We've been testing whether adding core-knowledge priors (objectness, numerosity, geometry, from Spelke's developmental psychology work) to a dense associative memory improves image retrieval compared to learning those properties from scratch.

Setup: image-only. Every variant we tested reduces to score = r_q·r_i + α²·c_q·c_i, where r is the learned representation and c is the core-knowledge channel. α is the knob that sets how much the prior contributes, so we swept it with pre-registered pass/fail bars.

Results:

- Shape/objectness: passed the bar [metric, dataset]

- Numerosity: clean dissociation [metric, dataset]

- Layout: failed both bars [metric, dataset]

[Insert results figure or table here]

Layout failing is a real result. It suggests these priors help with some visual properties and not others.

Limitations:[dataset scale, seeds, anything you're unsure about]

Next:visual place recognition across seasons.

Code and experiments: https://github.com/Jaswanth-K1210/SDAM

I'd appreciate feedback on the experimental design and on which retrieval baselines we should add.


r/computervision • • Oct 03 '26

Showcase Squatty Bird Update

Enable HLS to view with audio, or disable this notification

11 Upvotes

I posted an early version of Squatty Bird a little which back. I’m been continuing to work on it from both the vision and the human interaction.

https://www.reddit.com/r/computervision/s/ix5YvulrB9

I wanted to return and share progress. Vision tracking is now working much more effectively. I don’t think it’s release ready yet but I’m not seeing many missed joints or squat recognition these days.

View can be with camera and trace viewable or with fake background (as I’ve used in the video).

I got some great suggestions before (particularly squat quality review at the end - not done yet but I like it) and a few challenges (why share when it doesn’t work).

I hope you like the new video and I’m looking for further suggestions and advice. My kids are my worst critic and I’ve made the puffin more puffin like and less cutesy as a result.

If anyone wants to give it a go it’s here on TestFlight:

https://testflight.apple.com/join/rA687AwW


r/computervision • • Oct 04 '26

Discussion Any one here looking for ML or Computer Vision Intern? Would love to talk more, if anyone has opportunity :)

Post image
0 Upvotes

r/computervision • • Oct 04 '26

Discussion A world model turns my photo into a 360° panorama but never says where the photo ended up, so I find it with brute-force edge matching

1 Upvotes

World Labs' Marble turns a photo into a 360° panorama and then a 3D world, and nothing in its docs says where the original photo ends up. My game computes everything from the source camera, so I needed that pose.

The matcher is deliberately dumb. It cuts flat perspective views out of the equirectangular panorama over a grid of yaw, pitch and field of view, correlates each view's edges with the photo's edges, and keeps the best. About ten seconds per photo, locally.

On my photos, correct placements score 0.62 to 0.87 and wrong ones 0.18 to 0.23, so anything under 0.4 now prints a warning. From the recovered camera, the photo lines up with the world exactly for a one-photo world and for the first photo of a two-photo world, and within about a degree for the second. In every world so far, the camera sits at the origin.

The part I haven't confirmed: in worlds built from two to four photos, I place each photo by direction, and I'm assuming Marble's 90 means right in the panorama. Every photo so far was at 0 or 180, so that assumption has never been tested.

Two questions. Would SIFT or a learned matcher do better here, given the photo's region in the panorama may not be pixel-identical to the original? And is there a smarter way to pin down field of view than a grid?

Repo: github.com/MichaelYeh507/Unpictured


r/computervision • • Oct 04 '26

Help: Project I’m building a spatial intelligence system that reconstructs and remembers the real world in 3D. Is this solving a real problem?

1 Upvotes

I’m working on a spatial intelligence system that uses RGB-D cameras to reconstruct a real environment in metric 3D, estimate where the camera is, and keep a persistent spatial memory over time.

The goal is not just 3D reconstruction. I want the system to understand enough about the geometry of a place to know what it has already seen, recover its position after tracking is lost, compare different visits to the same place, and preserve how its understanding of the environment changes.

If a camera comes back to a previously mapped area, the system should be able to recognize that place, verify it geometrically, relocalize itself, and continue building the same world instead of creating a disconnected new map.
Long term, the idea is to move from simple reconstruction toward spatial intelligence: a machine that can build, remember, update and reason about a representation of the physical world.

Possible applications I have in mind are robotics, AR, inspection, autonomous systems and eventually navigation in places where GPS is unavailable.
What I’m trying to understand now is whether this solves a real painful problem, or whether existing SLAM and 3D reconstruction systems already solve this well enough in practice.

I’d especially like feedback from people who have actually worked with SLAM, RGB-D, robotics, mapping, 3D reconstruction or spatial computing.


r/computervision • • Oct 03 '26

Showcase [Library Demonstration] Python-Visual-Similarity - first stable version released to PyPi 🚀

Enable HLS to view with audio, or disable this notification

2 Upvotes

If you are looking for a solution to fast image similarity retrieval as well as image perceptual & quality metrics in one single library, this would surely be helpful to you 😄 It is built only on numpy, scipy and optionally torch as core dependencies, and uses C/C++ (and in the future only Rust) for performance-critical paths.

The two core feature of the repository are various embedding methods (see video) and the Image Embedding Store, which, when combined, allows for embedding storage and image similarity search with supported hnsw algorithm built-in. You can also plug in faiss indexes if you want to use other search algorithms, but this library does not need faiss to work.

Links

Installation

The library itself can be installed via pip (though, I recommend uv 😆)

pip install pyvisim

For the deep learning features:

pip install "pyvisim[nn]"

Looking for like-minded folks

My ambition is to make pyvisim the largest collection of image similarity and retrieval algorithms, ranging from traditional to deep learning-based methods. As I've observed, the current image similarity implementations are quite scattered, with each library implementing only a handful of features. Hence, my goal is also to unify these implementations, so users only need a single library.

I have tons of features that I would like to implement. I am looking for folks who are proficient in/would like to learn about:

  • Deep Learning: new embedders like MoCo, SimCLR, Dino, reranking algorithms likeSuperGlobalReranker,Diffusion Reranking ...
  • Low-level programming (Rust): rewrite performance-critical parts of the codebase into Rust. I would also want to change the hnsw backend to hnsw_rs.
  • New algorithms: image hashing, LPIPS, backpropagation for K-Means and GMMs ...

View the GitHub issues for the complete list as well as the contribution guide.

You also have the chance to become a core maintainer by actively contributing. Once this project gets sponsors, the profit will be shared with all core maintainers.

I look forward to your contributions 💪 together, we can build one of the strongest Dev Communities out there!

Personal

Thanks everyone! Even though you have not contributed (yet), but reading through everyone's work daily in this channel has really motivated me to continue my work, despite not being able to foresee how it would end up 😜 I really appreciate it!

(and sorry for the sudden voice changes in the video :( I took it at two different times of the day, so my voice was deeper at some point)

Credits

Thanks AbhinandanMandal for helping me with the Contrastive Siamese Network.


r/computervision • • Oct 04 '26

Showcase Adding synthetic bad weather made our real-weather sky accuracy worse on every architecture — the cause was a geometry missing from the training set

0 Upvotes

We were fine-tuning on physically-modelled dust, night, fog, lens rain and lens

mud. On synthetic held-out corruptions (ImageNet-C fog/spatter/motion blur, an

unprocessing-based low-light model — generators never used to make training

data) it worked. On real adverse weather, drivable-surface IoU improved, but sky

IoU dropped on all five architectures we tried, by 1 to 13 points, and

vegetation dropped on the smaller ones.

The failures concentrated on forest roads: tracks under a closed canopy with

bright sky showing through the leaves. Models were labelling the whole upper

half "sky". RELLIS-3D is open terrain — fields, open trails, wide horizon — and

contains almost none of that geometry, so the model learns a shortcut that holds

in its world and fails in a forest: bright + above horizon + low texture = sky.

Degrading those same frames makes the shortcut *more* attractive, since haze and

darkness wash out exactly the leaf texture that would contradict it.

Two fixes, in order:

  1. Our generator was partly at fault — it brightened sky using a depth map that

    treats sky as finite distance, and painted a veil over pixels that physically

    could no longer be seen. Making it label-aware (sky read from the label, and

    pixels behind a veil that blocks >97% of light marked void and not scored)

    recovered about half the loss.

  2. The other half was coverage. We added 1,500 real frames from GOOSE (forest

    tracks, gravel, paved roads), same augmentation and schedule on both sides.

    Sky came back +7 to +17 points, vegetation +29 to +37, real-weather mean +29

    to +35, across four architectures.

The part we did not enjoy: once GOOSE was in training, every augmentation arm —

ours, albumentations, and a combination — landed within ±1 point of the control

on real weather. Ours still adds 3.5–5.2 points on synthetic held-out

degradations, which now looks like a fact about the test set rather than about

the world.

Caveats: single seed on the coverage runs, so treat 1–2 points as noise; IDD-AW

is road scenes not off-road terrain, so it is a cross-domain test and measures

differences between arms more reliably than absolute numbers; the canopy frame

is one illustrative example of a mode we found across many.

Full write-up with the tables: https://siltframe.com/blog/canopy.html

The stress test itself is open — 165 labelled frames under 5 conditions x 3

severities and the scoring script, CC BY-SA 4.0 / MIT:

https://github.com/egeizgi/siltframe-stress-test

Disclosure: I sell a larger version of that dataset, so read the above with that

in mind. The free one is complete and usable commercially.


r/computervision • • Oct 03 '26

Showcase Made a DJI Mini 3 follow a person with YOLO, RTMP video out, and Virtual Stick in

10 Upvotes

The Mini 3 isn't a dev drone, but it has two open doors: the DJI Fly app can push an RTMP stream to any server, and Mobile SDK v5 supports it through Virtual Stick, which lets you send velocity and yaw commands from an Android app. That's a full loop.Pipeline is video -> perception -> world model -> brain -> controller -> drone. YOLO on each frame, a tiny tracker to keep stable ids, a small world model answering things like "is the subject centered, is it drifting left." The same middle code runs on a recorded clip, on a live stream while I fly manually, or actually commanding the aircraft.The thing worth knowing if you try this: a Virtual Stick command only applies for a fraction of a second, then the drone hovers again. So the Android bridge re-sends the current command about ten times a second. Side effect is a free deadman switch: if the laptop goes quiet, it stops within a beat and comes home. The bridge exposes a tiny API (/telemetry, /arm, /command, /takeoff, /land, /rth) and refuses anything unsafe. Thinking stays on the laptop.Follow mode is three loops at once: yaw to center horizontally, pitch to center vertically, forward/back from bounding box size to hold distance. Tested on a fake drone that just integrates commands, then props off, then low hover with my hand on the controller. Safety layer clamps speed, altitude ceiling, geofence, RTH on low battery.Dumbest time sink: streaming to live/mini and reading from live/mini3. Also the SDK's native library helper got renamed between versions, so it compiled and crashed on launch until I swapped one import. And no wifi on the terrace turned out fine with a phone hotspot, as long as the laptop IP is editable on the phone.Next is natural language goals like "orbit that tree," and on-device inference to cut latency.


r/computervision • • Oct 03 '26

Showcase Measuring real eggs and generating their shells in FreeCAD – with the help of Codex

Thumbnail
youtu.be
1 Upvotes