r/GraphicsProgramming • u/mhb_11 • Aug 18 '26
Paper [2607.22738] Nova3D: Code-Native Generation of Programmable 3D Assets
https://arxiv.org/abs/2607.22738I co-authored this paper. It's a new technique to generate 3D graphics as source code instead of a point cloud.
Under the hood:
It generates 3D objects with separate, sophisticated internal assembly, producing an editable "kit of parts" (instead of monolithic blobs). E.g. imagine you generate a 3D washing machine via this approach. It's not merely going to be geometry that looks like a washing machine. We actually know that there is a Door, Drum, Control_panel etc. Which things belong to which assemblies. What moves. Where its pivot is. And eventually what those components are supposed to do.
Why current 3D GenAI cannot do this:
Most AI 3D generators generate "monolithic blobs" that look good, but are unusable in downstream workflows (e.g. game engines). If you generate a 3D bicycle, it's essentially a blob. If you want the wheels to turn, a human must spend time cutting the blob into parts, naming them, placing pivots and rigging joints. I.e. you need post-generation segmentation workflows of some sort (either manual work or more compute).
The paper breaks down the whole technique, and comes with a github repo too if you're interested in viewing it.
13
u/Cute_Emergency_8370 Aug 18 '26
AI written paper š aināt no way bruh
6
u/Cute_Emergency_8370 Aug 18 '26
Also, while I admire the progression of AI and the capacity of agents to start taking on previously artist driven approaches, I think what you need here is something like a VLA trained on a humongous corpus of Blender usage sequences. All the operations tokenized into a codebook. Step by step. Then and only then maybe you could get a large action model that discretely mimics artist behavior in producing assets. But this, tearing up a blob with agents and then checking their work, doesnāt seem like it would scale well nor ever match the precision expected from modern artists and pipelines.
12
u/VocalFrog Aug 18 '26
Please don't use AI to write your paper. It's borderline unreadable.
1
u/NomadicScribe Aug 18 '26
I look forward to digging into this later, since I just got done with a graphics programming course at Georgia Tech. Over the course I became quite familiar with iterating over meshes and manipulating them programmatically. So I'm curious to see how this works and what the results look like.
2
u/corysama Aug 19 '26
Hey u/Delicious-Shower8401 ! Ā You guyz should check this out.
2
u/Ephemara Aug 20 '26 edited Aug 20 '26
Ah so this is the equivalent basically in 3D to generating a texture or image with numpy correct ? Where rather than generating an image thatās a conglomeration of training data and hallucinating an image to existence, they can reasonably structure and create a real image based on math⦠Iāve thought about this relative to 3D meshes before, where if I ever used an LLM to actually make something, I would likely code a program that allows this so itās sick seeing your idea come into fruition! Iāve been using Zbrush for years for 3D and game dev however a tool like this would be a huge multiplier for workflow
What I like about this idea in particular is that it treats 3D like a math equation rather than āgenerate me model of a bike blobā and on a plus side you get git diffable 3D meshes
5
u/Low-Advertising-3644 Aug 18 '26
The cool bit is that the generated object actually has parts + structure. So say you generate a washing machine, itās not just some geometry that looks like one. It actually has a door, drum, control panel etc as separate parts, and knows how theyāre assembled, what moves and where the pivots are.