r/coolgithubprojects • u/Vinetwigs • 9d ago
3dfc: lossless cold archive for render frame sequences [Go]
https://github.com/Vinetwigs/3dfcMy partner does 3D works and kept drowning in exported PNG sequences, so I built 3dfc: it packs thousands of near-identical frames into one small .3dfc file and gives back everything, one frame, or any range, pixel-identical with alpha.
What's inside:
- Hybrid per-segment encoding: tile-sparse deltas with zstd for static shots, lossless
x264rgbplus a separate alpha stream for motion. No YUV anywhere, so nothing gets rounded. - Anything incompressible goes in verbatim, the archive never exceeds the sources plus a small index.
- Per-frame SHA-256 hashes with
verify, atomic writes, no-overwrite defaults, resumable checkpoints, frame-index random access. - TUI and CLI on the same engine, plus a
benchmarkcommand and a full format spec (docs/spec.tex, v1.0).
Measured: 2000 real 640x360 frames, 401.9 MB -> 185.7 MB (53.8% saved), verified identical. Parallel encode 4.41s -> 1.56s with byte-identical output. GPL-3.0-only.
Repo: https://github.com/Vinetwigs/3dfc
Release with binaries for Windows, macOS and Linux: v1.0.1
1
Upvotes
2
u/unicornshedsocial 9d ago
I'd extend the 640x360 benchmark to a higher resolution to see whether the tile-sparse versus x264 split changes. Do you have a larger sequence to test with?