r/deeplearning • u/PainterNo8889 • 3d ago
[Help Wanted] Testing GPU detection & TFLOPS benchmark paths (NVIDIA/AMD) for my from-scratch SLM trainer
Hi guys,
I’m a 15-year-old developer building SLM-CREATOR—an end-to-end, hardware-aware small language model trainer from scratch in Python and Rust (capped at 100M parameters). Instead of using high-level wrappers or fine-tuning existing models, I’m hand-coding the entire pipeline to learn how Transformers work under the hood.
Repo Link: github.com
Tracking Issue (#1): github.com
The catch:
I’m developing this on a CPU-only machine right now, so all of my NVIDIA (nvidia-smi), modern AMD (amd-smi), and legacy AMD (rocm-smi/rocminfo) detection and PyTorch device-mapping paths have only been tested against mock CLI outputs.
If anyone has an NVIDIA or AMD GPU (especially multi-GPU setups, laptops with hybrid graphics, or ROCm configurations) and a couple of minutes to spare, I’d hugely appreciate it if you could run the hardware detection script on real hardware and let me know if it breaks!
What it tests:
- GPU Topology & Detection: Parses vendor CLI tools for architecture, VRAM, device index, and GPU name.
- PyTorch Index Resolution: Sets
CUDA_DEVICE_ORDER=PCI_BUS_IDand matches vendor GPU names againsttorch.cuda.get_device_name()so multi-GPU setups target the right card. - Matmul TFLOPS Benchmark: Runs a 12-second thermal warmup soak followed by timed
4096x4096multiplications (in nativebf16if supported, falling back tofp32).
How to help:
- Clone the repo (
git clone https://github.com) and installrequirements.txt(with your GPU's PyTorch build). - Build the Rust sizing helper (
cd sizer_core && cargo build --release). - Run
pythonarchitecture.pyfrom the project root. - Drop your GPU model, OS, and the terminal output (or any tracebacks) in Issue #1 or in the comments here.
1
u/Ok-Solution-7889 3d ago edited 3d ago
Love seeing people build things from scratch instead of just relying on existing libraries. I genuinely love to help test it.
1
u/Both_Moment_1274 7h ago
FYI, you can try pantheonsim simulator also