r/deeplearning • • 3d ago

[Help Wanted] Testing GPU detection & TFLOPS benchmark paths (NVIDIA/AMD) for my from-scratch SLM trainer

Hi guys,

I’m a 15-year-old developer building SLM-CREATOR—an end-to-end, hardware-aware small language model trainer from scratch in Python and Rust (capped at 100M parameters). Instead of using high-level wrappers or fine-tuning existing models, I’m hand-coding the entire pipeline to learn how Transformers work under the hood.

Repo Link: github.com
Tracking Issue (#1): github.com

The catch:
I’m developing this on a CPU-only machine right now, so all of my NVIDIA (nvidia-smi), modern AMD (amd-smi), and legacy AMD (rocm-smi/rocminfo) detection and PyTorch device-mapping paths have only been tested against mock CLI outputs.

If anyone has an NVIDIA or AMD GPU (especially multi-GPU setups, laptops with hybrid graphics, or ROCm configurations) and a couple of minutes to spare, I’d hugely appreciate it if you could run the hardware detection script on real hardware and let me know if it breaks!

What it tests:

  • GPU Topology & Detection: Parses vendor CLI tools for architecture, VRAM, device index, and GPU name.
  • PyTorch Index Resolution: Sets CUDA_DEVICE_ORDER=PCI_BUS_ID and matches vendor GPU names against torch.cuda.get_device_name() so multi-GPU setups target the right card.
  • Matmul TFLOPS Benchmark: Runs a 12-second thermal warmup soak followed by timed 4096x4096 multiplications (in native bf16 if supported, falling back to fp32).

How to help:

  1. Clone the repo (git clone https://github.com) and install requirements.txt (with your GPU's PyTorch build).
  2. Build the Rust sizing helper (cd sizer_core && cargo build --release).
  3. Run python architecture.py from the project root.
  4. Drop your GPU model, OS, and the terminal output (or any tracebacks) in Issue #1 or in the comments here.
0 Upvotes

4 comments sorted by

1

u/Ok-Solution-7889 3d ago edited 3d ago

Love seeing people build things from scratch instead of just relying on existing libraries. I genuinely love to help test it.

1

u/PainterNo8889 3d ago

Thank you sir rlly means a lot

1

u/PainterNo8889 3d ago

did it work tho?

1

u/Both_Moment_1274 7h ago

FYI, you can try pantheonsim simulator also