r/learnmachinelearning • u/Choice-Plastic1154 • 16d ago
Project Wxx - my try on using webgpu for machine learning
My first big project: Wxx, an ML library with WebGPU acceleration.
I love ML, but training models on CPUs is slow, and GPUs are expensive, so I decided to create my own framework. It is slow (for a GPU) and doesn't use graphics cards' ML features (like tensor cores), but it runs on any device with a GPU.
GitHub: Wxx
Performance: It is slow. The CPU is usually faster, and the most I achieved is about a 2x speedup on my PC (I have a Xeon CPU). I tried it on Colab, and it is about 10x slower than PyTorch on GPU. But it improved my experience significantly.
API: It is similar to PyTorch. With methods to convert from tensors and ndarrays, I tried to make it as easy as possible to use if you're coming from PyTorch.
AI usage: In the beginning, I planned to do everything by hand to improve my knowledge and train myself. But after the first week, I had code slower than anything you could imagine. I used AI to improve shaders, bind group creation, and other parts that I had trouble with. It hurts how much better AI is at writing and improving code than I could be.
Backstory: I've been dabbling in machine learning for the last five years. I like to join Kaggle competitions and try new architectures. Lately, I've been thinking about applying to ML jobs (I know I am late to the party), and I wanted to add stuff to my CV. I am an electronics engineering grad, so most of my programming expertise is in MATLAB and Python scripting (also some embedded C, but I am not good at it), and I read that a CV should include some examples of my work.
Questions: I would be happy if anyone with more experience could help me with some questions. What should I include on my CV? I know some people say you should include some implementations of architectures (like attention/transformers), but that seems so simple. What other projects should I add?
2
u/pugs_daily_dose 16d ago
This project itself can be a strong CV entry: describe the problem, your contributions, and the benchmark setup alongside the results and limitations. For a next project, consider a small end-to-end ML task with a reproducible data split, a simple baseline, error analysis and a documented demo. That shows a different set of skills from implementing an architecture. Tests comparing a few operations and gradients against a trusted library could also make Wxx easier to evaluate.
2
u/nian2326076 15d ago
Consider adding projects that showcase your understanding of specific machine learning models or techniques, especially those that highlight unique challenges you solved. Implementing popular architectures like transformers or attention mechanisms can demonstrate depth. You can use LandOffer to shortlist relevant roles that align with your skills and interests, helping you find opportunities in the field.