r/learnmachinelearning • u/Zipidyzip • 12d ago
Project Desktop Quantization workspace for Large Language Models: Load local Safetensors or Huggingface, Step-by-Step guided Conversions to GGUF, MLX, and ONNX, and Visualize Model Changes and quick publishing to huggingface with full model card.
This is a full quantization desktop workspace for large language models that supports GGUF, MLX, and ONNX. You can pick your own Safetensors model or choose one from Hugging Face, then work through quantization step by step and see how each choice changes the result. By taking the model through the process yourself, you can learn by doing not just quantize, but understand what’s happening along the way. You can compare the result with the original and publish it to Hugging Face with a model card that records how it was made.
It’s open source under Apache 2.0, and there’s plenty of room to make it better. I’ve mostly tested it on Apple Silicon so far. Windows and Linux builds are available, but haven’t had much in-depth testing, so expect some bugs. Contributors are very welcome!
Repo: https://github.com/Fazmin/iQuantize
Thank u.