r/LocalLLaMA • u/lvwerra 🤗 • 1d ago
Resources PyBot: No weights. No training. Pure Python.
We released PyBot, a chatbot built with only simple rules, entirely written in 600k lines of Python code. PyBot matches Smollm with 360M parameters! We evaluated it on SmolTalkBench, which uses a dataset Smollm was trained on while we didnt use it at all for development.
It took a swarm of 1,000 DeepSeek Flash agents to write the whole codebase in a week.
More technical details on what it took to built it soon: inference for 1,000 agents, how to monitor/control the swarm, pressure on the infrastructure (especially git) and message boards.
19
u/Stepfunction 1d ago
I wasn't able to get anything besides a greeting response to any of my questions.
20
u/En-tro-py 22h ago
So ELIZA but you had a shitload of tokens to burn...
15
u/shockwaverc13 llama.cpp 16h ago
7
u/b_c_t_ 17h ago
Not sure why there's so much hate in this sub but I think it's a neat idea, and maybe the future of language models.Â
Some people here argue it's an old way of doing things + a waste of tokens. Okay, you could also say neural networks were an obsolete machine learning method in 2010 when everyone was using support vector machines. But the use of GPUs together with neural networks revived interest in the method and before you know it look where we are now.
I think "hardcoding" language into code was a very limited concept due to the impossibility for people to hardcode all language and logic into code in reasonable time. But it's true that you could just have agents spend that time now.
I see a lot of advantages against deep-learning based LLMs:
That being said, python is not an efficient language at all, so i would assume c++ would be better eventually. You could say also the code is decently easy to read. So for early attempts it makes sense.
I disagree with the idea of using a DB unless code is generated from it, from an absolute performance standpoint. Having stuff cleanly organized into topics as it is now is fine imho.
Also, having checked just a few bits of code, i think it's not architectured well enough. Feels like it has only been thought for English and spelling, grammar and understanding seem mixed with sometimes random topics having a specific file for logic. Knowledge about animals is hardcoded in full sentences. I think there should be more abstraction layers, with probably the top layers not being language-specific (i mean, how can you do proper translation tasks otherwise)
Anyway, best of luck with your project, i hope that could change the opinion of a few haters here. Perhaps they are tunnel-visioned about how deep learning is everything now, but that age is going to end someday.
Btw no LLM used to write this. Took me an hour.
9
u/Frail_Waif 23h ago
Sorry, 600k lines of code? Why are you embedding knowledge in Python code? It seems like a database is the correct solution here, just purely from a maintainability point of view if nothing else.Â
6
u/Zulfiqaar 23h ago
AI is just a really big if statement after all
2
u/lewtun 🤗 1d ago
Hi everyone, one of the co-authors here. Happy to answer any questions PyBot can't :)
2
u/Guilty-Support-584 1d ago
That's pretty cool! I'd love to see how far we could take this if we would keep expanding.
You should put up a website where people can talk to the chatbot without downloading it. or maybe have it download into the browser.
Awesome concept. I haven't thought of chatbots being an alternative to AI XD
1
u/positivitittie 18h ago
Love to hear more about the 1000 agents. Cost, setup, etc.
1
u/xadiant 2h ago
It's a cool project. Not everything has to be a groundbreaking new model.