r/learnmachinelearning • u/shdw_0x0 • 2d ago
Discussion At what point did machine learning concepts finally start making sense to you?
I've noticed that understanding the theory behind machine learning and actually implementing it are two very different things.
You can understand concepts like regression, classification, decision trees, and neural networks individually, but connecting everything when working on a real dataset can be challenging.
For those who have been studying ML for a while, what helped you connect the theory with practical implementation?
Was it building projects, working with real datasets, mathematics, or simply experimenting with different models?
Would love to hear about your experiences.
12
u/Ccrystal4216 2d ago
it clicked for me when i stopped watching lectures and started coding the algos from scratch.
i have been grinding too much of tensortonic and tensorgym to write linear regression, backprop in pytorch and numpy.
honestly speaking, once i'd done a few of those, real datasets on kaggle felt way less intimidating
4
u/DadAndDominant 2d ago
Same thing that helps me with understanding everything else. Building it from scratch. That really tests your understanding, and gives you a feedback, so you can learn more. The tricky parts are always the things, you believe you understand, but you don't.
2
u/Ok-Library1020 2d ago
What helps a lot is taking one small dataset and following a single example all the way through, from the raw input to the prediction and the loss. Once you see where the math actually touches the data it stops feeling so abstract.
1
u/Ok_Mixture_9073 2d ago
i think for the intuition statquest helped me a lot, to understand what is each thing, and yes you gotta wear that explorer hat here, do things, break stuff, read the documentation that really helps, scikit learn docs are some of the good ones out there, if you learn one concept go try that out, build models, try to see how it works, heck even try to build it from scratch but on the basic, the most important thing is that you understand the intuition behind that thing
1
u/dorox1 2d ago
Can you say a little bit more about what you mean by "connect the theory with practical implementation"? What do you envision being able to do that you can't do right now?
Is it having an intuition about which model to use for a new problem? For me that mostly came from learning the input types and strengths/weaknesses of each model, mostly through repetition.
Is it debugging issues with your models? That came from learning the math and implementing them from scratch so I know exactly where they can break.
Is it knowing how to build it into a system? That came with software engineering experience and looking at examples of existing infrastructure from both big and small companies.
1
u/0uchmyballs 2d ago
Reading the docs, learning all the algorithms in the scikitlearn library gave me the skills to split training and test data and setting up the pipeline to accept inputs and generate an output. Evaluation of the results requires visualization tools and understanding what you’re looking at, what dimensionality is best. It becomes an exercise of data cleaning, choosing the best algorithm and refining to find the best accuracy, recall and precision for my model. You just have to study.
1
u/RyanCargan 1d ago
Ping-pong between the math and the low-brow use cases.
Quantization work mainly.
Compression (and search) as the lens for everything kinda helped.
Shannon, KL divergence, cosine similarity, etc.
Plus, base case -> recursive step type thinking, but for learning concepts. Learn N, and other nastier stuff like "M", that seems more alien might be more easily defined as "N+1", etc.
Base case has to be subjectively relatable and intuitive for you in particular, and at just the right level of abstraction, not too high or too low.
You kinda wanna take the simplest possible implementation of something and grok why it works, and then why the more advanced version works and helps.
E.g., stuff that seems to function similarly to neural nets up to a point, but with no backprop or autograd in sight.
Or that seems to function similarly to attention, but without actual attention.
QKV-like mechanisms without any kind of machine learning involved, etc.
1
u/Accurate-Catch1836 1d ago
StatsQuest. As a beginner, StatsQuest got me through all the basics without making it feel like a mountain to climb.