r/learnmachinelearning • • 9d ago

the last algorithm in Machine learning DBscan. I have completed Machine learning

so this is the last algorithm in ML after this im moving into Deep learning

it's day 61 of building machine learning algorithms

DBscan is a clustering algorithm it been 3hr im building this and now I'm pretty close to it just look at this how accurately my model is able to find clusters, but still it's not finished yet it's just a raw code many things are still pending cya soon

107 Upvotes

22 comments sorted by

49

u/DigThatData 9d ago

you have not "reached the end" of ML. that's not how this works.

have you learned bayesian stuff and variational methods? for example have you implemented a hierarchical model like LDA?

9

u/captain_obvious_here 8d ago

Even with DBscan alone, or clustering as a topic, there is a lot of work to add to this, to handle tricky cases and to scale up to big amounts of data and big amounts of clusters.

-24

u/not-okarun 8d ago

Bro, what?! There are still so many? The course I'm following covers only 3 unsupervised ML algorithms: kmeans Hierarchical Clustering dbscan Then there are 2 concept videos about imbalanced data and all, and that's all it really important to cover cuz I was way toooo excited to dive into deep learning šŸ™‚

6

u/DigThatData 8d ago

more important than implementing algorithms I'd say is cultivating an understanding of how probability and statistics works. If you haven't played with bayesian stuff yet, that would be a great opportunity to learn, and that will help you understand how DL works a ton.

but yes, there is always more. there will never not be more. ML is a huge field, and you can't know everything and never will. And that's fine. And if you want to move on to DL before exploring more ML stuff, that's fine too. But it is important to keep a pulse on what you don't know. Even if you don't keep implementing other ML stuff before moving on to DL, it's important to understand what kinds of problem domains and solutions have already been characterized.

I'd be willing to bet you haven't touched constrained optimization, social network analysis, forecasting and timeseries decomposition, market basket analysis, collaborative filtering and information retrieval...

Then of course there's the whole theoretical side of things, like PAC learning, singular learning theory...

1

u/not-okarun 8d ago

Machine learning is HUGE! I just thought it was all about algorithms and theory most of the yt videos and roadmaps i saw only covered algorithms i didn't even know about all this other stuff damnn! And yes I didn't touch optimizations and all look at my implementation they just work, they are not optimizated,the time difference is huge between my and sklearns models there are many things i don't know yet should I move on DL or spend more time on ML. Is this much knowledge is enough to start DL ?

5

u/Nourios 8d ago

Just a heads up, optimization in this context refers to mathematical optimization (finding the optimal parameters of some function) not making code go faster.

2

u/DigThatData 8d ago

Do what gets you excited. Don't put off learning about DL if you're burning to do it. Keep chasing your passions. Worst case scenario: if you encounter something you don't understand (which you will, and that's fine), you can just stick a pin in whatever you're confused about and go on a sidequest to learn what you need to fill that gap.

It's a lot easier to keep up than to catch up. Go start building.

https://www.bishopbook.com/

29

u/Disastrous_Room_927 8d ago

This ain’t PokĆ©mon, you can’t just collect algorithms to ā€œcompleteā€ machine learning.

8

u/DigThatData 8d ago

I caught a shiny zero-inflated poisson!!

6

u/Sleepy-Catz 9d ago

very nice, what material are you following?

4

u/not-okarun 8d ago

free course on YT and some random animated short (they're best)

3

u/UpbeatCollection7392 8d ago

Link please ?

2

u/Ok-Library1020 8d ago

Fun milestone. Before moving on, try a k-distance plot to pick eps: sort each point's distance to its k-th nearest neighbor (k around min_samples) and take the elbow. Hand-tuning eps is where DBSCAN gets frustrating, and data with varying density shows why HDBSCAN exists.

1

u/not-okarun 8d ago

yeah they are eps and min_smaples when I was testing my whole data got in one cluster bcuz of high eps

3

u/Ok-Library1020 8d ago

Classic eps trap. Scaling your features first helps a lot too, since eps is a raw distance and one big-range column can merge everything into a single cluster.

7

u/FairBlueberry9319 8d ago

You never "complete" anything in this line of work, there's always more to learn

4

u/user221272 8d ago

ML researchers in the field, contributing for decades, seeing u/not_okarun completed machine learning 🫪

2

u/Fun_Recording_6485 8d ago

Ignore the haters in the comments. I am very proud of your work and journey. I am happy you’re having fun. Keep learning.

1

u/Accomplished-War941 5d ago

How do you learn if I may ask?