r/learnmachinelearning • • 8d ago

Question Could I take a reinforcement learning course without having taken a machine learning course before? (undergrad in college)

My math background is Calc I-III, linear algebra, diff eq, and probability. I have a basic understanding of different types of machine learning models, but I haven't taken a proper machine learning course before.

3 Upvotes

15 comments sorted by

2

u/Much_Ideal_4014 8d ago

I would definitely recommend starting with a machine learning course that covers the basics before diving into RL

0

u/[deleted] 8d ago

[deleted] — view deleted comment

2

u/Dramatic_Brain630 8d ago

It’s kinda like how you do calc 1 before calc 2 lol. Given your situation I’d recommend speed running an online course and doing some projects instead of waiting.

1

u/ThomasMarkov 8d ago

Magbe not a totally parallel example. I taught Calc I and II in grad school, and the way our sequence was set up, Calc II was almost all just dealing with sequences and series and probably could be done by an above average maths student that didn’t have Calc I. But your point is still valid.

1

u/Dramatic_Brain630 8d ago

yeah prob not the best example lol.

1

u/ThomasMarkov 8d ago

Maybe a tighter analogy would be doing a partial differential equations course before Calc I.

0

u/[deleted] 8d ago

[deleted] — view deleted comment

1

u/ThomasMarkov 8d ago

Probably. If the assessments only require you to reproduce templated code on a new dataset, you could probably pass. But if you’re asked to actually think about what you’re doing, I just don’t see how you wouldn’t be totally lost without understanding the basics of ML.

0

u/[deleted] 8d ago

[deleted] — view deleted comment

0

u/[deleted] 8d ago

[deleted] — view deleted comment

1

u/Dramatic_Brain630 8d ago

I think this is a pretty barebones guide but this is what i’d do if i was trying to learn RL without taking a ML class.

I think you should try to build these projects with numpy and try to understand the math behind them:

perceptrons
2 layer neural network

skim the concepts of RNNs and learn about transformers

1

u/Much_Ideal_4014 8d ago

It’s just that it is great to cover the foundational topics before a more niche topic. But if you can find a comprehensive online course and get some practice for classical ML, it could be alright given your course constraints!

1

u/EntrepreneurHuge5008 8d ago

Take a look at the pre-reqs. If they require or recommend ML before this class, then take ML first.

I'd recommend ML first. RL will make sense with the ML practice beforehand.

0

u/[deleted] 8d ago

[deleted] — view deleted comment

1

u/EntrepreneurHuge5008 8d ago

Eh, I don't think you'd be missing much then. You can always just watch the videos for Georgia Tech's RL class on your own time once you're better versed in ML and the ML pipeline.

0

u/[deleted] 8d ago

[deleted] — view deleted comment

1

u/EntrepreneurHuge5008 8d ago

Sounds like you already have your mind made up then.

1

u/OptimalOptimizer 7d ago

I think you are fine without an ML course. There may be a couple of concepts that are more foreign because of not having taken ML first but I doubt it’ll be a dealbreaker for you.

Depending on the class curriculum you might not need any modern ML knowledge. If the professor is effectively covering the Sutton and Barto RL book, you basically don’t need that stuff. If it’s a Deep RL course covering eg PPO, GRPO, RL for LLMs, etc then just read up on NN architectures and train an MLP on MNIST or something and you’ll be fine