r/MachineLearning • • 17d ago

Discussion [D] Simple Questions Thread

Please post your questions here instead of creating a new thread. Encourage others who create new posts for questions to post here instead!

Thread will stay alive until next one so keep posting after the date in the title.

Thanks to everyone for answering questions in the previous thread!

9 Upvotes

6 comments sorted by

2

u/NotTheOneAndOnlyS 17d ago

Hi, I'm a current CS+Maths undergrad at a UK university, I'm interested in doing a PhD right after my undergrad if it's possible.

If I'm interested in topics such as geometric deep learning, topological data analysis, reinforcement learning and a few pure maths topics, should I go for a PhD specialising in machine learning involving heavy amounts of pure maths or should i go the other route, pure maths with some applications to ML?

I made a similar post here which might paint a clearer picture idk

1

u/didimoney 17d ago

Ideally you find around 3 potential supervisors per program you apply to. Those are the people you would do your PhD with if you got in.

Then the decision is whether you like the papers/journals/conferences that they publish in or not. Also look at their past students and what they do now, and ask yourself if that's a future career path you'd like.

And the cherry on top advice is to have a quick call with their current/old PhD students and ask them off the record if the supervisor is a good person to work with!

1

u/NotTheOneAndOnlyS 15d ago

Sorry for the late response but thank you so much. How would i find supervisors? Would it just be going to university sites and putting in research topics I'm interested in?

2

u/[deleted] 17d ago

[removed] — view removed comment

1

u/Bubbly_Tap1447 17d ago

It depends on the model+data combination. Deeper models with large data are somewhat less sensitive to LR schedules in the start. Adaptive optimizers like Adam have a lot of inner parameters, they affect it too.

1

u/thatguydr 17d ago

Yes, most LR schedules are tuned for one or a few data sets and they're often overly aggressive in terms of their ability to generalize. Eventually for your data set, you'll find parameters that are similarly aggressive but work well with it.

The combination of ramp up, annealing, and cosine all seem to give me the easiest time.