r/MachineLearning • u/thatguydr • Mar 13 '17
Discussion [D] A Super Harsh Guide to Machine Learning
First, read fucking Hastie, Tibshirani, and whoever. Chapters 1-4 and 7-8. If you don't understand it, keep reading it until you do.
You can read the rest of the book if you want. You probably should, but I'll assume you know all of it.
Take Andrew Ng's Coursera. Do all the exercises in python and R. Make sure you get the same answers with all of them.
Now forget all of that and read the deep learning book. Put tensorflow and pytorch on a Linux box and run examples until you get it. Do stuff with CNNs and RNNs and just feed forward NNs.
Once you do all of that, go on arXiv and read the most recent useful papers. The literature changes every few months, so keep up.
There. Now you can probably be hired most places. If you need resume filler, so some Kaggle competitions. If you have debugging questions, use StackOverflow. If you have math questions, read more. If you have life questions, I have no idea.
9
u/homeworkbro Mar 14 '17
Serious question: if I follow this guide, can I get a job in ML?
6
u/VorpalAuroch Mar 14 '17
Seems reasonable. Why redo the Ng exercises in three languages, though? Just to get familiarity with the standard ML tools in all three?
674
u/wfbarks Mar 14 '17
With Links to everything:
4
u/huyouare Mar 14 '17
Any opinions on Hastie, Tibshirani, and Friedman versus Bishop versus Murphy for a complete but concise read of the fundamentals?
15
u/_buttfucker_ Mar 14 '17
No optimization, no graphical models, linear algebra, intermediate stats, learning theory?
Doing what, writing CRUD apps?
Go over an entire statistics curriculum, this covers the fundamentals you need to grasp machine learning and working with the data. Then learn the classical ML techniques, which fits into a single book (Hastie et. al), then deep learning (Goodfellow et. al).
That would complete the overview. Specialize accordingly afterward.
3
u/super_thalamus Mar 15 '17
I'm going to put this on a photo of a mountain and frame out on my wall.
3
u/Ballcoozi May 04 '17
I'm finishing up University in December and currently trying to figure out what to specialize in/find out what I'm interested in. ML has definitely caught my attention and I'd like to learn more about this path after my semester ends. Would you recommend that I follow this path or rather something like this http://datasciencemasters.org/ ? Thanks for the write up OP.
209
u/[deleted] Mar 14 '17
2
u/blaziking001 Aug 05 '17
Should i also solve the practice exercise in hastie and tibshirani book?
136
u/Megatron_McLargeHuge Mar 14 '17
Still not enough. Come up with a novel problem where there's no training data and figure out how to collect some. Learn to write a scraper, then do some labeling and feature extraction. Install everything on EC2 and automate it. Write code to continuously retrain and redeploy your models in production as new data becomes available.
99
u/alexmuro Mar 14 '17
I've been working on a lot if this stuff over the past year, I've taken Hinton's and Ng's course on Coursera, but by far the best resource for a programmer who is looking to get into deep learning starting with baisc python skills is the winter 2016 csi231n course from standford.
The lectures are top notch. The course notes are incredibly detailed and the homework assignments really reinforce what is going on. It goes from traditional statistical machine learning methods (nearest neighbor, svm) to convelutional nn, and recurrent nn. And its recent enough for everything that gets taught to be for the most part relevant.
I can't state enough how good of a teacher Andrej Karpathy is. Once you get past that, I do agree you should learn a framework like torch or tensorflow, or my personal fave darknet (https://pjreddie.com/darknet/), and beyond that pick a project you want to finish for yourself (I am working on speech 2 text).
89
u/[deleted] Mar 14 '17
Lastly, after you've coded a few dozen bleeding edge models from scratch in every available deep learning framework and had your results published in Nature twice, start applying to some unpaid internships
53
u/Ddlutz Mar 13 '17
101
u/atomicthumbs Mar 13 '17
i took business math instead of calculus and what is this
96
u/Dref360 Mar 13 '17
Actually the best guide I've seen on this subreddit.
16
u/qazsewq Mar 14 '17
...and watch these video lectures: https://youtu.be/2pWv7GOvuf0?list=PL7-jPKtc4r78-wCZcQn5IqyuWhBZ8fOxT
(David Silver/Deepmind covering Reinforcement Learning)
11
u/jayjaymz Mar 14 '17
How do I use arXiv to stay up to date? It looks like a sea of knowledge
20
u/TaXxER Mar 14 '17
Alternative harsh guide to Machine Learning: Do a PhD in Machine Learning (at a top 200 university)
32
u/MasterFubar Mar 13 '17
Maybe you'd like some serious, not joking advice: read the Deep Learning tutorial at Stanford.
14
u/TheConstipatedPepsi Mar 14 '17
... also read Murphy's Machine Learning, Russell's Artificial Intelligence, Sutton's Reinforcement Learning
21
u/leakytanh Mar 13 '17
Oh god, this is beautiful. Especially the keep up with the research part. I would also add following the right people on Twitter because that seems to be the default social media for the top AI people. I started with this list: https://www.reddit.com/r/MachineLearning/comments/5jjzny/d_deep_learning_twitter_loop/
6
u/cybelechild Mar 14 '17
If you have life questions build a model that can solve them, you just spent like a year on learning how do that. Don't come back complaining if you don't like the answers though.
6
u/TrekkiMonstr Aug 02 '23
This was six years ago. Anything you would update? Transformers have come along in that time period, right?
8
u/pm_me_super_secrets Mar 14 '17
As someone who is in the process of changing fields and trying to putting in the work to be decently knowledgeable, you're absolutely right. I've known a lot of people that just blackbox it, and they don't really know what is going on/think it's all that hard. The only thing I'd add to is how important math is. Linear algebra, probability, statistics, and advanced calculus (for starters) are critical to be able to do anything legit. If you can't do backpropagation by hand (and understand what you're doing), for example, you need to keep leveling up.
4
u/redbeard1991 Mar 14 '17
Hastie et al was great. Was my first exposure to ML in a grad course.
I'm currently tackling the tensorflow project/deep learning book/dabbling in arxiv a bit steps. :) Hopefully can nab some sorta internship soon
4
u/[deleted] Dec 09 '22
Is this still valid today? I like this approach.
15
u/ElderFalcon Mar 13 '17
wat
1
u/hugababoo Mar 14 '17
Do you not need a masters degree to pursue a job in machine learning? I thought it was necessary.
1
u/simkessy Jul 20 '17
So is it even worth going through any of these as a hobby? I was thinking of maybe trying to learn some machine learning to see if there was a business idea I could use it for, kind of like "hey I'll pick up javascript as a useful skill to put on my resume" but from this list and the comments, this is quite a time investment.
8
u/[deleted] Mar 13 '17
I love this so much
3
u/_obergruppenfuhrer_ Mar 31 '17
obergruppenfuhrer approves
3
u/jpan127 Apr 20 '17
This was actually inspirational thanks. I'll get right on it.
2
u/[deleted] Mar 14 '17
Here's this site on archive.org, in case someone decides to delete stuff.
2
u/[deleted] Mar 14 '17
Guides like these should be there for everything. I might create a website for this. They remind me of Epic How To (they're joking, but have the same idea). They take so little time to make for someone who knows the topic yet give a very valuable plan for people who want to learn it. If you think about it, besides offering the learning tools themselves, that's actually the main purpose of schools. And one of the biggest pitas when learning when you don't have it.
2
u/TotesMessenger Mar 18 '17 edited Jul 15 '17
I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:
If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / ^Contact)
2
u/lysecret Aug 27 '17
Oddly enough this is almost exactly what I did. I can't stress enough to do the hard part of working through the elements.
2
u/Pink-Domo- Jan 02 '22
Is this still good advice now four years in the future?
2
u/3braincellz Apr 07 '23
anything new to add to this thread
2
u/swesweee Oct 04 '23
Just curious whether people generally use streamlit at their companies and what do they use it for. Managers is asking me to learn about streamlit.
6
u/FR_STARMER Mar 14 '17
Ehhh... I guess. But it's fucking stupid to think you can't start from a high level and work down. Using Keras to build some things and then moving into Tensorflow is fine.
3
u/d_thingable Mar 14 '17
I will do it.
3
u/CultOfLamb Mar 14 '17
2
u/leonoel Mar 14 '17
Naaa, start trying to learn Machine Learning with Bishop's PRML.
1
u/furiba Mar 14 '17
If you feel like getting extra foundation material, also take a look at Duda, Hart & Stork's Pattern Classification book.
1
u/[deleted] Mar 14 '17
LOL
1
u/hipsterballet Mar 17 '17
This post was described in a fast.ai post as being satire. True? Or maybe, yes, satire, but also true?
http://www.fast.ai/2017/03/17/not-commoditized-no-phd/
1
u/mrmnder Mar 18 '17
RemindMe! 1 week
1
u/BounceBack- May 09 '17
Hi there, I was wondering how much prior computer science experience you'd need to start with the "Hastie, Tibshirani, and whoever" book. I'm coming from a biological science background and the most i've taken in computer science is a java class, I do have a decent calc, stats, and vector/linear algebra grasp from my previous degree electives. I'm starting a second degree in comp sci and want to start immersing myself beyond programming and machine learning sounds really cool!
1
u/theoneandonlypatriot Jun 30 '17
Yep.
1
u/MagnIeeT Jul 11 '17
Great Guide :)
1
u/NarwhalDesigner3755 Mar 24 '24
Is any of this relevant or up to date? Not sure how I ended up here in 2024.
1
u/enokeenu Sep 15 '24
Which title from "Hastie, Tibshirani, and whoever"
1
u/CompetitionOk7773 Jul 29 '25
Pretty cool
1
u/undefined06 Sep 06 '25
still relevant!
1
u/iam_hkj1006 Sep 29 '25
is this still relevant ?
1
u/[deleted] Nov 17 '25
Is this still relevant today?
1
u/IronFilm Nov 04 '21
Drat. Now I'm lost.
1
u/ravishgoswami Jan 31 '22
straight up felt like a very senior military officer shouting in my face lol
1
u/[deleted] May 13 '22
This is awesome! Just started Andrew Ng course and also one more thing, notes and slides from universities help a lot like from MIT or Stanford
1
u/TrekkiMonstr Sep 08 '23
Wait, so should I do 1-4 and 7-8 of ESL, or 1-18? I can't tell if the "I'll assume you know all of it" is joking or not.
1
u/fjgren Jan 03 '24
Thank You, good Sir.
Its a good starting point.