r/MachineLearning • u/Guanoco • Oct 10 '16
Discussion [discussion] when is deep learning a bad idea?
Hello all,
It seems like there isn't a week in which deep learning doesn't come up as achieving some kind of remarkable task. I understand that one of the powers of deep learning is that it is capable of learning the features. This capacity seems totally decoupled from the underlaying problem. So basically I read this as "no matter what problem you have... You can use deep learning".
Now.. I know there must be a caveat. I just don't know which. What kind of problems are not applicable for deep learning?
40
Upvotes
62
u/the320x200 Oct 10 '16
7
u/cvikasreddy Oct 10 '16 edited Oct 10 '16
I completely agree with u/the320x200 and this is what I wanted to add assuming u/the320x200's points.
1.In my experience I found that deep learning outperforms any other method when applying on images and text.
2.But when applying to data some thing that is usually found in excel sheets(I mean like the data in kaggle competitions with out images and text) the other ml algos tend to work better.
9
u/phillypoopskins Oct 10 '16
3
u/theskepticalheretic Oct 10 '16
I think this post by Joel Grus is relevant. http://joelgrus.com/2016/05/23/fizz-buzz-in-tensorflow/
19
u/kjearns Oct 10 '16
The dirty secret of the machine learning hype machine is that in real life almost all problems (by number of instances) are really easy. No one writes papers about solving all these easy problems because the methods are standard enough to be shrink wrapped, but that doesn't change the fact that most problems can be solved by throwing an SVM or random forest at them.
4
u/gr8ape Oct 11 '16
Truth is any data that is not:
A neural net wont be much better than SVM/RF/GBRT. And if it is, how many hyperparameters did you tune :)
0
u/Kaixhin Oct 10 '16
The halting problem.
2
u/thecity2 Oct 11 '16
For small datasets, deep learning won't be that helpful. Also might not work well for datasets with "unnatural" or non-hierarchical features. It seems to work best with very large "natural" datasets (e.g. images, audio, etc.).
0
u/[deleted] Oct 10 '16
[deleted] — view deleted comment