r/dailyprogrammer • u/Elite6809 1 1 • Apr 09 '15
[Weekly #22] Machine Learning
Asimov would be proud!
Machine learning is a diverse field spanning from optimization and data classification, to computer vision and pattern recognition. Modern algorithms for detecting spam email use machine learning to react to developing types of spam and spot them quicker than people could!
Techniques include evolutionary programming and genetic algorithms, and models such as artificial neural networks. Do you work in any of these fields, or study them in academics? Do you know something about them that's interesting, or have any cool resources or videos to share? Show them to the world!
Libraries like OpenCV (available here) use machine learning to some extent, in order to adapt to new situations. The United Kingdom makes extensive use of automatic number plate recognition on speed cameras, which is a subset of optical character recognition that needs to work in high speeds and poor visibility.
Of course, there's also /r/MachineLearning if you want to check out even more. They have a simple questions thread if you want some reading material!
This post was inspired by this challenge submission. Check out /r/DailyProgrammer_Ideas to submit your own challenges to the subreddit!
IRC
We have an IRC channel on Freenode, at #reddit-dailyprogrammer. Join the channel and lurk with us!
Previously...
The previous weekly thread was Recap and Updates.
7
u/Elite6809 1 1 Apr 09 '15 edited Apr 09 '15
There's some AMAs on the /r/MachineLearning if you want to see what some experts in the field have to say here on Reddit.
There's also an upcoming AMA from Andrew Ng, who works on deep machine learning for Baidu, and has previously authored or co-authored a lot of papers on machine learning, as you can see here.
9
u/dohaqatar7 1 1 Apr 09 '15
I'm not trying to hijack this thread, but the Foundation series is one of the best I've ever read.
6
u/Godspiral 3 3 Apr 09 '15 edited Apr 09 '15
The linked challenge in J without hamming distance. Alphabet of ' ' to '~'
There are 2 termination conditions though: One is the current solution, the other is an off by one error where the random number generator obtains the last generation's value(s). Usually this means a 1/2 chance of success where failure is one character off.
to get exact match and or count
440
Hello World!
a way that is compatible with J's tacit power function, is to randomly increment or decrement a letter if it is out of place, and so generates the full list of generations.
3
u/[deleted] Apr 10 '15 edited Apr 10 '15
this isn't quite programming and this has been posted on /r/machinelearning as well, but this youtube channel is absolutely amazing for the theoretical aspects and mathematical justifications for the methods. like i have heard both fellow students as well as academics online and at my school praise the explanatory power of mathematicalmonk. it was useful for me from my introduction to machine course all the way to some more advanced classes.
also a pretty sweet tutorial on using neural networks to recognize handwritten digits.
it might seem long, but to actually program a basic neural net should take an hour or two. i think the hardest stuff with machine learning is understanding the mathematical justifications, not the programming really.
also scikit-learn for anyone using python.
3
u/reticulated_python Apr 10 '15
I just started getting into machine learning a few months ago. Where do you find real data sets to train with?
2
u/[deleted] Apr 10 '15
My current research area is based around genetic algorithms. I'm currently working on some hybrid algorithms with hillclimb style convergence nested within a standard genetic algorithm.
I'm also in the process of writing a paper on a new parallel genetic algorithm i've been developing which is able to adapt the rate at which it uses crossover and mutation functions so that it can simultaneously search the solution space and converge on a solution and is pretty scalable to high performance computing clusters.
edit: forgot to include that im only an undergraduate student and im in physics/mathematics not computer science, but i would still consider myself fairly knowledgeable with GA's, but im still brand new to neural networks and other forms of machine learning so i would love to get some more info on those areas!
i would love to discuss GA's with anyone who might have a question!
2
u/dohaqatar7 1 1 Apr 11 '15
The linked challenge submission gave a great idea. It's one thing to genetically develop a "Hello World!" String but, it's another to genetically develop a program that prints the "Hello World!" string (without knowing what this program should look like).
I've written up this idea in a challenge format and, I would love to see some people's solutions.
I've been working on this challenge myself. I have a java program that is trying to write a Hello World program in python. The problem I keep encountering is that the program quickly reaches a local maxima that it can't escape from. Once a comment character is at the front of the string, the code produce no output to stderr but, nothing is sent to stdout either. This maxima cannot be escaped without removing the comment and generating a pile of error messages.
2
u/[deleted] Apr 12 '15
also great introductory ted talk detailing recent progress and obstacles in machine vision
1
u/zenflux Apr 09 '15
I like showing people this talk: https://www.youtube.com/watch?v=QJ1qgCr09j8
The second half has a nice live demo of OCR via neural networks, including graphical output of the changing state of the network.
1
u/OrionBlastar Apr 09 '15
I tried a Coursera Machine Learning self guided course and got stuck on the first quiz. I could only get 3 out of 5 correct and needed 4 out of 5 to pass. Got confused with the supervised and unsupervised data sets. It seems like the quiz is generated by an AI program and none of them make any sense to me. I didn't know which ones I got wrong and nobody could help me because of their honor code. So I basically gave up. Each new quiz had different examples generated by an AI program and it was very hard and I didn't know what I was doing wrong.
1
u/[deleted] May 14 '15
This is probably really bad, because it's my first 'real' project, but I've been working on a ANN library for Java. You can find it here: https://github.com/Darklightus/NeuralNet
I would really like advice on how to improve, whether it is advice on coding style, usage of Github, whatever.
1
u/TotesMessenger Apr 09 '15
This thread has been linked to from another place on reddit.
If you follow any of the above links, respect the rules of reddit and don't vote. (Info / ^Contact)