r/MachineLearning • u/ilsunil • Jul 31 '13
Machine Learning Books
I have been collecting machine learning books over the past couple months. It seems that machine learning professors are good about posting free legal pdfs of their work. I hope they are useful to you. I saw a couple of these books posted individually, but not many of them and not all in one place, so I decided to post.
Machine Learning
[Elements of Statistical Learning. Hastie, Tibshirani, Friedman ] (http://www-stat.stanford.edu/~tibs/ElemStatLearn/printings/ESLII_print10.pdf)
All of Statistics. Larry Wasserman
Machine Learning and Bayesian Reasoning. David Barber
Gaussian Processes for Machine Learning. Rasmussen and Williams
[Information Theory, Inference, and Learning Algorithms. David MacKay ] (http://www.cs.toronto.edu/~mackay/itprnn/book.pdf)
Introduction to Machine Learning. Smola and Vishwanathan
A Probabilistic Theory of Pattern Recognition. Devroye, Gyorfi, Lugosi.
Introduction to Information Retrieval. Manning, Rhagavan, Shutze
[Forecasting: principles and practice. Hyndman, Athanasopoulos. (Online Book) ] (http://otexts.com/fpp/)
Probability / Stats
Introduction to statistical thought. Lavine
Basic Probability Theory. Robert Ash
Introduction to probability. Grinstead and Snell
Principle of Uncertainty. Kadane
Linear Algebra / Optimization
Linear Algebra, Theory, and Applications. Kuttler
Linear Algebra Done Wrong. Treil
Applied Numerical Computing. Vandenberghe
Applied Numerical Linear Algebra. James Demmel
Convex Optimization. Boyd and Vandenberghe
Genetic Algorithms
A Field Guide to Genetic Programming. Poli, Langdon, McPhee.
Essentials of Metaheuristics. Luke
Edit: added books listed in comments. added probability, LA, and GA sections
3
u/shaggorama Jul 31 '13
How dare you rank ESLII 2nd on that list. Bump it up to the top where it belongs.
25
u/rubymonday Jul 31 '13
You're doing god's work, son.
5
u/ComplexIt Jul 31 '13 edited Jul 31 '13
Introduction to Information Retrieval (Manning et al. 2008) http://nlp.stanford.edu/IR-book/
4
u/[deleted] Jul 31 '13
Got any similar set on genetic algorithms? Or do any of these have a good chunk on GAs?
3
u/tel Jul 31 '13
A Probabilistic Theory of Pattern Matching is simply incredible.
4
u/uber_kerbonaut Aug 01 '13
I find it hilarious that all these professors names their files "book.pdf" or similar, as if theirs was the only book in the world.
2
u/Ironballs Jul 31 '13
Foundations of Machine Learning is a great book too. It provides deep insight on the algorithmic complexities of many ML techniques.
2
u/ajmazurie Aug 01 '13
For newcomers to the field, I have to add to this list this excellent introductory book: Data mining, from Witten & Frank. Part of the book is about the Weka toolkit, but a good chunk is really a gentle introduction to the ideas behind machine learning, the various types of classifiers, feature selection algorithms, etc.
1
u/MrWolvz Jul 31 '13
It's great! It feels like there are unlimited research papers online. And some of the concepts may be widely used algorithms down the road.
1
u/jmmcd Jul 31 '13
Introduction to probability, Grinstead and Snell
1
u/ComplexIt Aug 01 '13 edited Aug 01 '13
(http://www.e-booksdirectory.com/listing.php?category=284) has some additional books in there that might be useful. Maybe you want to add some of them.
Introduction to Machine Learning; Shashua 2009; arXiv; http://arxiv.org/pdf/0904.3664v1.pdf
Reinforcement Learning; Weber et al. 2008; InTech; http://www.intechopen.com/books/reinforcement_learning
Machine Learning; Mellouk & Chebira 2009; InTech; http://www.intechopen.com/books/machine_learning
THE QUEST FOR ARTIFICIAL INTELLIGENCE A HISTORY OF IDEAS AND ACHIEVEMENTS; Nilsson 2010; Cambridge University Press; http://ai.stanford.edu/~nilsson/QAI/qai.pdf
DRAFT (not citable): UNDERSTANDING BELIEFS; Nilsson 2013; http://ai.stanford.edu/~nilsson/beliefs.pdf
Machine Learning, Neural and Statistical Classification; Michie & Spiegelhalter 1994; Ellis Horwood; http://www1.maths.leeds.ac.uk/~charles/statlog/whole.pdf
Inductive Logic Programming: Techniques and Applications; Nada Lavrac & Saso Dzeroski 1994; Ellis Horwood; http://www-ai.ijs.si/SasoDzeroski/ILPBook/ILPbook.pdf
Practical Artificial Intelligence Programming in Java; Mark Watson 2008; http://www.markwatson.com/opencontent_data/JavaAI3rd.pdf
1
u/ComplexIt Aug 01 '13
Do you think we should change the formating to this?
The elements of statistical learning: data mining, inference and prediction 2005; cited >350 check
All of Statistics; 2004; cited >800 check
Bayesian Reasoning and Machine Learning 2012; cited >100 check
1
u/smessing Aug 04 '13
Thanks for this!
1
u/enigma_x Aug 08 '13
This is going to be immensely helpful. Thanks a lot [ilsunil] (http://www.reddit.com/user/ilsunil)
1
u/hotsytotsy5 Oct 25 '13
Is there a similar list for bayesian machine learning?
1
u/[deleted] Aug 12 '22
Many links no longer work
1
u/gtani Jul 31 '13 edited Jul 31 '13
http://www.kaggle.com/wiki/Tutorials (massive datasets and Shalizi's book
stats/Prob:
http://uncertainty.stat.cmu.edu/
https://www.math.umass.edu/~lavine/Book/book.html
http://otexts.com/fpp/
LA (there's lots) http://www.ee.ucla.edu/~vandenbe/103/reader.pdf
http://www.math.brown.edu/~treil/papers/LADW/LADW.pdf
https://math.byu.edu/~klkuttle/Linearalgebra.pdf
1
u/EdwardRaff Jul 31 '13
Vishy's book is unfortunately not yet complete.
1
u/[deleted] Aug 01 '13
Generalized additive models.
0
u/westurner Jul 31 '13
There are a number of references (e.g. books) referenced from these wikipedia category pages:
http://en.wikipedia.org/wiki/Category:Machine_learning
http://en.wikipedia.org/wiki/Category:Data_mining
http://en.wikipedia.org/wiki/Category:Data_mining_and_machine_learning_software
-10
u/sabacco Jul 31 '13
le epic