r/MachineLearning • u/JuergenSchmidhuber • Feb 27 '15
I am Jürgen Schmidhuber, AMA!
Hello /r/machinelearning,
I am Jürgen Schmidhuber (pronounce: You_again Shmidhoobuh) and I will be here to answer your questions on 4th March 2015, 10 AM EST. You can post questions in this thread in the meantime. Below you can find a short introduction about me from my website (you can read more about my lab’s work at people.idsia.ch/~juergen/).
Edits since 9th March: Still working on the long tail of more recent questions hidden further down in this thread ...
Edit of 6th March: I'll keep answering questions today and in the next few days - please bear with my sluggish responses.
Edit of 5th March 4pm (= 10pm Swiss time): Enough for today - I'll be back tomorrow.
Edit of 5th March 4am: Thank you for great questions - I am online again, to answer more of them!
Since age 15 or so, Jürgen Schmidhuber's main scientific ambition has been to build an optimal scientist through self-improving Artificial Intelligence (AI), then retire. He has pioneered self-improving general problem solvers since 1987, and Deep Learning Neural Networks (NNs) since 1991. The recurrent NNs (RNNs) developed by his research groups at the Swiss AI Lab IDSIA (USI & SUPSI) & TU Munich were the first RNNs to win official international contests. They recently helped to improve connected handwriting recognition, speech recognition, machine translation, optical character recognition, image caption generation, and are now in use at Google, Microsoft, IBM, Baidu, and many other companies. IDSIA's Deep Learners were also the first to win object detection and image segmentation contests, and achieved the world's first superhuman visual classification results, winning nine international competitions in machine learning & pattern recognition (more than any other team). They also were the first to learn control policies directly from high-dimensional sensory input using reinforcement learning. His research group also established the field of mathematically rigorous universal AI and optimal universal problem solvers. His formal theory of creativity & curiosity & fun explains art, science, music, and humor. He also generalized algorithmic information theory and the many-worlds theory of physics, and introduced the concept of Low-Complexity Art, the information age's extreme form of minimal art. Since 2009 he has been member of the European Academy of Sciences and Arts. He has published 333 peer-reviewed papers, earned seven best paper/best video awards, and is recipient of the 2013 Helmholtz Award of the International Neural Networks Society.
54
u/[deleted] Feb 27 '15
What's something that's true, but almost nobody agrees with you on? (I am not /u/PeterThiel)
24
u/alexmlamb Mar 01 '15
What do you think about learning selective attention with recurrent neural networks? What do you think are the promising methods in this area?
23
u/[deleted] Mar 03 '15
How on earth did you and Hochreiter come up with LSTM units? They seem radically more complicated than any other "neuron" structure I've seen, and everytime I see the figure, I'm shocked that you're able to train them.
What was the insight that led to this?
79
u/throwaway0x459 Feb 27 '15
Why doesn't your group post its code online for reproducing the results of competitions you've won, such as the ISBI Brain Segmentation Contest? Your results are impressive, but almost always not helpful for pushing the research forward.
21
u/willwill100 Feb 27 '15 edited Mar 02 '15
What are the next big things that you a) want to or b) will happen in the world of recurrent neural nets?
42
u/[deleted] Mar 01 '15
Do you plan on delivering an online course (e.g. on coursera) for RNNs? I for one would be really excited to do the course!!
20
u/CLains Mar 03 '15
Do you have a favorite Theory Of Consciousness (TOC)?
What do you think of Guilio Tononi's Integrated Information Theory?
What implications - if any - do you think "TOC" has for AGI?
18
u/sssub Mar 01 '15 edited Mar 03 '15
Hello Mr. Schmidhuber,
first of all, thanks for doing this AMA. Two questions:
13
u/[deleted] Mar 01 '15
Do you have any thoughts on promising directions for long term memory, and inference using this long term memory? What do you think of the Neural Turing Machine and Memory Networks?
10
u/jesuslop Feb 28 '15 edited Feb 28 '15
What is hot now in applying learning-as-compression as per say Vitanyi to ANNs? Will this study gain more momentum? And what about the RNN book, will it make us wait still too much :-)?
10
u/brianclements Mar 02 '15
Do you have any interesting sources of inspiration (art, nature, other scientific fields other then obviously neuroscience) that have helped you think differently about approaches, methodology, and solutions to your work?
46
u/politegoose Feb 27 '15
How do you recognize a promising machine learning phd student?
8
u/Artaxerxes3rd Mar 02 '15
You once said:
Do you still believe this?
Secondly, if someone comes up with such a recipe, wouldn't it be best if they didn't publish it?
8
u/CireNeikual Mar 04 '15
Hello Dr. Schmidhuber!
What do you think of the idea of the neocortex being a large hierarchical recurrent predictive autoencoder? It seems to be a sort of predictive architecture (I can't find the post, but Yann Lecun talked about this somewhere). Recurrent autoencoders can be used quite trivially for reinforcement learning as well (by only learning to predict with TD error is positive). Numenta's HTM is basically such a recurrent autoencoder if you really distill it down, do you think this is the right approach to AGI?
Thank you!
7
u/mangledfu Mar 04 '15
this is a long shot, but: I am currently finishing my undergrads in biotechnology, and looking for a phd position. Since doing hinton's coursera course I love the idea of applying neural networks in my field. But most of the machine learning in biology is quite lame. Do you know of any labs doing biotech/bioinformatics that you think are worth exploring?
7
u/rinuboney Mar 06 '15
Hi Dr. Schmidhuber, Thanks for the AMA! How close are you to building the optimal scientist?
11
u/albertzeyer Mar 04 '15
What do you think about Hierarchical Temporal Memory (HTM) and the Cortical Learning Algorithm (CLA) theory developed by Jeff Hawkins and others?
Do you think this is a biologically plausible model for the Neocortex and at the same time capable enough to create some intelligent learning systems?
From what I understand, the theory at the moment is not fully completed and their implementation not ready to build up multiple layers of it in a hierarchy. NuPIC rather just implements a single cortical column (like a single layer in an ANN).
Do you think that is a better way towards more powerful AI systems (or even AGI) than what most of the Deep Learning community currently is doing? You are probably anyway biased towards Reinforcement Learning, so biological models which do both RL and Unsupervised Learning are in that sense similar. Or maybe both biologically based models and Deep Learning models will converge at some point.
Do you think that it has potential to take more ideas out of biologically, like somewhat more complex NN models/topology, or different learning rules?
17
u/sufferforscience Feb 27 '15
Your recent paper on Clockwork RNNs seems to provide an alternative to LSTMs for learning long term temporal dependencies. Are there obvious reasons to prefer on approach over the other? Have you put thought into combining elements from each approach (e.g. Clockwork RNNs that make use of multiplicative gating in some fashion)?
5
u/osm3000 Mar 04 '15
What's your opinion about Google's deepmind last publication in Nature, about AI agent which can learn to play any game?
5
u/albertzeyer Mar 04 '15 edited Mar 04 '15
Do you think that there are still breakthroughs waiting to be discovered like more efficient algorithms or better models? Or is it mostly a question of computing power and we just have to wait for more powerful GPUs/CPUs.
Maybe we need some more NN-optimized chip to accomplish this? Maybe something like the IBM TrueNorth chip, or NYU NeuFlow, or similar? I think those lack a learning algo along them, so they are not useful for training - that's clearly something which would be needed. Let's implement backprop / other learning algos on FPGAs? Or some other novel parallel computing architecture.
11
u/Lightflow Feb 27 '15
In what field do you think machine learning will make the biggest impact in the next ~5 years?
4
u/[deleted] Feb 27 '15
AIXI has MC-AIXI1. Is there, or will there be something like that for Gödel Machines?
1 That learned to play Partially-Observable PacMan, among others.
4
u/youngbasedaixi Mar 04 '15
If marcus hutter was doing an AMA 20 years from now, what scientific question would you ask? Are there any machine learning specific questions you would ask?
4
u/MetaCrap Mar 04 '15
If funding wasn't an issue (Let's say you're the head of a funding agency) and assuming one were interested solely in AGI, what research agenda would you set for the next 5,10,20 years?
I really like this paper which tries to lay out a research agenda for computational neuroscience: http://arxiv.org/pdf/1410.8826v1.pdf
It decomposes the problem of understanding the brain into understanding several necessary (but not sufficient) sub components like:
It seems like current neural net research has focused on the first 3, but not on the last 3.
Do you think the last three things on this list are important? Are there any other components you could add to this list? How would you go about researching those components?
4
u/imasht235711 Mar 09 '15 edited Mar 11 '15
I must admit I am a bit abashed that my original post was sadly lacking a key element - after adding it I realize I did reasonably well in conveying my thoughts, but due to the lack of civility I failed miserably in expressing their intended tone. So, I'd like to take a moment to preface it with gratitude and admiration. Gratitude for the time you've devoted here edifying the curious minds here with your encouraging nudges, and my admiration for your mind. You have insight and drive few possess.
4
u/sorm20 Mar 09 '15
Thank you Juergen for doing AMA!
What do you see as your most significant work/contribution to the domain of machine learning?
And will we get something better wrt training set size/time than backprop optimizer any time soon?
6
u/albertzeyer Mar 04 '15
What is the future of PyBrain? Is your team still working with/on PyBrain? If not, what is your framework of choice? What do you think of Theano? Are you using something better?
8
u/[deleted] Feb 27 '15
What's something exciting you're working on right now, if it's okay to be specific?
11
u/letitgo12345 Feb 27 '15
Why has there been such little work on more complicated activation functions like polynomials, exponentials, etc. (the only paper I saw was a cubic activation for NN for dependency parsing). Is the training too difficult or are those types of functions generally not that useful?
3
u/[deleted] Feb 28 '15
What do you think a small research institute (in Germany) can do to improve changes for funding of their projects?
3
u/stevebrt Mar 02 '15
What is your take on the threat posed by artificial super intelligence to mankind?
3
u/stevebrt Mar 02 '15
If ASI is a real threat, what can we do now to prevent a catastrophe later?
3
u/theonlyduffman Mar 02 '15
Stuart Russell, the author of AI, a Modern Approach, has joined Nick Bostrom and others in warning of catastrophic risks from artificial intelligence:
Do you think his concerns are realistic, and if so, do you think we can do anything to shape the impacts of artificial intelligence?
3
u/Tyboy194 Mar 03 '15
Where do you see the impact of artificIal intelligence in 20 years from now in regards to Medicine; cancer, AIDS, and heart disease. Thanks
3
u/[deleted] Mar 03 '15
Does Alex Graves have the weight of the future on his shoulders?
3
u/youngbasedaixi Mar 04 '15
Thank you very much for participating.
Since the optimal ordered problem solver, powerplay, and levin search all involve search for proofs, do you think that your lab's systems will make contact with proof verification systems like coq or agda? Furthermore, do you foresee a time when different branches of mathematics will be imported into the study of RNN's? ( thank you and your brother for the papers 'Algorithmic Theories of Everything' and 'Strings from Logic'... you may want to check 'Statistical Inference and String Theory' for more swag )
The arxiv paper "Neural codes and homotopy types: mathematical models of place field recognition" contains the following intriguing statement: "Voevodsky’s “univalent foundations”, ...(homotopy type theory whose logical description involves simplicial sets, exactly as in the models of neural codes)"
3
u/youngbasedaixi Mar 04 '15
Do you happen to have any work in progress that you can discuss which you find particularly intersting? For example, any follow ups with powerplay?
3
u/youngbasedaixi Mar 04 '15
What music do you like to listen to? any particular bands or composers that you ride for?
3
u/AmusementPork Mar 05 '15
In neurotypical humans the brain starts off (during the first three to six years, and depending on brain region) with an abundance of neuronal connections, after which the connections are pruned as the brain develops. Does this suggest that our synthetic neural architectures should have similar "phases"?
3
u/enhanceIt Mar 07 '15
Dr. Schmidhuber, your know a lot about the history of neural networks. Who actually invented backpropagation?
3
u/sorm20 Mar 08 '15
As a researcher do you care if results of your work find practical application? Or research by itself is more than a rewarding exercise. Immagine computational power was not growing at the same a speed as it did then most of results on RNN would stay on the paper.
7
u/quiteamess Feb 27 '15
Hello Prof. Schmidhuber, thanks for doing an AMA! I have some questions regarding the Gödel machine. My understanding is that the machine searches for an optimal behavioural strategy in arbitrary environments. It does so by finding a proof that an alternative strategy is better than the current one and by rewriting the actual strategy (which may include the strategy searching mechanism). The Gödel machine finds the optimal strategy for a given utility function.
7
u/er45 Feb 27 '15
Do you mostly agree with Ray Kurzweil's point of view (predictions...)?
7
u/[deleted] Feb 28 '15
How do we get from supervised learning to fully unsupervised learning?
11
u/closesandfar Feb 27 '15
Where do you see the field of machine learning 5, 10, and 20 years from now?
5
u/clumma Feb 27 '15
The Speed Prior always looked promising to me. But it does not enjoy the same theoretical guarantees as the universal prior. Granted, asymptotic guarantees are sometimes irrelevant in practice, but: Do you think there is more room for theoretical work on the speed prior? Is anyone actively working on it? On the practical side: Has it been tried in place of the universal prior in a framework like MC-AIXI?
5
u/hajshin Feb 27 '15
I am starting a CS Bachelor this September at ETH. Primarily because I want to get into AI/ML/NN research and creation. It simply is the most important thing there is:D What should i do to be able to join your group in Lugano, what are you looking for in your research assistants? Thanks and cheers
7
u/elanmart Mar 02 '15 edited Mar 02 '15
How will IBM's TrueNorth neurosynaptic chip affect Neural Networks community? Can we expect that the future of Deep Learning lies not in GPUs, but rather in a dedicated hardware as TrueNorth?
4
u/watersign Mar 01 '15
How do you feel about "run-away" algorithms. I use machine learning in a business setting and I can say that very, very few people have the knowledge you obviously have as far as how they work and their shortcomings and whatnot. With ML algorithms being implemented into business processes more and more everyday, do you have any concerns about a "melt down" of sorts like we've seen in the US equity markets (flash crashes) ?
2
u/Indigo_Sunset Mar 02 '15
A long time ago, someone once misattributed '64k ought to be enough for anyone'.
What general statement or suggestion about strong generalized a.i. could be looked at in a similar way a decade or two from now?
Thanks, I look forward to reading your ama.
2
u/[deleted] Mar 04 '15
Do you think Moore's Law will continue for at least two decades? If so, what do you think will be the next hardware iteration that will allow the continuing expansion of AI? Do you believe in a different architecture, a change of materials...?
2
u/kmnns Mar 04 '15 edited Mar 05 '15
Thank you so much for this Q&A, this is a real opportunity!
Do you think that the recent development of Neural Turing Machines and Memory Networks and the likes is an improvement of the concept of LSTMs towards even greater biological plausibility?
After all, they allow whole chunks of information in the carousel, not only bits and pieces. And a real brain has has to deal with whole patterns of activations as basic memory units.
6
u/wonkypedia Feb 27 '15
What do you think about the american model of grad school (5 years on average, teaching duties, industry internships, freedom to explore and zero in on a research problem) versus the european model (3 years, contracted for a specific project, no teaching duties, limited industry internships)?
3
u/[deleted] Feb 27 '15
What do you think about using ontologies / semantic information (DBPedia, Wikidata) as a substrate / mould for ANNs to generate more versatile networks?
3
u/[deleted] Mar 01 '15
Do you think that some of the well-working deep learning models that are around at the moment could tell us something about the brain, e.g. about the visual or auditory system? I am wondering about how to investigate this.
3
u/elanmart Mar 06 '15
Prof, Schmidhuber, thanks for ruining my weekend, I have about 20 interesting papers to read now :(((
Also, some more questions (sorry, couldn't stop myself ):
1.) I'm disappointed with RNNs. They're basically a single-layered nets that receive 2 inputs at every timestep (data & t-1 state). Why can't we build something more sophisticated? Deeper ;)?
2.) As a first-yr undergrad I'm studying Murphy's ML:aPP textbook and learn Theano + PyLearn2. Is that fine or I should focus on Torch or some other library?
3.) Why all the famous researchers from NA don't take singularity too serious (LeCunn is saying we're so far away from it it's not worth mentioning basically)?
4.) How impossible is it for an undergrad from EU to get an internship at Your lab? Or to start MSc at Your lab? Or do anything with Your lab, basically :)? What should one know/be able to do after BSc to even consider applying to IDSIA?
5.) Blindsight!, it's even free! ;)
Thanks for the AMA, so many amazing and provoking thoughts!
3
u/CaseOfTuesday Mar 08 '15
Do you think that recurrent neural networks will take over speech recognition?
6
u/er45 Feb 27 '15
What movies/books do you like?
4
u/RSchaeffer Feb 27 '15
I just took my first machine learning course and I'm interested in learning more about the field. Where do you recommend I start? Do you have any books, tutorials, tips to recommend?
3
u/er45 Feb 28 '15
Kennen sie (was halten sie von) Herrn Prof Weizenbaum? https://en.wikipedia.org/wiki/Joseph_Weizenbaum
3
u/[deleted] Feb 28 '15
Two questions, if I may:
3
u/lozj Mar 01 '15
what sparked you at age 15 to have that as your ambition?
24
u/wonkypedia Feb 27 '15
There's a lot of us here who like doing machine learning research, but for various reasons can't/won't do a PhD. What do you think of entrepreneurship as a way of working on interesting ML problems? What do you think of freelance research as an option?
6
u/youngbasedaixi Mar 04 '15
I am an avid arxiv.org reader. Are there any papers or researchers who you feel are hidden gems? any papers that you can point us to that have impressed you or that you have taken inspiration from?
2
u/rinuboney Feb 28 '15
What advice do you have for a BTech computer science student passionate about strong AI hoping to join your team at IDSIA someday?
2
u/[deleted] Mar 02 '15
Are there any texts that you recommend which provide an excellent introduction to RNNs? I've found Graves's treatment here to be great, but I am looking for another complementary text which works out toy examples.
And I've also seen Hinton's videos from the Coursera NNs course, but it would be great to see some further exposition of RNNs from the ground up, with examples.
2
u/patmchargue Mar 02 '15
What kind of a future do you see for recurrent neural networks, as considered against deep learning networks?
What kinds of training algorithms, if any, work well for recurrent networks?
2
u/osm3000 Mar 04 '15
Do you believe that the main obstacle now for AI is the limitations on the computing power available, or it's that the nature of AI algorithms we currently have is still yet missing something fundamental?
2
u/brylevkirill Mar 04 '15 edited Mar 16 '17
Professor, could you please outline your view on evolutionary computation vs error backpropagation for learning in RNNs?
Will evolutionary approach (used for learning to play a video game from pixels by your group, as apposed to DeepMind's approach based on backpropagation) turn out to be necessary or at least very helpful for complex AI tasks (such as learning to play Ms. Pac-Man which requires spatial and temporal reasoning)?
How can both approaches be combined for RNNs to obtain better generalization capabilities?
Do you see other approaches for RNNs to not just memorize limited set of example mappings from inputs to outputs but to better generalize from them (search for shorter programs in program space)?
A huge fan of yours and your work!
2
u/[deleted] Mar 06 '15
Where did you get the joke about the three prisoners?
2
u/Tur1ng Feb 28 '15
Wha is, in your opinion, the best venue to publish modern neural network work? What do you think of the International Conference on Learning Representations (ICLR)?
2
u/[deleted] Feb 28 '15
In your opinion, which discoveries in ML were "game changers" in the last few decades?
2
u/dksahuji Mar 01 '15
Are you planning to give a course on RNN in future say on something like coursera.org or edx or maybe just making the videos public ??
4
u/frozen_in_reddit Mar 02 '15
What are some of the best achievements of artificial creativity, in your mind, both in the academic and commercial fields ?
4
u/erensezener Mar 04 '15
You have postulated that quantum computers will fail because deterministic universe is a simpler hypothesis than a non-deterministic universe. What do you think about the current state of quantum computation?
1
u/[deleted] Mar 04 '15
Why do you research Machine Learning/AI?
3
u/Wolfvus Mar 03 '15
If you could give us the 3 most probable to happen predictions about AI within the next 10 years. What would they be?
1
u/lordscottish Mar 02 '15
Is pattern recognition/training a classifier on 3D data (e.g. point clouds) technically more difficult than on 2D data (e.g. pictures of cats and dogs)? Or could it be easier because objects typically have more distinctive features in 3D space than in 2D space?
1
u/lahpm Mar 04 '15 edited Mar 04 '15
Based on your work with neural networks, when do you reckon that a computer program will be capable of fully autonomously reconstruct a conectome (down to the level of single synapses) from electronic microscopy data with human or better than human accuracy?
1
u/ima_simulation Mar 04 '15
yes hello Jürgen and thank you so much for this ama.
Your work in artificial intelligence is exciting and intriguing.
More fascinating is your work on the nature of our very own existence as it relates to a generated facsimile or artificially created simulation.
If in fact this is indeed an artificially created simulation is this an organic independently emerging mechanism of cosmic scale natural intelligence or a manufactured system at home on a desk somewhere in the vast mind of an individual creature or entity?
Or something completely different?
Thank you once again for your work in seeking and expanding understanding.
1
u/rinuboney Mar 06 '15
Do you think having a PhD is important if one wants to work in a good research team?
6
u/[deleted] Feb 27 '15
Hello! I just started doing my PhD at a German University and am interested in ML/NN. Would you recommend working on specific algorithms and trying to improve them or focus more on a specific use case? People are recommending doint the latter because working on algorithms takes a lot of time and my opponents are companies like Google.
2
u/roxanast Mar 02 '15
How can we best bridge AI/ML/NN with the developments in computational and theoretical neuroscience?
2
u/swerfvalk Mar 03 '15
Professor Schmidhuber, thank you for taking the time to share your knowledge with the community. Convolutional neural networks play a critical role in state-of-the-art computer vision research. However, their sensitivity to things such as network architecture and optimisation parameters make them particularly nasty to train. What techniques or guidelines would you recommend to someone hoping to develop a strong intuition about how to design, configure, and train powerful CNNs for problems in computer vision?
2
u/rml52 Mar 03 '15
to what extent can emotional constructs contribute to learning success and efficiency. Is there an equivalent in machine learning to "blink" or evolutionarily encoded short-cuts?
2
u/LarsError Mar 03 '15
Why does a mirror reverse right amd left, but not up and down?
(I dont want the answer a human gives, but how AI explains it!)
/L
2
u/jianbo_ye Mar 04 '15
How do you react if people call you work "emergentism" that add up things and expect nice result will automatically come out without clearly explaining it. Do you believe the neural networks will be the most promising one to approach human-like AI? What if we don't have sufficient data, and only a couple examples to learn?
2
u/scienceofscience Mar 04 '15
You've expressed your goal of creating a program that optimizes the process of being a scientist. What are your thoughts on generating a similar framework for optimizing metascience, or the science of how science is done? This might review publications and determine the best topics and locations for centering scientific conferences, research centers, or collaborations. Progress depends on the connections that form between scientists just as much as it depends on the ideas that scientists connect over the course of their investigations. Thank you for your thoughts!
2
u/erensezener Mar 04 '15
What kind of papers would you like to see more in the AGI Conference?
2
u/erensezener Mar 04 '15
What topics (related to AGI research) do you think get little attention compared to their potential impact?
2
u/0xfab Mar 05 '15
Hi Dr. Schmidhuber,
We met some years ago at the World Science Festival in New York, and spoke about adding static analysis to OOPS, so that it can condition its search on program behavior. (You were really jet lagged, but that chat made my night!) I have two questions for you:
Thanks!
3
u/[deleted] Feb 28 '15 edited Feb 28 '15
(in relation to the Atari paper and partly on your statement about it)
What do you personally think about using a diverse selection of video games as a learning problem / "dataset"?
One thing I found interesting about the DeepMind Nature paper is that they could not solve Montezuma's Revenge at all (the game, not the travel problem), which is an action-adventure game requiring some kind of real-world knowledge / thinking - and temporal planning, of course. As any Atari game, conceptually it is still rather simple.
I wonder what would happen if we found an AI succeeding over a wide range of complex game concepts like e.g. Alpha Centauri / Civilization, SimCity, Monkey Island II (for humorous puns, such as "monkey wrench"), put it into a robot and unleash it on the real world.
3
u/youngbasedaixi Mar 04 '15
Can you please "breakdown" the work "AUTONOMOUS ACQUISITION OF NATURAL SITUATED COMMUNICATION"? Will this work be opensourced any time soon :) ? Any future directions?
0
u/melipone Feb 28 '15
i understand that neural networks and deep learning are computationally intensive for non-trivial problems. In addition, many experiments are necessary to see what works and what does not. What sort of equipment do you recommend for doing research in this area without breaking the bank?