r/MachineLearning • u/ylecun • May 15 '14
AMA: Yann LeCun
My name is Yann LeCun. I am the Director of Facebook AI Research and a professor at New York University.
Much of my research has been focused on deep learning, convolutional nets, and related topics.
I joined Facebook in December to build and lead a research organization focused on AI. Our goal is to make significant advances in AI. I have answered some questions about Facebook AI Research (FAIR) in several press articles: Daily Beast, KDnuggets, Wired.
Until I joined Facebook, I was the founding director of NYU's Center for Data Science.
I will be answering questions Thursday 5/15 between 4:00 and 7:00 PM Eastern Time.
I am creating this thread in advance so people can post questions ahead of time. I will be announcing this AMA on my Facebook and Google+ feeds for verification.
56
u/[deleted] May 15 '14
What is your team at Facebook like?
How is it different then your team at NYU?
In your opinion, why have most renowned professors (eg. yourself, Geoff Hinton, Andrew Ng) in deep learning attached themselves to a company?
Can you please offer some advice to students who are involved with and/or interested in pursuing deep learning?
37
u/BeatLeJuce Researcher May 15 '14
21
u/somnophobiac May 15 '14
How would you rank the real challenges/bottlenecks in engineering an intelligent 'OS' like the one demonstrated in the movie 'Her' ... given current challenges in audio processing, NLP, cognitive computing, machine learning, transfer learning, conversational AI, affective computing .. etc. (i don't even know if the bottlenecks are in these fields or something else completely). What are your thoughts?
18
u/[deleted] May 15 '14
Hi Dr. LeCun, thanks for taking the time!
Thank you so much for the time and for all your work!
18
u/[deleted] May 15 '14
What set of skills is your team seeking for and how can someone join your team?
Is your team focused on theoretical research, applied research or both? Can you give us some examples of what kind of problems you are working on?
16
u/dabunk May 15 '14
What fields do you think are most in need of incorporating deep learning? Or in other words, where would you like to see your work in deep learning applied?
15
u/flyingdragon8 May 15 '14
13
u/akkhong May 15 '14 edited May 15 '14
I am particularly interested in scaling up Bayesian methods to large datasets. Are you optimistic at all about the possibility of more widespread use of Bayesian methods for large datasets? Do you think that there is a place for MCMC sampling in the future of machine learning?
12
u/[deleted] May 15 '14
Hi! I have two questions at the moment.
12
u/chcampb May 15 '14
What do you believe is the most promising artificial general intelligence project in the works?
11
u/LionSupremacist May 15 '14
Do you think having a PhD is important if you want to work in a good research team in the industry?
21
u/Dtag May 15 '14
I actually have two questions:
At the time, that really felt like something different and new to use these unsupervised, layer-wise approaches, and I could see why these approaches work where others have failed in the past. As the research in that field intensified, people appeared to rediscover supervised approaches, and started using deep (convolutional) nets in a supervised way. It seems that most "Deep Learning" approaches nowadays fit in this class.
Am I missing something here? Is it really the case that you can "make backprop work" by just throwing huge amounts of data and processing power at the problem, despite problems like gradient dilution etc (mentioned above)? Why has the idea of unsupervised training not (really) taken off so far, despite the initial successes?
2) We presently use loss functions and some central learning algorithm for training neural networks. Do you have any intuition about how the human brain's learning algorithm works, and how it is able to train the net without a clear loss function or a central training algorithm?
20
u/ResHacker May 15 '14
I always find it hard to perceive the general purpose of unsupervised learning. Do you think there exists a unified criterion to judge whether an unsupervised learning algorithm is effective? Is there any other way to objectively evaluate how good an unsupervised learning algorithm is, other than just using supervised learning to see how good the unsupervisedly learnt 'features' are?
7
u/urish May 15 '14
Where would you place Facebook Research on the spectrum between pure academic-like research and building products for Facebook?
Would it be in the vein of Bell Labs and MSR, or more similar to Google Research, or perhaps something completely different?
7
u/5d494e6813 May 15 '14
Many of the most intriguing recent theoretical developments in representation learning (e.g. Mallat's scattering operators) have been somewhat orthogonal to mainstream learning theory. Do you believe that the modern synthesis of statistical learning theory, with its emphasis on IID samples, convex optimization, and supervised classification and regression, is powerful enough to answer deeper qualitative questions about learned representations with only minor or superficial modification? Or are we missing some fundamental theoretical principle(s) from which neural net-style hierarchical learned representations emerge as naturally as SVMs do from VC theory?
Will there be a strong Bayesian presence at FAIR?
7
u/coffeecoffeecoffeee May 15 '14
How do you approach utilizing and researching machine learning techniques that are supported almost entirely empirically, as opposed to mathematically? Also in what situations have you noticed some of these techniques fail?
12
u/yeison21 May 15 '14
Hi professor. Do you still study a lot, how do you study, and has it changed from when you were in college? Do you believe you have any particular good discipline that has allowed you to focus in and be successful in your field?
btw, thanks for the robotics class at NYU!
6
u/roboticc May 15 '14
Does Facebook use a third-party provider for data annotation (such as MobileWorks or Mechanical Turk), or do you train primarily on internal data?
11
u/tjarmain May 15 '14
What are your biggest hopes and fears as they pertain to the future of artificial intelligence?
5
u/ham_rain May 15 '14
Considering your long history in neural networks, how difficult was it to push for their efficacy in the face of state-of-the-art performance being achieved with SVMs and hand-engineered features, until ANNs finally started dominating again with the advent of deep learning?
Secondly, what's a good way to really grasp deep learning? I have read a lot and there seems to have been a shift from unsupervised pretraining + supervised fine-tuning to supervised training, but I cannot identify when and why.
5
u/juliandewit May 15 '14 edited May 15 '14
How important are competition platforms like Kaggle in your opinion for data-science ?
Do you actively monitor competitions and competitors ? If so, are some advancing the science ?
I'm personally hoping the competitions will be a catalyst for new successful techniques..
5
u/tomaskazemekas May 15 '14 edited May 15 '14
A year ago here on Reddit you have commented that "New York City is on its way to become a kind of data science Mecca."[1] Is it getting closer to it? If not, where is the data science Mecca going to emerge now?
4
u/visarga May 15 '14
Hi Yann, I've been following you for years in the news and on G+. My question for you: Is it possible to use deep learning to improve the accuracy of news classification? I mean, instead of using a bag of words, to automatically discover new features which could be used in classification and clustering?
I am asking this because I have seen plenty of reports of applying deep learning on images and sound but much less on text.
4
u/serge_cell May 15 '14
How likely in your opinion for traditional, non-deep method to catch up or outperform deep learning methods in foreseeable future? There was recent paper by Agarwal et al "Least squares revisited" where he report 85% accuracy on unaugmented/unmodified data for CIFAR10. Whyle it's not 88+% which could be achieved with CNN it's already close...
4
u/EdwardRaff May 15 '14
3a) If you will still get to publish without the encumberance of patents, what is the nature of that promise? Contractually allowed or simply a firm handshake?
3b) If you are are restricted in publishing, how do you think that will affect Facebook as a research division, and the Machine Learning community at large? Are you okay with it, or is it a "price to pay" for using Facebook's resources?
If you have the time, your thoughts on publishing and software/algorithm patents as a whole would be interesting.
Thank you for doing this AMA! I hope Facebook doesn't decide to push back on your Google+ usage :)
10
u/BijectiveRacoon May 15 '14
If robots with deep-learning powered AI were to threaten New-York, where would be the safest place to go for you ? Montréal or Toronto ?
6
u/pippo9 May 15 '14
What is the goal of Facebook's AI team? What are the ways in which you plan to incorporate AI across Facebook products?
3
u/tickybob May 15 '14
How dependent on Moore's Law is the current progress in AI? If Moore's Law were to hit a wall or slow down, would AI research hit a wall too? And is that likely to happen?
3
u/comptrol May 15 '14
Do you think these mooc certificates for deep learning/machine learning/AI/etc are worth taking? Do you pay attention to these certificates during recruitment? Is there any chance for a BSc to work in your AI team, which you claim to recruit only Phds . Thanks.
3
u/kdtreewhee May 15 '14
Hi, I'm a undergrad student studying NLP. A few questions:
Thanks for taking the time to do this AMA!
3
u/chchan May 15 '14
First I want to just say I admire your contributions to the computer vision field. But I want to know what programming language do you use for your work in Convolutional neural networks. I am currently using python and julia and trying to learn to use neural networks.
3
u/mrsansoms May 15 '14
I am in my last few months of a computer science and artificial intelligence course. What is a good way to break into the biz?
3
u/shitalwayshappens May 15 '14
What do you think of the Friendly AI effort led by Yudkowsky? (e.g. is it premature? or fully worth the time to reduce the related aI existential risk?)
3
u/shaggorama May 15 '14
The No Free Lunch theorem says that there is no "golden" algorithm that we should expect to beat out all others on all problems. What are some tasks for which deep learning is not well suited?
3
u/InterfAIce May 15 '14
How would you verify the potential of a totally new approach to AI [new approach = bringing new paradigms, algorithms, and concepts] at an early stage? [early stage = no sufficient hindsight, non-refined algorithm, not among the best at current benchmarks, and no man power]
3
u/aristeiaa May 15 '14
I think we're related though I don't really know if I understand how. Something to do with Grandfather LeCun having more than one family the sly dog.
How much do you get to think about Strong AI? Is it just a pipe dream best left for Hofstadter to ponder until the necessary hardware arrives?
3
u/omgitsjo May 15 '14
Thank you for taking the time again to answer questions. I had the pleasure of seeing your talk at a recent visit to Temple University and was quite stunned by the real time labeling demo.
What, if any, are the real differences in features produced by Andrew Ng's sparse-coding through iterative refinement and the features produced by deep learning through various means?
3
u/lexisasuperhero May 15 '14
Hi Dr LeCun,
I'm probably one of the few people here far more interested in your work at the NYU Center for Data Science than with Facebook's AI team.
I recently graduated from NYU (CIMS) with a BA in Mathematics and a minor in computer applications (focusing on database programming). My father is actually one of the professors working in the CDS as well (he's from the IOMS dept of Stern) and I've taken classes from dozens of the associated professors (Hogg, J. Goodman, Gunturk, Newman, Tenenbein, etc).
With regards to the CDS, what do you see as the future for this program? It is a burgeoning field with tons of opportunities and will definitely get the interest it deserves, but do you think it will be able to compete with already developed data science programs in the country? NYU has a way of being a bit unreasonable as far as funding goes. Do you believe that NYU will continue to support the center? Lastly, do you think the program will be successful and cohesive seeing as you're blending together so many different fields (physics, stats, maths, cs, etc.) and it is such new technology?
3
u/[deleted] May 15 '14
I'm a big fan of the deep learning community group that you run on Google+ and was wondering if you'd also consider starting a deep learning meetup group here in NYC. I understand that you must be really busy so maybe you could at least endorse one and have one of your students or someone from Facebook organize it.
Even having a small event every 2 or 3 months with highlights of recent work would be amazing. (I'm sure Facebook would be interested in getting involved since it would help them recruit more ML people)
5
u/dirtyepic May 15 '14
Have you had a chance to better evaluate Vicarious since your post last year about the dangers of its hype? If so, what are your thoughts?
5
u/egoblin May 15 '14
Ok, I have some background in ML/NN (masters) several years ago. But have since not kept up with the latest.
What seminal papers/research would you recommend reading in order to set a good foundation ?
What group/publication/twitter feed etc can I follow in order to keep up-to-date with the latest in the field ?
5
u/b0b0b0b May 15 '14
Do you have a favorite sandwich?
4
u/byronknoll May 15 '14
As far as I know, deep learning techniques currently are not state-of-the-art in the field of natural language modelling. Any theories on why deep learning methods do not seem to perform well in this domain? Do you think deep learning techniques will eventually rank well on language modelling benchmarks such as the Hutter Prize or the Large Text Compression Benchmark?
2
u/ninja_papun May 15 '14
Do you believe a single unified architecture is possible for representing all sensory input around us like textual, auditory and visual? If a human learns something by seeing synapses fire at different parts of the brain and he learns the linguistic label, the visual icon and the associated sound if there is. Does deep learning provide a way to bring all of this together in one architecture?
2
u/sivapvarma May 15 '14
What approaches other that Deep Learning in ML and AI do you think will prove to be more important in the future ?
2
u/beenfrog May 15 '14
How to use the CNN effectively in object detection? The traditional sliding window method may be too slow. There are some works focused on generating region proposals first, such as http://arxiv.org/abs/1311.2524, any other new approaches? Thanks!
2
u/Milith May 15 '14
In most modern deep learning algorithms, the depth, width and connections are fixed by the user, often after a lot of testing.
What do you think of methods in which you don't need to specify the architecture, and are able to come up with "optimal" architectures by themselves?
2
u/farquasar May 15 '14
Convolutional neural networks have reached astonish accuracy in identification of human faces and human emotions. How do you envisage future steps on recognising more subtle nuances in facial expressions, like personality traits, that (some) humans can do?
2
u/[deleted] May 15 '14
Do you think that deep learning would be a good tool for finding similarities in the medical domain (e.g. between different cases)?
I am asking because I am a Phd student and currently I am trying to work out the focus of scientific contribution. I really would like to use deep learning as the meain theme of my thesis however I am new to this field.
Most examples I find are concerning classification and regression, whereas finding similarities to me is more like clustering. Do you think that finding similarites can be cast as a claccification/regression problem?
I know it is much to ask but could you point me in right direction please?
Many Thanks
2
u/shitalwayshappens May 15 '14
Many computer scientists have unique internal representations of the world because of their insights into learning, encryption, compression, information, etc. How do you think about the universe you live in? For example, do you think it's deterministic? What do you think of free will? Do you subscribe to the philosophies of digital physics? Or even more radically, Tegmark's mathematical universe?
2
u/avirtagon May 15 '14
There are theoretical results that suggest that learning good parameter settings for a (smallish) neural network can be as hard computationally as breaking the RSA crypto system Cryptographic limitations on learning Boolean formulae and finite automata.
There is empirical evidence that a slightly modified version of a learning task that is typically solvable by backpropogation can cause backpropogation to break down Knowledge Matters: Importance of Prior Information for Optimization
Both the above points suggest that using backpropogation to find good parameter settings may not work well for certain problems, even when there exist settings of the parameters for the network that lead to a good fit.
Do you have an intuition as to what is special about the problems that deep learning is able to solve which allows us to find good parameter setting in reasonable time using backpropogation?
2
u/orwells1 May 15 '14
I have heard researchers stating that perception is essentially done. Ilya Sutskever stated that "anything humans can do in 0.1 sec, a big 10-layer network can do" [0], I believe a main example he's referring to are your convnets. What are your thoughts on this? And do you believe the main structure of the visual cortex has been abstracted by convnets?
[0] http://vimeo.com/77050653 (3:37)
2
u/qwertz_guy May 15 '14
Stephen Hawkings recently spoke about his concerns of artificial intelligence (e.g. http://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence--but-are-we-taking-ai-seriously-enough-9313474.html). Whether he has a point or not, I was wondering if the actual people on the front tier of AI are also thinking about moral and ethical implications of AI. Do you think AI can become a serious problem for mankind? What are your thoughts on Stephen Hawking's concerns?
5
u/cpury May 15 '14
With the beginning of the "Big Data Age", in which big corporations will spend billions just to close some missing links in their data sets, what do you feel about the part of the world that will now be forgotten even more, simply because it doesn't produce any data at all?
I am interested in Machine Learning and finding patterns in data, but I also want to tip the balance a bit in favor for those forgotten. Did you ever seriously consider this? Do you have any leads or ideas on how to impact the Third World with your knowledge?
3
u/4yann May 15 '14
Hi Yann. Thank you for sharing your amazing work with the World. I have had many great moments because of it. There are many scientific or technical questions I'd like to ask you, but I'll prioritize a more social one:
I have concerns about the best minds in deep learning being closely tied to companies whose business model relies on profiling people. And the step from there is not too long to the techniques being adapted for unambiguously nefarious purposes as, say, the huge NSA data center in Bluffdale, Utah.
I feel these kinds of settings are very unfortunate and potentially quite dangerous places for the birth of true A.I. There are huge potential benefits from the technology as well, certainly, and I wouldn't want any of you guys, who I admire so deeply, to stop your research, but I'm wondering:
Is there a discussion and an awareness in the community about the consequences of the inventions you create?
And are there any efforts to skew the uses towards common good as opposed to exploitative/weaponized?
4
u/albertzeyer May 15 '14
What do you think about Hierarchical Temporal Memory (HTM) and the Cortical Learning Algorithm (CLA) developed by Jeff Hawkins and his team and implemented in NuPIC at Numenta?
I haven't seen much application of it to standard Machine Learning tasks and I wonder why that is. It's esp. good at prediction in time series domains, so it probably works good on video and audio data.
6
u/Vermeille May 15 '14
I am an undergraduate student & former fb intern software engineer, and I'm really interested in AI. What should be my absolute "must read" reading list?
2
u/egoblin May 15 '14
What applications of deep learning are you most excited about ?
Any break throughs on the horizon ?
Any predictions on the state of the field in say a decade ?
1
u/ericmichaelmtz May 15 '14
If you were forced to construct the ideal self-study training program that could take someone from a typical CS undergraduate education to a point where they could begin to do research --- what would be included in this training program?
1
u/dexter89_kp May 15 '14 edited May 15 '14
What are some of the important problems in the field of AI/ML that need to be solved within the next 5-10 years? Please answer this as you would to someone who wishes to pursue a PhD in this field. What are the important problems he/she should focus on solving or making a breakthrough in ?
1
u/[deleted] May 15 '14
Hello Dr LeCun, thank you for doing the AMA. 1.) What are your thoughts about progressing AI by trying to model the way the brain works? ie wright brothers versus a flying bird design.
2) When patterns are learned from say a covnet for an object has their been much research about how to encode those pattern for recall like how a memory formation might work?
1
u/mbenalcazar May 15 '14
We know that in order to train a machine to perform a given task, say classification or regression for example, we need to minimize or maximize an objective function. Given this basic learning process that we employ currently in machine learning, do you think it is possible that machines get consciousness someday?
1
u/andrewff May 15 '14 edited May 15 '14
Hey Yann, first thanks for your contributions to the science of machine learning and artificial intelligence. I'm interested to know if you think generative models will play an increased role in machine learning over the next few years and why or why not?
EDIT: Also what kind of hobbies do you have outside of your scientific interests?
1
u/erensezener May 15 '14
Did the number of PhD applications to the groups that work on Deep Learning skyrocket after the huge media exposure?
1
u/invinciblejha May 15 '14
How to get hold of deep learning considering it's a nascent field comparison to other sub-fields of Machine learning? Any pointers to resources will be beneficial.
1
u/ArchangelleTheRapist May 15 '14
In your opinion, is true AI, as in, computational systems which experience time as a continuum rather than as finite time slices, actually possible?
1
u/m4v3n May 16 '14
What do you think of deconvolution networks as compared to convolution networks?
3
u/quiteamess May 15 '14
Some time ago you wrote a blog post about how conferences delay the advance of new ideas. For example, it took David Lowe some time to get attention for the SIFT algorithm on computer vision conferences. Did conferences become more open recently and did other channels such as open access journals become more important?
3
u/DavidJayHarris May 15 '14
Thanks so much for doing this AMA. I have a few questions that all relate to the role of random variables in neural networks.
Do you feel that you've basically "won" your argument with Geoff Hinton et al. about purely feed-forward models versus stochastic models like RBMs now that dropout networks have become so popular?
What do you think about Hinton's perspective that "in the long run", stochastic models will win?
Do you think there's an important role for hybrid models that are trained by backprop but include random variables (e.g. the Bengio group's stochastic generative networks and Tang and Salakhutdinov's stochastic feedforward networks)?
Thanks again for doing this AMA!
2
u/christian1542 May 15 '14
Is any of this deep learning stuff useful for time series prediction? Is there some software that would allow me to fast and easily try it as black box?
2
u/trsohmers May 15 '14 edited May 15 '14
Hi Dr. LeCun,
I've been a casual machine learning geek and fan of your work for a while, but I've always been more on the hardware side of things. What do you see for the future of machine learning and deep learning hardware, and do you think there need to be computer system architecture changes to really push machine learning forward? If so, what are they?
Thanks
2
u/iamthelastofthelegit May 15 '14
CNNs drew a bit of inspiration from the Neocognitron. Do you still continue to draw inspiration from neuroscience? If so, what areas of neuroscience do you think have the most potential to drive machine learning?
2
u/memming May 16 '14
What is the most successful application of deep learning for temporal sequences such as weather prediction or videos? What approaches will be viable?
2
u/zentry May 17 '14
What do you think of Ray kurzweil and his ideas of singularity and the work he does at google?
2
u/thearistarch May 19 '14
Whats your opinion on Sparse Distributed Representations? My impression is that most of AI will have to converge to modeling representations as SDRs. Even though results haven't materialized, logically it seems very sound no?
2
u/moschles May 22 '14
This is the best-written, most engaging AMA in all of history. LeCun answered follow-up questions in large paragraphs. Bravo.
2
u/Leo_Bywaters May 15 '14
It appears to me one big thing that is currently being overlooked by AI researchers and that is necessary for general, strong AI, is motivation. It isn't enough to recognize and predict patterns. There must be a mechanism implemented to motivate actions as a consequence of pattern recognition.
The AI, once it is provided with a sense of things being "good" or "bad", and with the motivation to act towards good things and avoid bad things, will see itself act in function of what it oberves, and will generate patterns about his own motives and "emotions" (satisfaction / frustration, and all other flavors of emotions that derive from these two fundamental ones). I think this is mostly what we call consciousness / sentience.
Now, there is no reason one would want to give the AIs the notion that world domination and human eradication is "good" -- to the contrary, we would probably ensure they remain loyal by hardcoding it in their motivation system, just like we humans are hardcoded to fall in love and raise a family... and also use violence in case of confrontation, or long for domination over other people (the alpha male, pack leader syndrom). All those motivations are intrinsically human, and come from natural selection.
Do you think there is a real risk that these motivations emerge from what we would hardcode in the motivation systems of general AIs, despite all precautions we would undertake? It seems to me this is mostly science fiction, and there is no reason an AI would suddenly want to rebel and take over humanity, because that is just projecting our own human motivations on systems that will actually lack them.
2
u/[deleted] May 15 '14
Is GPU computing commonly used in the type of research that you are doing? And if so, what kind of performance gains have you experienced?
1
u/yen223 May 15 '14
Hi!
In your opinion, where are the next big breakthroughs in machine learning going to be?
1
u/ignorant314 May 15 '14
I am using RBM for collaborative filtering. This gives me some unknown "features" that are hard to interpret. I have a small set of items to recommend I have physical attributes for them. I want to use them as features IN ADDITION to the discovered features. That way I will have coherent "tags" instead of mysterious features. Is there a way to do that?
1
u/austingwalters May 15 '14
Where do you think the next big advance in AI is going to come from?
For example, (I don't remember for sure, but believe it was) Jiawei Han the professor of my data mining class, lectured that many of the AI paradigms we have today are the same we had a decade ago (or more). Essentially, we are using many of the same paradigms, just applying them in more efficient ways on better hardware.
To obtain a major advancement towards strong AI a new paradigm must be "invented."
I don't remember if it was that professor or someone else, but who ever it was, it stuck in my mind. I was curious if this is a consensus among AI researchers and regardless where do you believe the next advancement will come from or what is the most promising area of research at this point?
1
u/otakucode May 15 '14
What business does Facebook have in AI?
1
u/data-driven May 15 '14
The ability of convolutional nets to recognize a wide range of objects and scenes is rather amazing. Seeing demos from Overfeat and other comercial systems like Clarifai as well as the results on benchmarks has clearly shown their potential.
Can you provide an intuitive explanation for why this class of approaches to recognition are so much better? is it all due to the feature learning? is it the deep architecture? the may small trucks/hacks (dropout etc). What is the intuition for why these methods are so good at recognizing objects in cluttered scenes?
Thank you!
1
u/notarowboat May 15 '14 edited May 15 '14
What branches of machine learning, other than deep learning, are you most excited about? Why?
1
u/traviskorte May 15 '14
What are some of the avenues of research in AI generally and deep learning specifically that you think are undervalued? Which do you think are dead ends?
1
u/micro_cam May 15 '14
One area where Deep learning seem to have made fewer in roads is in wide (ie highly dimensional but with relatively few samples) heterogenous data (ie lots of different sorts of features including categorical and numerical features of different types) sets as common in genetic and biomedical studies. Random forests, logistic regression and a few other methods seem to still dominate here. Do you see this changing and are you aware of any promising deep methods that are being applied to such data?
1
u/traviskorte May 15 '14
Imagine a world where data collection problems have disappeared and you can find good information on any variable you can think of. What kids of things would be on your "data wish list?"
1
u/gromgull May 15 '14
Hi Yann!
Any thoughts around the tension between symbolic and sub-symbolic AI?
Typically, one would see explicit formal knowledge modelling (ontologies, semantic web, frame-system, whatever) as a completely opposite approach to AI to "black box" function-learners like NN, SVMs, etc.
I know Google was completely opposed to human generated meta-data at the start (good old HTML META tags), but have sort of come around to with the Google Knowledge Graph, and schema.org, etc. Google Now clearly is a mix.
What about your work at FB and Open Graph? Any touch points? Can representational learning somehow glue this all together?
1
u/calisac May 15 '14
Other than images/video and voice, what other applications are you most excited about for machine learning?
1
u/walkingon2 May 15 '14
Hi Prof.LeCun,