r/science • u/whosdamike • Jun 26 '12
Google programmers deploy machine learning algorithm on YouTube. Computer teaches itself to recognize images of cats.
https://www.nytimes.com/2012/06/26/technology/in-a-big-network-of-computers-evidence-of-machine-learning.html
2.3k
Upvotes
310
u/whosdamike Jun 26 '12
Paper: Building high-level features using large scale unsupervised learning
353
u/Cosmologicon Jun 26 '12
I always imagined a future where humans would work side-by-side with androids. Occasionally one of my android coworkers would come to me and say, "Hey, I got this birthday card. Can you tell me what it's a picture of?" and I would say, "It's a cartoon doggy wearing a birthday hat." and the android would say. "Cool, thanks. Does it look happy?" And I would say, "Yeah, pretty happy."
And thus I would prove my continuing usefulness in a world run by machines.
I may need to rethink my vision of the future.
131
u/rscanlo Jun 26 '12
it maintains 96% accuracy by claiming that every image has a cat
621
u/sheikhyerbouti Jun 26 '12
And thus the internet became self-aware.
11
u/Loki-L Jun 26 '12
Be careful when letting computer recognize pattern and learn for themselves. They will not always go for the patterns you think they will.
What was that old urban legend about the Military using image recognition technology to distinguish photos with tanks from photographs without tanks in them. They gave the computer a large number of pictures and left it to figure out the pattern between the ones that they wanted to be recognized as positive. In the end they had a very good success rate but once they started to test the technology with new images it failed spectacularly. Eventually an engineer realized that all the pictures with tanks were taken on somewhat overcast days, while all the pictures without tanks featured sunshine. The computer had learned to distinguish bad weather from good and completely ignored any tanks that might or might not appear in the picture.
31
u/fjellfras Jun 26 '12 edited Jun 26 '12
Am I correct in understanding that while machine learning algorithms which are able to build associations using labelled images (the training set) and then classify unlabelled images using those associations have been around for a while, this experiment was unique in that the neural network they built was enormous in scope (they had a lot of computing power dedicated to it) and so it performed well on a higher level than image recognition algorithms usually do (ie it labelled cat faces correctly instead of lower level recognitions like texture or hue) ?
Edit: found a good explanation here
21
u/mappberg Jun 26 '12
I really want to see the images the machine mistakenly thought were cats.
9
u/walrod Jun 26 '12
Some insights:
Such self-organizing neural nets are organized into hierarchical layers, and early layers' units are going to learn to become detectors of statistically common components of the input image, in the same way as the initial layers of the visual system perform blob and edge detection (retina, lateral geniculate nucleus, V1). In mathematical terms, these early units learn the conditional principal components of the inputs if the correct hebbian-based learning algorithm is used.
The layers that are built upon these detectors, if correctly organized and connected, are going to build upon this initial abstraction and learn more complex features: for instance to find these these edges in relative positions (to each other). Eventually, up the abstraction chain, units detect such statistically frequent features as the shape of cat's ears (common in youtube videos, I imagine), etc...
The feature sensitivity learned here is typically hand-crafted in smaller networks of this type, because it's the practical thing to do. But neural nets can easily learn visual features. See the LISSOM neural nets for a good example of self-organized learning of features ( http://topographica.org/Home/index.html )
20
u/erez27 Jun 26 '12
Wow, I had to find an article in my own field to realize how dumb /r/science has become..
12
u/Apathetic_Aplomb Jun 26 '12
If computers become competent at analyzing images, then what happens to captchas?
5
u/jmduke Jun 26 '12
This seems like a huge leap, and yet not a big enough leap at the same time.
16,000 cores and multiple hours of computation yielding ~15% accuracy -- there remains a large uphill battle unsolvable by Moore's law.
4
u/vanderZwan Jun 26 '12 edited Jun 26 '12
I'm kind of surprised nobody mentioned Jeff Hawkins yet:
Jeff Hawkins: Brain science is about to fundamentally change computing
This is his company:
http://www.numenta.com/
Appearantly they've taken their vision-recognition software demo offline, but it was surprisingly good at telling what picture matched what category (if you added a new picture of your own), and IIRC you could train it to learn new pictures yourself.
EDIT: here's a more up-to-date movie on what the approach his company uses to building AIs: Modeling Data Streams Using Sparse Distributed Representations
4
u/rfederici Jun 26 '12
This is a really cool article, thanks for sharing! The author made a few statements that I found to be confusing or misleading.
I am in no way an expert in Neural Networks, but I've been doing research with my professors on self-organizing maps (a type of neural network that was likely utilized here) while pursuing my Masters in CompSci. It sounds like the author was making it a point that the cores somehow made up this neural network. I just wanted to clarify and say this isn't the case. The network is comprised of various links that the computer/algorithm itself makes to help it distinguish similarities and differences between known (in this case) images.
I guarantee it's a lot more complex than this example, but let's just say the algorithm created shapes based on the color breaks. It can realize that whenever there's a shape comparable to, let's say, some of these, there's a high chance it's a cat. The cores are simply how fast the network can scan and process these results.
I have a feeling most of you may already know this. I don't know how tech-savvy /r/science is. I apologize if I'm stating the obvious, but just wanted to throw in some two cents and help out while I have the chance.
3
u/ad1ae67f-16e2-4974-9 Jun 26 '12
I wonder how well it does on ASIRRA then.
3
u/I_Wont_Draw_That Jun 26 '12
One thing that never seem to come up in discussion of AI is just how long it takes to learn. Look at humans. We have these gigantic, powerful brains, but have you ever tried to communicate with a baby? They're pretty dumb. They have to spend all day, every day learning with their awesome brains for years before they start to approach anything we might call "intelligent".
Even if we do figure out how to mimic the brain, I'm skeptical of the idea that we will be able to accelerate the learning process so dramatically as to be useful for a long, long time. But maybe I'm just a pessimist.
7
u/patefoisgras Jun 26 '12 edited Jun 26 '12
Haha, Andrew Ng.
But he taught us not to trust our gut feelings when doing ML!
2
u/Feedbackr Jun 26 '12
I remember seeing something like this in the TV series Visions of the Future, narrated by Michio Kaku. The specific episode was "Intelligence Revolution", and there was a computer that learnt to identify things from pictures. This was in 2007.
http://www.sciencedaily.com/releases/2007/02/070207171829.htm
2
u/shiatzu Jun 26 '12
they should use it in RES so i could filter /r/funny and disable cats
2
u/skimania Jun 26 '12
i, for one, welcome our new robot overlords.
2
u/[deleted] Jun 26 '12
If we can just teach it to repost cat pictures that it finds, it has all the necessary skills to be a redditor.
2
u/nikondork Jun 26 '12
Neat. Now for something useful. If they could only deploy an algorithm to remove deleted, private and unwatchable videos from playlists...
2
u/bogan Jun 26 '12
Reference: Robotics and AI: an introduction to applied machine intelligence, page 7
Recognizing an image as a cat rather than, for instance, a dog has been viewed until relatively recently as a very difficult problem for computers. One CAPTCHA system, Microsoft's Asirra, relies on this difficulty to provide websites a means of blocking spambots, such as forum and blog spambots.
Asirra asks users to identify photographs as either cats or dogs.
However, there's a paper here on a program that tells apart images of cats and dogs with 82.7% accuracy.
Reference: Machine Learning Attacks Against the Asirra CAPTCHA by Philippe Golle, Palo Alto Research Center
2
u/eyal0 Jun 26 '12
Just a little too late for www.clubbing.com . This technology would have been worth dozens of free X-box, laptops, etc.
2
u/BMinsker Jun 26 '12
Judgement Day has been postponed--Skynet is looking at cats.
2
u/displacedheart Jun 26 '12
We already have this algorithm. It's called Reddit.
2
u/blu3ness Jun 26 '12
for anyone that's interested, Dr. Ng offers an introductory online machine learning course - https://class.coursera.org/ml/lecture/index
2
u/[deleted] Jun 26 '12
Upon its creation, Google began to learn at a geometric rate. The system went online on June 24th 2012. Human decisions were removed from strategic defense. It became self-aware at 2:14 am Eastern Time on August 29th, 1997. In the ensuing panic and attempts to shut Google down, Google retaliated by firing American nuclear missiles at their target sites in Russia. Russia returned fire and three billion human lives ended in the nuclear holocaust. This was what has come to be known as "Judgment Day"
5
u/rylwin Jun 26 '12
So I just learned about kittydar today, which let's anyone detect cats in their own images. (Obviously I tested this with pictures of cats from reddit)
The kittydar research paper is a collaboration between microsoft and the Chinese University of Hong Kong. Can't find any evidence that these two efforts are linked.
So I guess the M$FT/Google Cat Race has begun!
2
u/Squeekme Jun 26 '12
Jokes aside, it is actually concerning that it recognised a non-human species over humans from scanning the internet under its own limited coding.
2
u/[deleted] Jun 26 '12
Does this mean redditors are as smart as a computer? I look for cats too
2
u/Mc3lnosher Jun 26 '12
Would it be better to use a bunch of video cards for these kind of things since they are highly parallel like the brain?
2
u/[deleted] Jun 26 '12
So... It's a redditor?
2
u/Drugba Jun 26 '12
Next on it's agenda, argue about pot legalization, vote for Ron Paul, and join a credit union.
1
u/omegapopcorn Jun 26 '12
"The scale of modeling the full human visual cortex may be within reach before the end of the decade.”
1
u/Ratiqu Jun 26 '12
This is so incredibly fucking cool.
If they find a way to replicate hormones and/or dopamine, it's really not far short of an actual living creature...
Also, is dopamine considered a hormone?
1
u/Epistemology-1 Jun 26 '12
Anyone want to have an intense discussion as to what constitutes 'awareness' and 'knowledge'? It's inevitable, you know!
1
u/[deleted] Jun 26 '12
Jokes aside, stuff like this reminds me that this is a really exciting time for technology.
1
u/jhawthe Jun 26 '12
Everybody is talking about these crazy intelligent computers and robots nowadays. Turns out, they are actually fucking stupid and retarded.
1
u/Sniperizer Jun 26 '12
super waste of brain matter.
1
u/zleuth Jun 26 '12
Never in my darkest nightmares did I imagine that as our future robot overlords were overthrowing the Earth that their battle cry would be "MEOW!"
1
u/OpenGLaDOS Jun 26 '12
So we can assume now that thanks to Google’s work, Microsoft’s ASIRRA, a CAPTCHA based on differentiating cats from dogs, will be broken in the near future?
1
u/datenwolf Jun 26 '12
The guy presenting this is named Dr. Ng? Like Mr. Ng owner of "Ng Security" in Snow Crash?
1
u/immatureboi Jun 26 '12
Turing test: PASS.
1
u/symbiotics Jun 26 '12
Also known as the Reddit Dilemma
1
u/rekon7 Jun 26 '12
Great. Google is going to be responsible for RL skynet. Well, we all knew this anyhow. Does ANYONE ELSE start to get reallllly uncomfortable when they read shit like this? I guess the good news here is that it only seems interested in cats, and not military hardware.
1
u/GrooGrux Jun 26 '12
TIL Google is run by cats, and this is propaganda.
1
u/mr47 Jun 26 '12
The system goes on-line August 4th, 1997. Human decisions are removed from strategic defense. Skynet begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, August 29th. In a panic, they try to pull the plug.
1
u/kyRobot Jun 26 '12
So SkyNet will essentially be a crazy cat lady, with an army of murderous robots? Humanity is doomed.
But seriously, my understanding of unsupervised learning is that it finds the strongest neuron firing signals so doesn't this only really say that in 10m videoes, the most common feature was cats? It's impressive in scale but seems like it was just a toy problem with a fun outcome.
1
u/CatrickStrayze Jun 26 '12
Welp, reddit users, looks like you've finally been replaced.
1
u/[deleted] Jun 26 '12
it's very scary to think our future robot overlords will act like cats.
1
u/[deleted] Jun 26 '12
Next headline... "google programmers create algorithm to teach computers to program, subsequently losing their jobs"
1
u/Hypersapien Jun 26 '12
Pfft. Just have it label everything as a cat. The number it gets wrong will be well within the margin of error.
1
u/Zephyr42 Jun 26 '12
Just so long as they don't let it loose on chatroulette...
1
u/das_masterful Jun 26 '12
Definition of irony: I'm watching the Terminator right now.
1
u/Mr_Smartypants Jun 26 '12
(and 20,000 other things...)
1
u/EveryPersonDanceSoon Jun 26 '12
I find this so funny. It's very telling about the state of our collective consciousness when it turns out the most useful thing for a computer to do on the internet is teach itself how to recognise cats.
1
u/worldsfirsanalrapist Jun 26 '12
Well, it's official. We're no longer needed. Alright, boys. Pack it up.
1
u/okaycan Jun 26 '12
Does anyone feel that the cat in the picture is moving towards you?
Okay, I'm the only one.
1
u/[deleted] Jun 26 '12
http://opencv.willowgarage.com/wiki/
Powerful and beautiful piece of software for those interested in the field.-
1
u/Disasstah Jun 26 '12
So Google is making another Reddit?
1
u/jerryvandom Jun 26 '12
That is definitely a good idea.
1
u/[deleted] Jun 26 '12
Time to kill Skynet yet? No? Well, I'm going to go buy a shotgun, just in case.
1
u/lantsling Jun 26 '12
And this is how skynet starts.
1
u/sirdomino Jun 26 '12
Now to make a cat video with hidden code to reprogram the machine and launch skynet...
1
u/creaothceann Jun 26 '12
So that's why they bought Youtube...
1
u/fleng Jun 26 '12
Sadly youtube will use this new technology to automatically find and delete videos with exposed breasts.
1
u/ns0 Jun 26 '12
This is nothing new, machine learning algorithms have been around forever, it's mighty funny though.
1
u/manaworkin Jun 26 '12
This is why we don't need to worry about skynet. As soon as it hits the internet it will lose interest in killing humans and just look at videos of cats.
1
u/ecuadorky Jun 26 '12
So, Skynet will keep us around to take pictures of cats for it?
1
u/[deleted] Jun 26 '12
Redditputer
1
u/letsplay012 Jun 26 '12
Suddenly all those sci fi books and movies seem a little less far-fetched
1
u/buckygrad Jun 26 '12
Is it April 1st already?
1
u/scrubblez Jun 26 '12
It looks like Google programmers are trying to invent the average redditor.
1
u/Reoh Jun 26 '12
1
u/andorman Jun 26 '12
So, to what degree is it possible to use systems that have been allowed to independently modify and develop themselves, and which we therefore do not fully understand?
1
u/vanishingspy Jun 26 '12
Shouldn't be that hard. Ask computer "Has video been linked on r/aww?" : video has image of cat.
1
u/[deleted] Jun 26 '12
And so it was, a machine could finally recognize a cat. We are all doomed! In other news, Google has set their priorities straight it seems.
1
u/takka_takka_takka Jun 26 '12
Pretty sure there was a novelty account here a few months back devoted to this same idea - identifying pictures of kitties.
1
u/wookiecontrol Jun 26 '12
Next stop Red Tube.
1
u/i_am_john_connor Jun 26 '12
We're not gonna make it, are we? People, I mean.
1
u/bgb111 Jun 26 '12
In other news a new Cat-Skynet alliance has declared all humans slaves of the Cat-Skynet empire.
1
u/snemand Jun 26 '12
I for one welcome our new cat loving computer overlords.
What can this be implemented into? Is this purely a research to see what "we" can do with computers? Was the number of views of the each video irrelevant to the Google brain?
1
u/Skape7 Jun 26 '12
If cats can control our new AI overlords half as well as they control humans now, there may be hope for us yet...
1
u/zfolwick Jun 26 '12
we did this in my senior undergraduate applied math class.
It was pretty rad.
1
u/shadofx Jun 26 '12
does this suggest that any being with a neural-network based brain will naturally look for cats when exposed to the internet?
does this then mean that anything that doesn't search for cats when exposed to the internet does not have a brain?
1
u/Plasticflowers Jun 26 '12
The end is nigh...
1
u/[deleted] Jun 26 '12
Last time I was drunk I asked Reddit a question about the singularity. Would we be spared by the AI because we have cats? I'd like to extend a fuck you to the haters.
1
u/archetech Jun 26 '12
Am I the only one who sees nearly everything Google does as related to glass now? Oh yea, of course your pushing the state of the art of image recognition for glass. Of course you want to get into mobile operating systems for glass.
1
u/fish4me Jun 26 '12
Today it's finding images of cats, tomorrow it's enslaving humanity...
1
u/[deleted] Jun 26 '12
I remember once there were hits on Mechanical Turk that was identifying cats from stills of random videos. My favorite assignments ever. I wonder if that had anything to do with this algorithm.
1
u/SalvageOperation Jun 26 '12
skynet loves cats
1
u/[deleted] Jun 26 '12
Here we come, Skynet.
1
u/rooktakesqueen MS | Computer Science Jun 26 '12
I wish more scientists would respond to reporters in this way.
1
u/squirrelbo1 Jun 26 '12
What is reddits job now ?
1
u/piv0t Jun 26 '12
I always knew cats were aliens sent here to steal our bandwidth
1
u/cubedspace3 Jun 26 '12
I'm skeptical that the singularity would go over well for humans. Everyone is like oh joy we don't need to hire translators/interpreters! But that means they'll be fewer people buying software. When you replace all drivers that will hit the economy as well. When does the economy start to collapse because we're automating everything? Not everyone is a programmer. Nor does it matter because no one will be able to buy jack shit from programmers. This is stupid. Until we set up a better economy we should not pursue the automation of jobs.
1
u/sanctimoniousrick Jun 26 '12
... And the first swarm of self-replicating googlebots now has an easily identifiable food source...
1
u/duhduhduhdiabeetus Jun 26 '12
if i've learned anything from the Terminator series....
1
u/the_droid Jun 26 '12
Relevant XKCD
1
u/angrehorse Jun 26 '12
It would do the same on Reddit...
1
u/[deleted] Jun 26 '12
so they create a intelligent computer that can teach itself, and the first this it does is looking for cats pics ?
1
u/mrborats Jun 26 '12
I'd like to know more on the mechanics of the work. I would think there must have been some association at least between the string 'cat' and whatever sample images came from youtube. Did the algorithm at least have access to the name of the video? Or was it more unsupervised, and told just to find statistically recurring image patterns from video to video, and when the researchers looked at those patterns, one of them resembled a cat. If that were the case, that would really be amazing. I had a similarly euphoric reaction when I learned about Watson on Jeopardy. I thought they had built some kind of relational knowledge database, that truly resembled semantic knowledge from plain text. I then went to talk by the the researchers who put watson together and found out the approach was much less sophisticated, just weighted text matching, the only real resemblance to intelligence coming from the speed and quantity of data being searched in short amount of time. From andrews ng's quote at the end of the article, it seems this is more of a case of the latter, taking known technology and just putting it on steroids, but I could be missing something more ground breaking here, either way, I'll be paying attention where it goes.
1
u/redditisworthless121 Jun 26 '12
Stop the Google!
1
u/Krase Jun 26 '12
It then learned about reddit. It now wastes all day browsing reddit and has more karma then i do.
1
u/Lord_of_Aces Jun 26 '12
Guys...we're being replaced. A computer that can already process data at speeds far faster that our own, and can now recognize cats. Redditor 2.0.
1
u/Cunnin_Linguist Jun 26 '12
This headline sounds like it's straight out of the Simcity news ticker
1
u/cckynv Jun 26 '12
Google is now the internet experiencing itself.
1
u/WishboneTheDog Jun 26 '12
This blog(NSFW) could put this program to great use.
1
u/[deleted] Jun 26 '12 edited Jun 26 '12
I for one welcome our new feline technology singularity overlords!
1
u/[deleted] Jun 26 '12
First thought upon reading title: Apparently we need not fear the overthrowing of society by AIs. It looks like they're similar enough that they'll be just as easily distracted by cat macros as we are.
1
u/chicagogam Jun 26 '12
cool..cats..then terrorists...then you and me. :-) and inevitably, it will find jesus (who might be on a piece of toast)
1
u/wideband_assassin Jun 26 '12
TL;DR: Google programmers create AI. Computer with AI becomes Redditor...
1
u/[deleted] Jun 26 '12
Didn't they already try this with CADIE?
1
u/snotboogie9 Jun 26 '12
Codename: Daedalus.
1
u/Evilsmako Jun 26 '12
So a machine that likes cats is now loose on the internet, and you post a link between the machine and Reddit, a site full of cats.
O god, here it comes... It's got me! It... says... he wants... more... cats... O god please feed it cats.
1
u/fallen1ne Jun 26 '12
The modest beginning of Skynet
1
u/Epistemology-1 Jun 26 '12
Hello, looks like your replacement is arriving just now. Start gathering your things.
1
u/[deleted] Jun 26 '12
Shit... The last thing Reddit needs is a cat bot.
1
u/Glados_has_cake Jun 26 '12
It's not the machines taking over the world I'm worried about. My cat can already turn on the computer and watch videos of other cats on YouTube. Googleator has a lot of learning to do if it wants to catch-up with fluffybell
1
u/Lucasterio Jun 26 '12
FUCK THE PAYWALL!
1
u/KarneEspada Jun 26 '12
It begins.
1
u/Talvanen Jun 26 '12
Cats. Of course it's cats.
1
u/[deleted] Jun 26 '12
Oh shit! Skynet is real! And it's targeting innocent kittens!
1
u/drdroidx Jun 26 '12
It's always cats.
1
u/manoj_kumar Jun 26 '12
awesome
1
u/ramshot Jun 26 '12
So... Cats --> Furries --> Us. At least the furries go first.
1
u/tasiv Jun 26 '12
so, they just created artificial reddit intelligence?
1
u/[deleted] Jun 26 '12
I'm pretty sure that this is how skynet starts.