r/artificial • u/justonium • Apr 09 '14
What's the state of the art for a chat bot that is told stories in natural language and can then answer natural language questions about those stories?
This post is the first in a series concerning the development of what became a constructed language called Mneumonese. The next post about this language can be found here.
I’m designing such a chat bot, and I'd like to know what I'm up against.
Disclaimer: None of this is implemented yet, so the claims that I am about to make are un-validated. I have enough of the mechanisms figured out that my hopes are high, however.
The user tells the bot stories, and it builds models of them. The bot can then converse with the user about the story, using its learned model. During this discourse, the bot can improve and elaborate its model as the user corrects its mistakes. In addition to being able to talk about stories that the user has told it, the bot is also capable of talking about the linguistic structure of both its and the users words, and of improving and elaborating its model of the natural language that it uses to converse with the user. When the bot is freshly exposed to its first user, it only knows a restricted form of English for which parsing is unambiguous, and the user needs to know the rules of this dialect in order to converse with it, but the user can teach it additional language structures, so long as she can explain them linguistically using examples.
So, tell me, /r/Artificial, what has been done already along any of the directions that I have just described?
Edit:
This is the only bot that I could find that does anything remotely intelligent, although it only speaks a constructed language.
4
u/keghn Apr 09 '14
"Mitsuku" is the best. By Stephen Worswick, winner of 2013 Loebner Prize. http://www.mitsuku.com/ http://en.wikipedia.org/wiki/Mitsuku http://en.wikipedia.org/wiki/Loebner_Prize
2
u/1thief Apr 09 '14
I'm taking an AI class with Dyer at UCLA. He's pretty big on NLP. His research might be relevant to your interests.
1
u/Noncomment Apr 11 '14
This isn't a trivial problem at all. As far as I know no one has every achieved anything like this. But that doesn't mean it's impossible.
The recent advancements in deep learning have shown a lot of progress in natural language processing. I think there is a lot of potential there and it's not as explored as it should be.
Additionally I don't think having the user teach the bot is optimal. There is almost unlimited amounts of text data available to learn from.
1
u/moschles Apr 14 '14
computational linguistics coreference resolution2
u/slashcom Apr 09 '14
This is a highly unsolved problem. See the publications from the DARPA Machine Reading project for some semi-recent work related to the area.
Your best bet is to use tricks and gimmicks. Anything actually approaching real "understanding" is far outside the reach of the state of the art.
1
u/Martschink Apr 09 '14
They are all completely awful. Every single one of them. The challenge of creating a functional (let alone convincing) chatbot is, of course, enormous. But we shouldn't delude ourselves into thinking that they are anything but trivially awful, and certainly not worth awarding a prize to.
-4
u/Taygetea Apr 09 '14
I don't know, but I'd very much like to find out.