Computers Take the Turing Test for Artificial Intelligence, But Fall Short

80beats
By Eliza Strickland
Oct 13, 2008 7:04 PMNov 5, 2019 9:01 PM

Newsletter

Sign up for our email newsletter for the latest science news
 

Five sophisticated computer programs chatted with human examiners this weekend and tried to convince the judges that they were conversing with another human being, vying to be the first to pass the Turing Test for artificial intelligence. Although none of the programs achieved their goal of duping 30 percent of the judges, several came quite close to that threshold and all fooled at least one judge. Said organizer Kevin Warwick:

"...although the machines aren't yet good enough to fool all of the people all of the time, they are certainly at the stage of fooling some of the people some of the time" [Telegraph].

The contest draws on the ideas of British mathematician Alan Turing, who came up with a subjective but simple rule for determining whether machines were capable of thought. Writing in 1950, Turing argued that conversation was proof of intelligence. If a computer talked like a human, then for all practical purposes it thought like a human too [AP].

Since 1991, an annual competition has been conducted in which judges chat simultaneously with computer programs and their "confederate" humans, and try to determine which is which. One judge, Will Pavia, explained that he was fooled by a program that made use of humor and had a fully developed biography: the chatbot claimed to be a teenage boy named Eugene Goostman who loved the novels of Kurt Vonnegut. Later, Pavia said,

I was introduced to the charming Ukranian computer program that had fooled me, the creation of Vladimir Veselov, 39, a bio-scientist from St Petersburg. I saw the vast database it accessed: there was the file on Vonnegut, there a list of plausible responses on the subject of Eminem [The Times].

While none of the programs qualified for the gold or silver prizes (which have never been awarded), a program called Elbot took home the bronze for fooling the most judges; it tricked three out of the 12 examiners. But the program's inventor, Fred Roberts, said he didn't believe that conversational ability is a true mark of artificial intelligence, as Turing claimed.

"I don't think it's anything like thought," he said of Elbot's conversational prowess. "If you know a magic trick, you know how it's done, it's not magic anymore" [AP].

However, organizer Kevin Warwick says that even if these chatty computers aren't developing a truly human intelligence, they are rapidly becoming good enough at their specialized functions to fill new roles in society.

"This demonstrates how close machines are getting to reaching the milestone of communicating with us in a way in which we are comfortable. That eventual day will herald a new phase in our relationship with machines, bringing closer the time in which robots start to play an active role in our daily lives" [BBC News],

he said. Related Content: 80beats: Computers Exploit Human Brainpower to Decipher Faded Texts DISCOVER: The Next Jump in Artificial Intelligence

Image: flickr/N1NJ4

1 free article left
Want More? Get unlimited access for as low as $1.99/month

Already a subscriber?

Register or Log In

1 free articleSubscribe
Discover Magazine Logo
Want more?

Keep reading for as low as $1.99!

Subscribe

Already a subscriber?

Register or Log In

More From Discover
Recommendations From Our Store
Stay Curious
Join
Our List

Sign up for our weekly science updates.

 
Subscribe
To The Magazine

Save up to 40% off the cover price when you subscribe to Discover magazine.

Copyright © 2024 Kalmbach Media Co.