In Artificial Intelligence Competition, Two Bots Pass for Human

By Ashley P. Taylor | October 1, 2012 3:21 pm

video game

In the 2012 Bot Prize competition, the true winner may be the one who makes the most mistakes. In this match, video game avatars directed by artificial intelligence compete to see which comes across as most human in a fight against real human players. This year, for the first time, human participants mistook the two bots for humans more than half the time, a feat researchers attribute to the fact that these bots were programmed to be less-than-perfect players.

During the game, the aptly named “Unreal Tournament 2004,” players, of course, try to kill each other, but they also categorize each character they meet as either bot or human. As they move through their virtual world, they use what’s called a judgment gun to tag the figures they encounter, and these scores, or humanness ratings, determine the winners of the competition. Since the competition started, in 2008, the goal for the programmers entering their artificial intelligences in the game has always been to achieve a robot that was mistaken for a human half the time. This time, two bots achieved it, with humanness ratings of 52 percent. Furthermore, the human players had 40 percent humanness ratings, meaning that 60 percent of the time, human players thought other human players were robots.

The key to designing a convincing bot, researchers think, is to make sure it’s not too perfect. An avatar directed by a human would not have perfect aim, something a computer could easily achieve, explained Jacob Schrum, a doctoral student from the University of Texas who collaborated on one of the winning bots, in a press release.  Instead, a good bot would shoot worse at long distances and make illogical decisions about which characters to pursue.

Maybe now the focus will be on teaching humans to act less robotic.

Video game photo via Jacob Schrum

  • Chris

    Just have the computer shout “Leeroy Jenkins!” and run into battle.

  • Jack

    I like to be a player that is mistaken for a bot the most.

  • Jordan

    Doesn’t this study really just say that the study itself is pointless? If people cannot tell that the humans are humans then they obviously cannot tell if robots are humans. I understand the numbers sound cool that the robots appeared more human than humans but there really is no such thing. To me it sounds like they prove their experiment sucks.

  • Jeff Smith

    @ Jordan: It’s even worse than that: humans can’t tell both are just collections of pixels. :-)

  • http://n/a m

    Agreed Jordan.
    The experiment proves itself to be flawed when assessing what is human.

    Also why do you want a robot to be human, what the hell do you want with a machine that breaks down after 60 years, cant remember where he had the last beer, and couldnt solve an equation in milliseconds.


Discover's Newsletter

Sign up to get the latest science news delivered weekly right to your inbox!


80beats is DISCOVER's news aggregator, weaving together the choicest tidbits from the best articles covering the day's most compelling topics.

See More

Collapse bottom bar