The scores (and the facial expressions of the beleaguered humans) say it all: Last night on Jeopardy, IBM’s Watson supercomputer completed its dominating victory over former champs Ken Jennings and Brad Rutter. The carbon-based life forms managed a few correct answers during the final game of the three-day match, but not nearly enough to overcome Watson’s smarts and speed.
Facing certain defeat at the hands of a room-size IBM computer on Wednesday evening, Ken Jennings, famous for winning 74 games in a row on the TV quiz show, acknowledged the obvious. “I, for one, welcome our new computer overlords,” he wrote on his video screen. [The New York Times]
Jennings, who spent much of the three-day extravaganza grimacing with frustration at not being able to buzz in ahead of Watson, wrote up his experiences for Slate today. Once the machine acquired the human skill of parsing Jeopardy questions, he writes, there was really no stopping it. If Watson knew the correct response, it was going to ring in first.
Perhaps even a supercomputer needs a little time to get loosened during a big performance. After an admirable but not perfect round of Jeopardy on Monday in which it finished tied for the lead, IBM‘s Watson computer crushed human champions Ken Jennings and Brad Rutter on Tuesday’s episode and takes a huge lead into the final episode tonight.
Last night’s play began with Watson and Rutter at $5,000 apiece, with Jennings trailing at $2,000. After Watson’s dominance, last night’s show ended with the machine having tallied $35,734 to $10,400 for Rutter and $4,800 for Jennings.
Watson elegantly saw off the puny humans with responses on the likes of Franz Liszt, dengue fever, violin, Rachmaninoff and albinism. Even host Alex Trebek seemed spent: with Watson wanting to wage the extremely specific amount of $6,435 on a Daily Double, the laconic Trebek simply replied, “I won’t ask” (naturally, Watson was spot on here too). [TIME]
Though Watson steamrolled the best competition humanity could provide, its foibles are as telling as its dominance—especially when the seemingly unstoppable machine makes mistakes that would be laughable from a human contestant.
Watson’s one notable error came right at the end, when it was asked to name the city that features two airports with names relating to World War II. Jennings and Rutter bet almost all their money on Chicago, which was the correct answer. Watson went for Toronto. Even so, the error showed another side to Watson’s intelligence: knowing that it was unsure about the answer, the machine wagered less than $1000 on its answer. [New Scientist]
NOTE: Before tonight’s big match begins, check out our feature, “Who’s Smarter, a Human or a Computer? Round 9: Jeopardy,” on the other human games that AI programmers have tried to perfect—and the ones where humans maintain the advantage.
I can already hear the Jeopardy theme music (which isn’t my ringtone, I swear!). Tonight, one of the highest-profile man versus machine contests in years begins, as Jeopardy will air the matches pitting former flesh-and-blood champions Ken Jennings and Brad Rutter against Watson, the question-and-answer supercomputer by IBM.
Since traveling to IBM’s research center for the practice/demonstration match (which Watson led when play stopped after 15 clues), we here at DISCOVER have been simultaneously excited for the match and anxious about the prospects for our species’ chosen representatives to come out on top. Jennings apparently feels the same way:
Live, from IBM’s Thomas J. Watson Research Center: This is Jeopardy!
Today, IBM rolled out its Jeopardy-playing computer, a whiz machine named Watson that was four years in the works. In today’s demonstration match for the media Watson played against Brad Rutter and Ken Jennings, the two great (human) Jeopardy champions who will provide opposition for Watson in a two-day exhibition match. That man versus machine faceoff will air in February, and carries a prize of a million dollars. Bad news, humans: In today’s exhibition of about 15 questions, Watson tallied $4,400, compared to $3,400 for Jennings and $1,200 Rutter.
On stage, Watson was represented by a screen displaying its avatar (pictured) behind a podium, where a human player’s torso would be. Its avatar is a mobile graphic of the Earth with aurora-like lines swirling around it. When Watson was confident in its answer those swirls were shaded green; when it wasn’t they turned an orange hue. The questions were fed in plain text to Watson, but it had to wait the same amount of time to ring in as the human players did. To make the game fair, it also had to trigger a mechanical signaling button. Watson spoke in a stilted computerized voice–and was almost never wrong.
The machine started off on a roll in the category “Chicks Dig Me,” about women and archaeology. Jehrico. Agatha Christie. Mary Leakey. Crete. Watson fired off the answers so quickly it looked like it might blow its puny human competition off the stage. Fortunately for our species pride, Ken and Brad recovered with some right answers of their own.
Is the human brain in final jeopardy?
Last April IBM announced its newest plan to crush humans in the gaming sphere: After taking us to task at chess, it would conquer us at “Jeopardy!” Since then the game show-playing robot, Watson, has been in development (cue 80′s training montage featuring computer programmers). J-Day approaches, and this fall the battle should commence.
In a lengthy New York Times Magazine feature on Watson this week, some of the details of the match became clear. It will take place this fall on national television.
Watson will not appear as a contestant on the regular show; instead, “Jeopardy!” will hold a special match pitting Watson against one or more famous winners from the past. If the contest includes Ken Jennings — the best player in “Jeopardy!” history, who won 74 games in a row in 2004 — Watson will lose if its performance doesn’t improve. It’s pretty far up in the winner’s cloud, but it’s not yet at Jennings’s level… The show’s executive producer, Harry Friedman, will not say whom it is picking to play against Watson, but he refused to let Jennings be interviewed for this story, which is suggestive [The New York Times].
If you’ve always yearned for “Jeopardy!” to feature the same kind of obsessive game-planning and secrecy as professional sports, this is your time. While folks on the show’s side won’t reveal the human contestants, the folks on the IBM side are busy testing Watson against humanity in mock “Jeopardy!” games. They even found a fake Alex Trebek (and no, it’s not Will Ferrell).
I.B.M.’s scientists began holding live matches last winter. They mocked up a conference room to resemble the actual “Jeopardy!” set, including buzzers and stations for the human contestants, brought in former contestants from the show and even hired a host for the occasion: Todd Alan Crain, who plays a newscaster on the satirical Onion News Network [The New York Times].