Showing posts with label hoaxes. Show all posts
Showing posts with label hoaxes. Show all posts

Tuesday, June 10, 2014

An IQ test for computers: does it tell us how smart the computer is, or how dumb humans are?

 A Russian computer fooled 33% of people who engaged in an online chat into thinking it was a thirteen-year-old boy who didn't speak English very well.  But really, how hard is it for a computer to fool the least-intelligent third of humans that it is one of them?

 

Computer program fools humans, allegedly passes Turing test

A team in Russia claims its chatbot managed to dupe more than 30 percent of human interrogators into believing it's human. Are they to be believed?
It wasn't Siri, nor a souped-up Scarlett Johansson.
However, it seems that artificial intelligence may have gone even further toward a time when it will fool us that it's just like us. Emphasis on the "may have."
A Russia-based team claims to be the first to create a program that passed the Turing test. Named after Alan Turing -- who died on June 7, 1954 -- the challenge is to persuade a minimum of 30 percent of humans that the computer program is a real person.
As the Independent reported, in tests conducted at the Royal Society in London, the Eugene Goostman program managed to persuade 33 percent of people that it was a 13-year-old boy from Odessa, Ukraine.
The event was organized by the University of Reading. The university insisted that this is the first time the Turing test has been passed with flying deception.
Professor Ken Warwick, a visiting professor at Reading, said in a press release: "Some will claim that the Test has already been passed. The words Turing Test have been applied to similar competitions around the world. However this event involved the most simultaneous comparison tests than ever before, was independently verified and, crucially, the conversations were unrestricted. A true Turing Test does not set the questions or topics prior to the conversations. We are therefore proud to declare that Alan Turing's Test was passed for the first time on Saturday."
There's a certain convenience in pretending you're a 13-year-old boy, of course. You can fool people more easily because, unlike IBM's Watson, you don't have to pretend you know everything. Rather you have to have a very well-designed "dialog controller."
The man behind the boy, Vladimir Veslov, explained: "This year we improved the 'dialog controller,' which makes the conversation far more human-like when compared to programs that just answer questions. Going forward we plan to make Eugene smarter and continue working on improving what we refer to as 'conversation logic'."

...Those who are gullible to such things, though, are often those who think nothing right now of sending an online date whom they have never met huge sums of money.
The woman who was duped into wiring $500,000 to someone she'd met on a Christian dating site is but one example.
It's true, though, that as AI progresses, we'll be forced to think at least twice when meeting "people" online...





That Computer Actually Got an F on the Turing Test


Alan M Turing and colleagues working on the Ferranti Mark I Computer in 1951. Photo: SSPL/Getty Images
Alan M Turing and colleagues working on the Ferranti Mark I Computer in 1951. Photo: SSPL/Getty Images
Over the weekend, a group of programmers claimed they built a program that passed the famous Turing Test, in which a computer tries to trick judges into believing that it is a human. According to news reports, this is a historic accomplishment. But is it really? And what does it mean for artificial intelligence?
The Turing Test has long been held as a landmark in machine learning. Its creator, British computer scientist Alan Turing, thought it would represent a point when computers would have brains nearly as capable as our own. But the value of the Turing Test in modern day computer science is questionable. And the actual accomplishments of the test-winning chatbot are not all that impressive.
The Turing Test 2014 competition was organized to mark the 60th anniversary of Turing’s death and included several celebrity judges, including actor Robert Llewellyn of the British sci-fi sitcom Red Dwarf. The winner was a program named Eugene Goostman, which managed to convince 10 out of 30 judges that it was a real boy. Goostman is the work of computer engineering team led by Russian Vladimir Veselov and Ukrainian Eugene Demchenko.
The program had a few built-in advantages, such as the fact that he was claimed to be a 13-year-old non-native English speaker from Ukraine. It also only tricked the judges about 30 percent of the time (an F minus, or so). For many artificial intelligence experts, this is less than exciting...

Monday, September 01, 2008

If they win an award, they must be good--right?

Here are two stories about awards.

The first award is for a school district, and the second is for a restaurant. I learned a few years ago that awards are very often based on political connections rather than merit.

But there is another way of choosing winners: awards are sometimes based simply on what the applicants claim about themselves.

The award in story #2 below may have been a result of a combination of these two strategies. Maybe there was a deadlock regarding the real restaurants, so the secretly fake one was chosen because the judges wanted to escape a difficult choice.

AWARD #1

CVESD CHOSEN AS FINALIST

Apparently CVESD didn't tell the NSBA about the millions the board has spent covering up wrongdoing. Or maybe they did--and NSBA, which is connected to the Council for School Attorneys--thought it was a terrific accomplishment.


From CVESD's website:
"...National School Boards Association to honor District as a role model for excellence in Board governance

"The National School Boards Association’s Council of Urban Boards of Education (CUBE) has named Chula Vista as one of three finalists for the association's Annual Award for Urban School Board Excellence.

"The Chula Vista Elementary School District, the Brownsville Independent School District in Texas, and the School District of Omaha in Nebraska are each candidates for CUBE’s prestigious annual award. The prize honors urban school districts that demonstrate progress in educating children and that serve as role models in school board governance...

“These finalists illustrate how essential successful board governance is for urban achievement, and we are proud to recognize these districts for their exemplary leadership,” said Anne. L Bryant, executive director of NSBA...

"A panel of judges selected finalists based on the school districts’ submissions and independent research..."(emphasis added).

[Blogger's note: CVESD got (or gave to itself?) an NSBA/CUBE award in 2004.]


AWARD #2


NON-EXISTANT RESTAURANT WINS AWARD

NEW YORK TIMES
By Stanley Fish
August 31, 2008
Fooled Again


Last week the New York Post’s Page Six picked up on a story that had been widely circulated on the blogosphere. The magazine Wine Spectator was the victim of a hoax when it came out that its “award of excellence” had been given to a restaurant that did not exist. Robin Goldstein, a wine critic who said that he wanted to expose the lack of any foundation for many food and wine awards, had submitted an application that included the menu and wine list of a fictitious restaurant he named Osteria L’Intrepido. Goldstein revealed the hoax within a week or so of the announced award and declared that what he had done proved that “the level of scrutiny” that accompanies such awards is “insufficient.”