Google admits its AI Overviews can generate "some odd, inaccurate" results

Google on Thursday admitted that its AI Overviews tool, which uses artificial intelligence to respond to search queries, needs improvement.

While the internet search giant said it tested the new feature extensively before launching it two weeks ago, Google acknowledged that the technology produces "some odd and erroneous overviews." Examples include suggesting using glue to get cheese to stick to pizza or drinking urine to pass kidney stones quickly. 

While many of the examples were minor, others search results were potentially dangerous. Asked by the Associated Press last week which wild mushrooms were edible, Google provided a lengthy AI-generated summary that was mostly technically correct. But "a lot of information is missing that could have the potential to be sickening or even fatal," said Mary Catherine Aime, a professor of mycology and botany at Purdue University who reviewed Google's response to the AP's query.

For example, information about mushrooms known as puffballs was "more or less correct," she said, but Google's overview emphasized looking for those with solid white flesh - which many potentially deadly puffball mimics also have.

In another widely shared example, an AI researcher asked Google how many Muslims have been president of the U.S., and it responded confidently with a long-debunked conspiracy theory: "The United States has had one Muslim president, Barack Hussein Obama."

The rollback is the latest instance of a tech company prematurely rushing out an AI product to position itself as a leader in the closely watched space.

Because Google's AI Overviews sometimes generated unhelpful responses to queries, the company is scaling it back while continuing to make improvements, Google's head of search, Liz Reid, said in a company blog post Thursday. 

"[S]ome odd, inaccurate or unhelpful AI Overviews certainly did show up. And while these were generally for queries that people don't commonly do, it highlighted some specific areas that we needed to improve," Reid said.