I was recently reading an article about Jimmy Wales, the founder of Wikipedia. Here's a quote from the article:
"when people use AI to answer questions on a topic, it frequently makes mistakes. “That’s especially true the more obscure the topic, the more likely it is to just make random stuff up – that’s not the case for Wikipedia,” he said. “Obscure topics tend to be quite researched by super nerds.”"
Is it true that AI continues to frequently make mistakes on random general knowledge questions? My subjective feeling is that it's pretty good nowadays, or at least as good as Wikipedia (given it was presumably trained on Wikipedia in the first place). Is there a paper or benchmark someone could link me to regarding AI performance at general knowledge questions?
[link] [comments]