I was just bored and asking it to give me its estimates of who might win in various head-to-head fights between animals and humans or animals and other animals...you know, as one is wont to do when they're bad at their job and good at wasting time, lol.
We were talking about elephants vs lions when I asked it to cite its sources for the claim that an elephant could throw a lion dozens of yards (we all know they can, I just want to see what it was using to back up the claim). It linked me to an example video as evidence on Instagram.
The problem? The video it linked me to was a Sora AI video of a lion and an elephant, and the elephant wasn't even throwing the lion - the fake AI voiceover mentioned the elephant throwing the lion, but the video itself just showed the lion walking past the elephant.
That was its "proof".
I warned it that it had provided AI video as factual evidence and it apologized and said that was a big problem, then proceeded to provide me with "vetted" evidence...and linked me to the very same video.
Now, I know AI is fallible, we all know that. I know it hallucinates, it gets things wrong, its logic fails. But this is VERY concerning to me because it's indicative of what could potentially be a massive future problem - maybe even near future - where AI begins to train on AI-created data thinking it's human-created...and the model gets worse, and less capable, and more likely to hallucinate, and more likely to provide wrong, even dangerous generations. What happens when companies scrape the internet now, after years of AI slop being shared as if it were real, in these early days without dependable ways of verifying?
What's being done about it? I imagine there's a lot happening behind the scenes, but a quick search only brought up some "we're aware and working on it" type mentions of the issue. How are these billion dollar companies making sure that the training data is all human-created? Are there even laws requiring regulation of training data in that respect yet?
I feel like online search could become useless, returning nothing but machine-generated summaries of machine-generated summaries. AI video, photo and text used as verified sources are already happening, clearly. Extreme confidence returning dangerous or wrong information.
And maybe worse, AI models favor statistical averages, right? So niche information and groups would slowly but surely begin to be under-weighted, maybe even disappearing altogether. If you're part of a minority culture, have a rare medical condition, speak a rare language, work in a highly-specialized field, etc - all that could be replaced by high-noise garbage data hallucinated by the AI based on garbage training data filled with AI-generated content positioned as "human-generated".
I appreciate AI and use it daily, for multiple use-cases. This is worrisome - yet another thing to worry about in the "how will AI ruin the world?" list, lol.
[link] [comments]