 | Last week my post about an AI video quiz in r/artificial got a decent number of upvotes and comments so I thought it might be interesting to y'all to read a writeup of the results. For context, the quiz has 10 videos that tests whether someone can guess whether or not a video is real or artificially generated. When I posted the quiz initially I got a bunch of comments about how simple the quiz was. I'll copy one of the comments from the original thread here: I guess the quiz was pretty laughably easy? A lot of the comments made it seem like the quiz was too easy. But I went through and actually analyzed the data of all the users who took the quiz (only looking at people who answered all 10 questions) and here are some of the initial findings: Only 6.7% of people answered all 10 questions correctly. Warning, spoilers below in case you want to try the quiz first. The hardest videos for people to answer correctly were the initial Trump video where he talks about his coin, the video of Tom Cruise at the Producer's Guild Awards, and the video of Mark Zuckerberg at the Harvard commencement. On the Tom Cruise and Zuckerberg videos, the results were essentially split evenly 50-50 between answering if the videos were real or fake. Despite what people in the sub might comment, it seems like the actual data shows that it's not as easy as it might seem to tell the difference between a real video and an AI generated one. Just wanted to post this as I felt like it's pertinent, especially in the context of the upcoming election, just to be aware that these types of videos are possible, and not everyone is going to be able to see the subtleties and differentiate reality from falsehoods. [link] [comments] |
Predictive technology: computational social science
