The question is:
How many Rs are there in the word strawberry, and in what positions do they occur in the word?
Now you can replace R with any other letter, and strawberry with any other word. As you should, actually. Try other words (at least 7 letters long).
I did find that some chatbots answered the question correctly, but upon asking the same question in a new chat, they failed to replicate the correct results. So it's important to test this question in multiple chats, with different words and letters.
It's worth noting all I have are free models to test (except for Grok 2) since it's too expensive to test the paid models here in India. For context, in India, a month of ChatGPT Plus costs 4 times more than a month of Netflix (standard plan).
I tried ChatGPT-4o Mini, Claude Sonnet 3.5, Grok 2, Meta Llama 3.1 (70B), Perplexity, Gemini, Gemini 1.5 Pro and Microsoft Copilot.
Does anyone have access to o1? I'm curious as to how o1 will do on the prompt discussed in this post.
Edit: Guys, I am not claiming it to have discovered this question, calm down 😭 I saw someone else talking about it today in the comments of another post. I wanted to talk about it so I made a post. Although until reading some of the condescending comments made on this post, I wasn't aware this was such a popular question 💀
[link] [comments]