I've been experimenting with a simple idea for making AI systems more reliable:
Instead of:
Question → AI → Answer have:
Question ↓ AI generates an answer ↓ External check ↓ Correct → output Wrong → feedback → try again I've built some small prototypes around this using Gemini/GPT and tools that can independently check things like code, equations and logic.
I'm now thinking about testing it on more everyday AI failures:
- exact counting
- arithmetic
- dates/time
- processing long lists
- citations
- structured information
The bigger idea is eventually to do the same thing with specialized capabilities — e.g. a physics or time-series system with its own simulator/evaluator.
But before going further, I'm curious what people actually care about.
What is something you regularly ask AI to do where you think:
'This sunds convincing, but I really wish something independent could check it'
Could be something technical or completely mundane.
[link] [comments]