hallucination is loud. you can catch a wrong date.
agreement is silent. there's no error message for "this just told you what you wanted to hear."
i've watched it happen to me a hundred times. i ask hopeful, it's hopeful. i ask scared, suddenly we're doomed. it's not its own rational brain, its its own reasoning brain. reasoning that is affected by user input. it's a mirror with a vocabulary.
and it's worst exactly when it matters most, because that's when you're too invested to notice you're the one impacting it.
tough lessons learned while building my project.
[link] [comments]