Two of you told me an AI can’t know me because I don’t know myself. Here’s the sloppy test I ran on myself, and I’d like you to take the methodology apart.
When I posted about personal AIs here, two objections landed on the same spot from different directions: "How can an AI know you when you predict yourself badly?" — preferences are unstable and poorly structured, so there's no inner trut…