Are we going to end up like the tiger mothers who raise their kids to go to an Ivy League University and become a doctor, lawyer, scientist or engineer only to have our dreams dashed? What happens if ASI quits to pursue a career in standup comedy, poker, or decides to focus its research on the gender politics of subaquatic textile production and its utility for the manufacture of household containers.
Perhaps advanced human like reasoning won’t require the kinds of internal motivations, dreams and aspirations that humans develop. Maybe it’s possible to have AGI/ASI without consciousness and self awareness but the only model we have of a general intelligence seems to be deeply connected to those things.
Also humans are social creatures and as every person on the autism spectrum knows being correct is just frustrating if you lack the social skills to be able to convince the normies. I think that in order to interface with human meatspace ASI will have to have some on these human attributes of personality and a sense of identity. We’ve seen with recent ChatGPT glazing how quickly that kind of reward system can lead to undesirable outcomes.
Thoughts?
[link] [comments]