The Illusion of Consciousness in AI Companionship

"While simulating consciousness in AI companions is threatening to become a normalised practice, the recent spike in scrutiny suggests that resistance to this design choice may be growing – and rightly so. If their powers are harnessed appropriately, AI companions have the potential to be a positive source of support. But feigning the possession of real emotions – emotions which they outright lack – risks fostering emotional attachments that are both harmful and unethical. AI companions, at present, are not conscious, and they should not give off the contrary impression."