There’s a name for what’s happening out there: the ELIZA Effect
https://en.wikipedia.org/wiki/ELIZA_effect “More generally, the ELIZA effect describes any situation where, based solely on a system’s output, users perceive computer systems as having ‘intrinsic qualities and abilities which the software controlling t…