> You need an "agent" that has genuine motivations and some concept of an internal experience.

Don’t you just need a more complete model of such an agent? I agree you can’t get such a thing by training on text.