Broadly 'world' means 'the domain I'm interested in'. In current use in the DNN context 'world' tends to be physical space at a scale relevant to humans or robots (eg. autonomous vehicles). So when someone says 'world model' you have to ask 'what kind of world, and how is it represented?'.

We don't need to agree on one very specific meaning, which is good, because we would fail.