Yes, it does not understand (or has learned) the rules of the game then. For that being the case, it should be able to apply the rules correctly in a slightly different context.

Would it be possible to train an LLM on the rules how we would teach them to a human?