The problem will be in multiplayer. Going online and being repeatedly destroyed by mouse players won't be much fun.

Also I guess difficulty in singleplayer games would have to take the control scheme into account.