A bit late of a response sorry, but now that VMWare and others have OpenGL support inside the VM, isn't that the graphics card access you are referring to? I'm sure it's still slower than bare metal, like all abstraction layers, but perhaps it's better now?