When did I do that? WebUSB gives a website access to a specific USB device, not my entire computer.

Access to a programmable USB device is access to your entire computer. They can program it to emulate a mouse and accept more permissions.

I don't see how WebUSB makes that risk worse. At least I avoid making it easy and running somebody's firmware updater on my computer.