NVIDIA acknowledges latency problem (EDIT: FIXED) – Page 3 – Computer Setup and System Configuration Forum

How graphics can have an impact on audio and asio. If you touch any gui elemnt of your daw, like a knob, open a plugin, you get audio dropouts. The same with harddrives, try to open a folder when the daw is running and you also get audio dropouts.
So how you solve this, is to run your soundcard/usb driver on a separate cpu core from the other drivers, so that interrupt processing do not collide. But with nvidia they where saturating the irq system so all other irq requests got pushed aside and then you got audio dropouts because of that too. So switching to studio drivers, solved that problem on nvidia. This I have done myself and know to be true.