c# – Observed periodic noise with ASIO sound card in my audio processing application

I observe noise which shows up periodically (every 5 seconds or so) when i use Asio sound card with the custom built audio processing application visualisation tab which displays the frequency analysis.
The noise is not observed when using a Direct Sound card with the same audio.

I have tried changing the number of channels that are listening to the audio for Asio from 8 to 2 but that doesn’t fix the issue!
The sampling rate is 48kHz.( Tweaked it to 44kHz, doesn’t fix the issue).

The audio processing application is written in C# and made use of NAudio API.

Any inputs on this is appreciated!