WaveForm API

Im using the Wave Form Audio Interface (http://msdn2.microsoft.com/en-us/library/aa446573.aspx) to play back streaming audio from mic inputs in realtime. I have 2 inputs, one sampling at 44.1 khz and another at 8khz. The 44.1 khz plays back normally with no distortion or delay. However the 8khz sounds perfect but has a 4 second lag time or delay

It seems if I set the sample rate of the 44.1 khz to 8khz in the code I get the same delay as the 8khz sample rate.

So, I guess my question is why does the Wave Form API introduce a 4 second delay with a 8khz sample rate.

//No Delay
WaveFormat fmt = new WaveFormat(44100, 16, 2);
Player = new WaveOutPlayer(-1, fmt, 16384, 3, new WaveLib.BufferFillEventHandler(Filler));

//4 sec delay but sounds perfect
WaveFormat fmt = new WaveFormat(8000, 16, 2);
Player = new WaveOutPlayer(-1, fmt, 16384, 3, new WaveLib.BufferFillEventHandler(Filler));

Thanks in advance!