It's possible that you're simply saturating your Internet connection with traffic. This can cause packet loss or significantly delayed packets.
What do you see if you try using the tracert command instead of ping? This will give an indication of where the delay actually is.
I'm not on the WHS team, I just post a lot. :)