If you're using a wireless connection from your PC to your home network, try a wired connection. If you're using a wired connection, the range of potential causes stretches from the NIC in the client, down the wire(s) to your switch or router, then up the
wire to your server, to your server's NIC. It could also be a poorly written driver on your client, your server, or both.
If you have a wired connection, swapping components one at a time is usually the only way you'll isolate any problem.
I'm not on the WHS team, I just post a lot. :)