Hi,
If you purchased device cal means you can access only in that device not apart from that device, any user can work CRM on that device.
I think it will work in remote desktop server too becuase you got device CAL license right, so only that system taking in remote.
Thanks & Regards, MS CRM Consultant, V.Surya.