yes you can provision with diffrent port than 5555. And in the client configuration assistent you type the port you choosed.
where did you change the port? is it adfs ifd? local? provide more information and a client trace.
gruss Daniel Ovadia MBSS - Microsoft Dynamics CRM MCNPS