HPC Pack 2016 VM Azure Cluster. Scheduler.Connect Error when called via Web API hosted on IIS

• Question

• 

  

  0

  Sign in to vote

  I set up a Azure HPC 2016 VM Cluster.   I have C# web api running on the IIS of the Headnode acting as a client to submit the jobs to HPC Cluster.  IIS application pool (where the web api was hosted) running on custom domain account.  When calling the Scheduler.Connect the below error is being thrown

  ExecptionMessage - Inner Exception: One or more errors occurred. Inner Exception: The operation was canceled by the user
  ExceptionStackFrame - Inner StackTrace:    at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
     at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
     at Microsoft.Hpc.Scheduler.Scheduler.Connect(String cluster, ConnectMethod method)
  Inner StackTrace:    at Microsoft.Hpc.Credentials.PromptForCredentials(String target, String& username, SecureString& password, Boolean& fSave, Boolean fConsole, IntPtr hwndParent, CREDUI_FLAGS flags, String message)
     at Microsoft.Hpc.Scheduler.Store.StoreServer.<InternalConnectOverHttpAsync>d__36.MoveNext()
  --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
     at Microsoft.Hpc.Scheduler.Store.StoreServer.<ConnectAsync>d__34.MoveNext()
  --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
     at Microsoft.Hpc.Scheduler.Store.SchedulerStoreSvc.<InitializeAsync>d__41.MoveNext()
  --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
     at Microsoft.Hpc.Scheduler.Store.SchedulerStoreSvc.<RemoteConnectAsync>d__4.MoveNext()
  --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
     at Microsoft.Hpc.Scheduler.Store.SchedulerStore.<ConnectAsync>d__1.MoveNext()
  --- End of stack trace from previous location where exception was thrown ---
     at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw()
     at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task)
     at Microsoft.Hpc.Scheduler.Scheduler.<ConnectAsync>d__108.MoveNext()
  

  I am trying to connect to the HPC scheduler to submit the JOBS under the custom domain account that was configured on the IIS. I have added this custom domain user account to HPC Job Operators group but it is still throwing the error. 

  It appears IIS request to call the Scheduler.Connect under the domain account was being blocked for some reason which I have no clue. Any suggestions or ideas to resolve this issue? I have been trying to resolve this issue for last couple of days.  The piece of code is working fine on OnPremise HPC cluster. 

                  IScheduler scheduler = new Scheduler();
                  utl.Logger.LogMessage("Before connecting", Logging.Category.Information);
                  scheduler.Connect("https://mycloud.centralus.cloudapp.azure.com", ConnectMethod.WCF);
                  ISchedulerJob job = scheduler.CreateJob();

   Thanks in advance

  Ramesh

  Saturday, May 11, 2019 10:42 AM