locked
Schedule more task's than 80 on an automated way. RRS feed

  • Question

  • Hi All,

    We have 10 tasks running on each node (cluster of 8 nodes) but we want to schedule more than 80 task. We want to schedule 240 task but the dependency is that there is a max of 10 tasks on 1 node.
    I'm lost in how to create the next 160 task's on a automated way.

    This is what i created so far with the powershell cmdlets of the hpc cluster.

    $cred = get-credential -Message "Please put in an account that has rights on the windows HPC cluster"
    #the scheduler on which the job is running
    $scheduler = "Scheduler"
    $nameoftask = "Taskname"
    $nameofjob = "Name of job"
    $jobs = 1..$Numberofjobs
    $start = 0
    $end = 10
    
    foreach ($job in $jobs)
    {
    Write-host Starting Job $job with task start $start and $end
    
    $j = New-HpcJob -Name "$nameofjob $job" -Scheduler $scheduler
    $j | Add-HpcTask -Name "$nameoftask" -Parametric -Start $start -End $end -Increment 1 -CommandLine "$batchlocation *"-Scheduler $scheduler -NumCores 1 -Stderr $errorfile -Stdout $outputfile
    $j|Submit-HpcJob -Scheduler $scheduler -Credential $cred
    
    $start  = $end   +1
    $end = $start +9
    
    }


    Tuesday, October 3, 2017 2:22 PM

All replies

  • hi,

      The number of tasks allowed to run on a node is limited by the core number of the node. By default, we allow one task for one core.

      You can change the default behavior by setting "subscribed cores" for the node. In your case, you can set 30 subscribed cores on your nodes so that 30*8=240 tasks can be run at the same time. To do this, you need:

    - Take offline your nodes

    - run powershell cmdlet:

        add-pssnapin microsoft.hpc

        set-hpcnode -subscribedCors 30 -subscribedSockets 10

    - take online the nodes

    Submit your job and check the behavior.


    Qiufang Shi

    Sunday, October 8, 2017 3:44 AM