none
Submitting A Job To Many Nodes But Limiting Number Of Cores RRS feed

  • Question

  • Good Evening, I have a program which is very memory intensive, so would like to submit 20 tasks over 10 nodes, but limiting the number of cores running on each node to 2.  I can execute on 10 nodes, running 1 task per node, but cannot get Job manager to submit the job running 2 task/node (Running Windows 2012 HPC Pack).  Any ideas ?

    Regards

    Paul

    Thursday, March 28, 2019 6:38 PM

All replies

  • HI Paul,

      If your cluster only has one type workload running, you can under subscribe the core number for the node, to let scheduler think the node has only 2 cores. (Try using powershell cmdlet "Set-HPCNode -SubscribedCores" to configure it)

      The other way is to have your job to allocate resource type to Socket if you have 2 socket for the node (If not, you can also subscribe the socket number for the nodes). This way you won't change the core number for the node thus other jobs/workloads are not imapcted

      A third way is put those tasks into 20 jobs, and you can put memory requirements for your job.


    Qiufang Shi


    Friday, March 29, 2019 1:50 AM