none
How many max tasks with a Job ? RRS feed

  • Question

  • Hello,

    I submit a Job with 80 tasks, the job scheduler will be hold and cpu usage 100%.

    But it is correctly when I submit a Job with 10 tasks.

    How man max tasks with a Job I can use ?

    Or it is a problem of job scheruler ?

    Thanks.
    Thursday, November 6, 2008 5:25 AM

Answers

  • I didn't realize you were on 2003 (I assumed 2008).

    Is your Head Node also a Compute Node (check in the Node List)?  That might cause a problem if CPU intensive tasks are getting started on the HN.

    Also, what do you mean the scheduler will "hold."  Is the UI frozen?  Does the Scheduler Service crash?

    Also, it would be interesting to know if you are submitting from a remote client or are logged into the Head Node.  If the Head Node is a Compute Node, then when you start a job which runs on it, your UI may hang due to the CPU being used up . . .

    Does the hang last forever?

    -Josh


    -Josh
    Friday, November 14, 2008 1:23 AM
    Moderator

All replies

  • Tenlans,
    HPC Server should support jobs with many thousdands of tasks.  Can you clarify a bit how you are submitting and what behavior you are seeing?

    It's worth noting that if your head node is acting as a compute node (in Node Management, right click on your head node and say "change role" to see) and running a job which pounds on the CPU, the job scheduler may be starved for cycles a bit.  You can try raising the priority of Scheduler.exe, or changing the HN to not be a CN, and then see if that fixes your problem . . .

    -Josh
    -Josh
    Thursday, November 6, 2008 7:00 PM
    Moderator
  • Thanks for your reply.

    I try to submit a job with 30 tasks, more than will be hold.

    OS: WCCS 2003 SP1
    CPU: Intel E5335 Quad core * 2
    Memory: 4G


    Friday, November 7, 2008 8:09 AM
  • I didn't realize you were on 2003 (I assumed 2008).

    Is your Head Node also a Compute Node (check in the Node List)?  That might cause a problem if CPU intensive tasks are getting started on the HN.

    Also, what do you mean the scheduler will "hold."  Is the UI frozen?  Does the Scheduler Service crash?

    Also, it would be interesting to know if you are submitting from a remote client or are logged into the Head Node.  If the Head Node is a Compute Node, then when you start a job which runs on it, your UI may hang due to the CPU being used up . . .

    Does the hang last forever?

    -Josh


    -Josh
    Friday, November 14, 2008 1:23 AM
    Moderator