Is there any configuration available for running 2 tasks in the same compute node

Answered Is there any configuration available for running 2 tasks in the same compute node

  • Wednesday, August 06, 2008 12:16 PM
     
     
    Hi

    Is there any configuration available for running 2 tasks in the same compute node.


    Ex:

    I am creating 4 tasks in my job.

    Task2 is dependent on Task1
    Task4 is dependent on Task3

    Here Task1 will copy some of the Required files into the Compute node named (X) for Task2.

    In this case Task2 also needs to run on the same Compute node named (X) as Task1

    Requirement: 
                          Task1 & Task2 should Run on Same Compute node 

                          Task3 & Task4 should Run on same Compute node 

    1.Is it Possible?

    2.If possible how to configure?

    Thanks in Advance.....

    Murthy PVASN

All Replies

  • Wednesday, August 06, 2008 4:28 PM
    Moderator
     
     Proposed
    Unfortunately there is no built-in way to enforce this in v2; we are looking into possible solution in the future.

    In the meantime the easiest thing to do is wrap your two commands in a script and run the script as the task.

    That being said . . . in the case of a nice symetrical job like yours, you can probably just use task dependencies and unless something goes awry your following tasks will run in the same place as the initial tasks.
    -Josh
  • Wednesday, August 06, 2008 5:08 PM
     
     

    Thanks Josh for your early Reply

    Will all the Dependent task Run on the Same ComputeNode?


    Step 1: We had Task -T1 for Copy to  Configurable Shared location.
     
    Step 2: 200 additional Tasks Created with Dependetn Task as T1 to use the above
                 Configure Shared location

    We are having  4 Compute Nodes.

    Q1) Because of Dependent Task of T1 Will all the 200 Tasks Run on the same Compute node as
            T1?

    Q2)If the above case is True The above Job  Will Utilise only one Compute node without using 3 reamining compute nodes. Please confirm..

    Thanks
    Murthy 

  • Friday, August 08, 2008 10:33 PM
    Moderator
     
     Answered

    If you submit a job which takes 4 nodes and has 1 prep task, that task will run on ONE NODE only, and subsequent tasks might run anywhere in those 4 nodes.

    THanks,
    Josh


    -Josh