Sign in
Microsoft.com
 
Microsoft
 
 
 

locked
Does HPCS have scheduler plugin or sth like this? RRS feed

 > 

  • Question

  • Question
    Sign in to vote
    0
    Sign in to vote
    Can user develop some scheduler plugin to handle certain kind of jobs in Windows HPCS? Just like what the LSF scheduler plugin mechanism does.
    I mean I want to let Windows HPCS scheduler to offload certain kind of jobs to another cluster. Does HPCS have such a solution?

    Thanks in advance.
    Wednesday, June 25, 2008 8:14 AM

Answers

  • Question
    Sign in to vote
    1
    Sign in to vote
    We don't currently have any built-in Meta-Scheduling or Job Forwarding mechanisms (though we can accept jobs being forwarded from other schedulers like LSF or PBS).

    We do offer two differnet plug-in points, either of which could possibly used by you (with some custom code) to move jobs off of the HPCS cluster to another cluster.  These are called Submission and Activation filters . . . can you can read about them here:
    http://technet2.microsoft.com/windowsserver/en/library/91635ed4-44cb-4146-95ec-7ae771321c691033.mspx?mfr=true

    Basically they allow you to provide custom code which will be run whenever a job is submitted or activated.  This could be used to cancel the job on the HPCS cluster and submit it to another cluster.

    Thanks,
    Josh
    -Josh
    • Proposed as answer by Josh BarnardModerator Wednesday, June 25, 2008 5:57 PM
    • Marked as answer by WoodyZhou Friday, June 27, 2008 12:38 AM
    • Unmarked as answer by WoodyZhou Friday, June 27, 2008 12:39 AM
    • Unproposed as answer by WoodyZhou Friday, June 27, 2008 12:39 AM
    • Marked as answer by WoodyZhou Monday, June 30, 2008 1:28 AM
    Wednesday, June 25, 2008 5:57 PM
    Moderator
  • Question
    Sign in to vote
    0
    Sign in to vote
    The HPC Basic Profile support can make it easier to forward jobs between clusters.  But since it is really forwarding (and not true Meta-Scheduling) the user would have to query the cluster that the job was running on for status; the HPCS cluster wouldn't be keeping track of the job at that point.
    -Josh
    Friday, June 27, 2008 8:28 PM
    Moderator

All replies

  • Question
    Sign in to vote
    1
    Sign in to vote
    We don't currently have any built-in Meta-Scheduling or Job Forwarding mechanisms (though we can accept jobs being forwarded from other schedulers like LSF or PBS).

    We do offer two differnet plug-in points, either of which could possibly used by you (with some custom code) to move jobs off of the HPCS cluster to another cluster.  These are called Submission and Activation filters . . . can you can read about them here:
    http://technet2.microsoft.com/windowsserver/en/library/91635ed4-44cb-4146-95ec-7ae771321c691033.mspx?mfr=true

    Basically they allow you to provide custom code which will be run whenever a job is submitted or activated.  This could be used to cancel the job on the HPCS cluster and submit it to another cluster.

    Thanks,
    Josh
    -Josh
    • Proposed as answer by Josh BarnardModerator Wednesday, June 25, 2008 5:57 PM
    • Marked as answer by WoodyZhou Friday, June 27, 2008 12:38 AM
    • Unmarked as answer by WoodyZhou Friday, June 27, 2008 12:39 AM
    • Unproposed as answer by WoodyZhou Friday, June 27, 2008 12:39 AM
    • Marked as answer by WoodyZhou Monday, June 30, 2008 1:28 AM
    Wednesday, June 25, 2008 5:57 PM
    Moderator
  • Question
    Sign in to vote
    0
    Sign in to vote
    Thanks Josh! It's very helpful.
    I also notice that Windows HPCS 2008 Beta2 supports OGSA-BES which is compliant with HPC Basic Profile.
    Is there any possibility that this service provides the feature I need?
    Friday, June 27, 2008 12:38 AM
  • Question
    Sign in to vote
    0
    Sign in to vote
    Barndawgie said:

    We don't currently have any built-in Meta-Scheduling or Job Forwarding mechanisms (though we can accept jobs being forwarded from other schedulers like LSF or PBS).

    We do offer two differnet plug-in points, either of which could possibly used by you (with some custom code) to move jobs off of the HPCS cluster to another cluster.  These are called Submission and Activation filters . . . can you can read about them here:
    http://technet2.microsoft.com/windowsserver/en/library/91635ed4-44cb-4146-95ec-7ae771321c691033.mspx?mfr=true

    Basically they allow you to provide custom code which will be run whenever a job is submitted or activated.  This could be used to cancel the job on the HPCS cluster and submit it to another cluster.

    Thanks,
    Josh

    -Josh

    Another question: Since I cancel the job before the submission, how can user query the job status?
    Thanks.

    Friday, June 27, 2008 1:06 AM
  • Question
    Sign in to vote
    0
    Sign in to vote
    The HPC Basic Profile support can make it easier to forward jobs between clusters.  But since it is really forwarding (and not true Meta-Scheduling) the user would have to query the cluster that the job was running on for status; the HPCS cluster wouldn't be keeping track of the job at that point.
    -Josh
    Friday, June 27, 2008 8:28 PM
    Moderator
  • Question
    Sign in to vote
    0
    Sign in to vote
    Thanks indeed!
    Barndawgie said:

    The HPC Basic Profile support can make it easier to forward jobs between clusters.  But since it is really forwarding (and not true Meta-Scheduling) the user would have to query the cluster that the job was running on for status; the HPCS cluster wouldn't be keeping track of the job at that point.

    -Josh




    Monday, June 30, 2008 1:29 AM