Answered by:
Does HPCS have scheduler plugin or sth like this?

Question
-
Can user develop some scheduler plugin to handle certain kind of jobs in Windows HPCS? Just like what the LSF scheduler plugin mechanism does.
I mean I want to let Windows HPCS scheduler to offload certain kind of jobs to another cluster. Does HPCS have such a solution?
Thanks in advance.
Wednesday, June 25, 2008 8:14 AM
Answers
-
We don't currently have any built-in Meta-Scheduling or Job Forwarding mechanisms (though we can accept jobs being forwarded from other schedulers like LSF or PBS).
We do offer two differnet plug-in points, either of which could possibly used by you (with some custom code) to move jobs off of the HPCS cluster to another cluster. These are called Submission and Activation filters . . . can you can read about them here:
http://technet2.microsoft.com/windowsserver/en/library/91635ed4-44cb-4146-95ec-7ae771321c691033.mspx?mfr=true
Basically they allow you to provide custom code which will be run whenever a job is submitted or activated. This could be used to cancel the job on the HPCS cluster and submit it to another cluster.
Thanks,
Josh
-Josh- Proposed as answer by Josh BarnardModerator Wednesday, June 25, 2008 5:57 PM
- Marked as answer by WoodyZhou Friday, June 27, 2008 12:38 AM
- Unmarked as answer by WoodyZhou Friday, June 27, 2008 12:39 AM
- Unproposed as answer by WoodyZhou Friday, June 27, 2008 12:39 AM
- Marked as answer by WoodyZhou Monday, June 30, 2008 1:28 AM
Wednesday, June 25, 2008 5:57 PMModerator -
The HPC Basic Profile support can make it easier to forward jobs between clusters. But since it is really forwarding (and not true Meta-Scheduling) the user would have to query the cluster that the job was running on for status; the HPCS cluster wouldn't be keeping track of the job at that point.
-Josh- Proposed as answer by Josh BarnardModerator Friday, June 27, 2008 8:28 PM
- Marked as answer by Josh BarnardModerator Tuesday, September 16, 2008 9:02 PM
Friday, June 27, 2008 8:28 PMModerator
All replies
-
We don't currently have any built-in Meta-Scheduling or Job Forwarding mechanisms (though we can accept jobs being forwarded from other schedulers like LSF or PBS).
We do offer two differnet plug-in points, either of which could possibly used by you (with some custom code) to move jobs off of the HPCS cluster to another cluster. These are called Submission and Activation filters . . . can you can read about them here:
http://technet2.microsoft.com/windowsserver/en/library/91635ed4-44cb-4146-95ec-7ae771321c691033.mspx?mfr=true
Basically they allow you to provide custom code which will be run whenever a job is submitted or activated. This could be used to cancel the job on the HPCS cluster and submit it to another cluster.
Thanks,
Josh
-Josh- Proposed as answer by Josh BarnardModerator Wednesday, June 25, 2008 5:57 PM
- Marked as answer by WoodyZhou Friday, June 27, 2008 12:38 AM
- Unmarked as answer by WoodyZhou Friday, June 27, 2008 12:39 AM
- Unproposed as answer by WoodyZhou Friday, June 27, 2008 12:39 AM
- Marked as answer by WoodyZhou Monday, June 30, 2008 1:28 AM
Wednesday, June 25, 2008 5:57 PMModerator -
Thanks Josh! It's very helpful.
I also notice that Windows HPCS 2008 Beta2 supports OGSA-BES which is compliant with HPC Basic Profile.
Is there any possibility that this service provides the feature I need?
Friday, June 27, 2008 12:38 AM -
Barndawgie said:Another question: Since I cancel the job before the submission, how can user query the job status?
We don't currently have any built-in Meta-Scheduling or Job Forwarding mechanisms (though we can accept jobs being forwarded from other schedulers like LSF or PBS).
We do offer two differnet plug-in points, either of which could possibly used by you (with some custom code) to move jobs off of the HPCS cluster to another cluster. These are called Submission and Activation filters . . . can you can read about them here:
http://technet2.microsoft.com/windowsserver/en/library/91635ed4-44cb-4146-95ec-7ae771321c691033.mspx?mfr=true
Basically they allow you to provide custom code which will be run whenever a job is submitted or activated. This could be used to cancel the job on the HPCS cluster and submit it to another cluster.
Thanks,
Josh
-Josh
Thanks.Friday, June 27, 2008 1:06 AM -
The HPC Basic Profile support can make it easier to forward jobs between clusters. But since it is really forwarding (and not true Meta-Scheduling) the user would have to query the cluster that the job was running on for status; the HPCS cluster wouldn't be keeping track of the job at that point.
-Josh- Proposed as answer by Josh BarnardModerator Friday, June 27, 2008 8:28 PM
- Marked as answer by Josh BarnardModerator Tuesday, September 16, 2008 9:02 PM
Friday, June 27, 2008 8:28 PMModerator -
Thanks indeed!Barndawgie said:
The HPC Basic Profile support can make it easier to forward jobs between clusters. But since it is really forwarding (and not true Meta-Scheduling) the user would have to query the cluster that the job was running on for status; the HPCS cluster wouldn't be keeping track of the job at that point.
-Josh
Monday, June 30, 2008 1:29 AM