Windows HPC Server UNIX - Interoperability Forum

Submitting Jobs through Job Files/Job Submission Scripts/JSDL

Mon, 24 Aug 2009 21:26:31 Z

I've been searching high and low...mostly low for an example of submitting jobs to the Windows HPC Server Job Scheduler via a submission script. With PBS, LSF, SGE, ... you can create job submission scripts that are similar to shell scripts to describe the resources needed for a job as well as the environment needed to run the job and the application to run.

All of the documentaiton that I've seen so far has mentioned a "job file", but I've had a hard time finding one. I did see a niftty little webcast by Steven Newhouse about using JSDL, but that seems a bit heavyweight for what I want to do. So here are my questions:

1. Is there a way to perform a jobs submission from the command-line, where I could use the syntax: --> job submit some_file.xml?

2. If the answer to question #1 is yes, then where can I find examples of the xml description needed to submit the job?

3. If the answer to #1 is no, then what suggestions would you make for users who have applications that need to submit batch jobs, and basically feed the results

of the stdout, stderr from the job submission to another application to parse the results?

I know there are lots of cool APIs for doing this via the .NET framework, but I am working up to that. ;)

Regards,

Aquil H. Abdullah

Cygwin sshd?

Tue, 04 Aug 2009 19:36:39 Z

Has anyone else had trouble getting Cygwin sshd to work?

I've followed the instructions here:
http://www.petri.co.il/setup-ssh-server-vista.htm

The service does start. However, whenever I attempt to connect, the following error shows up in the event log:
sshd: PID 5096: fatal: setreuid 500: No such process

I've tried a number of variations on the configuration. I've tried it with and without privilege separation, I've checked the service-definition with "cygrunsrv -VQ sshd", and checked the user's rights with "editrights -l -u sshd_server", and it all looks happy as near as I can determine. But it keeps coming back to this setruid() problem.

Any suggestions?

Thanks,
-Luke

Using Windows HPC MPI from c++ in SUA?

Fri, 03 Oct 2008 15:01:04 Z

Hello,

I am trying to use the Windows HPC MPI library from c++ using windows SUA.
So i am pretty new to this

Here is my simple c++ example:

#include <iostream> 
using namespace std; 
 
int main(){ 
   cout << "Hello World!\n"; 
   return 0 
} 

Compiled and ran it like this:

bash-3.2$ cc -o main.exe main.cpp 
bash-3.2$./main.exe 
Hello World! 
bash-3.2$ 

All looking good so far.

Now i want to include the mpi.h, here is my simple example:

#include <stdlib.h> 
#include <iostream> 
#include <mpi.h> 
 
using namespace std; 
 
static int mypid;       // PID of *this* node 
static int nnodes;      // number of nodes 
 
int main(int argc, char *argv[]) 
{ 
    cout << "Starting..." << endl; 
 
    // fire up MPI 
    cout << "call MPI_Init().." << endl; 
    MPI_Init(&argc, &argv); 
    MPI_Comm_rank(MPI_COMM_WORLD, &mypid); 
    MPI_Comm_size(MPI_COMM_WORLD, &nnodes); 
 
    // this test required two nodes 
    cout << "Rank " << mypid << " of " << nnodes << endl; 
 
    // clean up and exit 
    cout << "Clean up and exit..." << endl; 
    MPI_Finalize(); 
    return(0); 
} 

Now here is where i get confused, if i try to compile this i get this error:

bash-3.2$ cc -o simplempi.exe simplempi.cpp 
C:\Users\Administrator\mpiTest\simplempi.cpp(7) : fatal error C1083: Cannot open 
 include file: 'mpi.h': No such file or directory 
bash-3.2$ 

Which is ok as there is not an mpi.h for SUA. Now i would like to use the HPC mpi.h.
I downloaded and installed the HPC SDK pack (now i get the header files i need)

bash-3.2$ ls -al  "/dev/fs/C/Program Files/Microsoft HPC Pack 2008 SDK/Include/" 
total 312 
drwxrwx---+ 1 +SYSTEM  +SYSTEM      0 Oct  3 08:33 . 
drwxrwx---+ 1 +SYSTEM  +SYSTEM   4096 Oct  3 08:33 .. 
-rwxrwx---+ 1 +SYSTEM  +SYSTEM  13674 Sep  2 15:12 job-v2.xsd 
-rwxrwx---+ 1 +SYSTEM  +SYSTEM  47551 Sep 11 14:51 mpi.f90 
-rwxrwx---+ 1 +SYSTEM  +SYSTEM  53132 Sep 11 14:51 mpi.h 
-rwxrwx---+ 1 +SYSTEM  +SYSTEM  15750 Sep 11 14:51 mpif.h 
-rwxrwx---+ 1 +SYSTEM  +SYSTEM  18153 Sep 11 14:51 mpio.h 
-rwxrwx---+ 1 +SYSTEM  +SYSTEM   6466 Sep  2 15:12 task-v2.xsd 
bash-3.2$ 

I then tried to link these headers to my /usr/include (symbolic) (Maybe this is where i am going wrong??)

bash-3.2$ ln -s "/dev/fs/C/Program Files/Microsoft HPC Pack 2008 SDK/Include/"* /usr/include/ 
 

Then tried to recompile, it attempts to load the mpi.h file but has trouble reading it.???
I tried mixed mode and g++/cc89/cc but without any luck

bash-3.2$ cc -o simplempi.exe simplempi.cpp 
flip: /tmp/cc_tmp3_1117 is a binary file, not converted 
C:\Windows\SUA\usr\include\mpi.h(1) : error C2018: unknown character '0x1' 
C:\Windows\SUA\usr\include\mpi.h(1) : error C2143: syntax error : missing ';' before '/' 
C:\Windows\SUA\usr\include\mpi.h(1) : error C4430: missing type specifier - intassumed. Note: C++ does not support default-int 
C:\Users\Administrator\mpiTest\simplempi.cpp(16) : error C2065: 'cout' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(16) : error C2065: 'endl' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(19) : error C2065: 'cout' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(19) : error C2065: 'endl' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(20) : error C3861: 'MPI_Init': identifier not found 
C:\Users\Administrator\mpiTest\simplempi.cpp(21) : error C2065: 'MPI_COMM_WORLD' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(21) : error C3861: 'MPI_Comm_rank': identifier not found 
C:\Users\Administrator\mpiTest\simplempi.cpp(22) : error C2065: 'MPI_COMM_WORLD' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(22) : error C3861: 'MPI_Comm_size': identifier not found 
C:\Users\Administrator\mpiTest\simplempi.cpp(25) : error C2065: 'cout' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(25) : error C2065: 'endl' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(28) : error C2065: 'cout' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(28) : error C2065: 'endl' : undeclared identifier 
C:\Users\Administrator\mpiTest\simplempi.cpp(29) : error C3861: 'MPI_Finalize':identifier not found 
bash-3.2$ 

So... I guess my question now is , is it possible?

Has anyone out there got an MPI example that works with the windows mpi.h from SUA?
Can anyone see something wrong in the way i am approaching this problem?

Any help is very gratefully received!

Regards
Steven

sjj

New features on HPC community site!

Wed, 04 Jun 2008 20:57:10 Z

I’m very excited to report that during the next few months the HPC community site will have some exciting new improvements. These include:

1. New feature rich, robust forums platform

2. Lots of white papers, code samples, how-to guides, etc about the V2 product

3. Videos that cover all features of the product

4. Interviews w HPC luminaries

5. Dedicated HPC MVP’s

6. Etc.

The transition to the new forums will start immediately (tomorrow, Thursday) and will result in a few hours of outage while data is ported over. Your patience is appreciated.

The new forums platform (MSDN | TechNet | Expression | Microsoft) provides increased performance, stability, and an improved user experience. To make sure this is a smooth transition, we want everyone using this forum to have a chance to try out the new forums in advance, and give feedback. We’ve created a Sandbox forum, where you can create threads and try out functionality, and a suggestions forum where you can give us your feedback. Please take some time to go to the new forums today and let us know what you think.

On the day the forum moves to the new platform, a post will be made letting you know the process has been started, and the forum will be locked to new posts. Once the process is complete, a final post to the forum will be made letting you know the forum has moved.

1. All posts in the forum will be preserved

2. Any points you’ve received for replies will move with you (on a per forum basis)

3. Any bookmarks to this forum or threads within this forum will redirect to their new location

4. Your “My Threads” will be preserved on the new platform

The only thing you’ll need to do after migration is set Windows Live Alerts for any threads you were tracking.

If you have feedback, let us know in the suggestions forum or contact Andrew.Brenner at Microsoft.com

Windows Clusters unavailability

Tue, 04 Dec 2007 04:29:38 Z

Hi,

I developed an application using the MPI.Net bindings for C# and other .Net languages available from Indiana University. Unfortunately these bindings cannot be used in a Linux environment because they are somehow tied to MS-MPI. Now, I don't have a test bed. I could test on my desktop but that is almost senseless. Any help would be greatly appreciated.

Thanks in advance,

Abhimanyu