List Info

Thread: LAM: multiple users and mpirun




LAM: multiple users and mpirun
country flaguser name
United States
2007-06-27 13:30:53
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi
we have a cluster on which several people want to run their
lam/mpi jobs
as themselves. alas, this appears to be impossible.

we have a special "lampi" user and lamboot is run
as "lampi".
we have a daemon (run as lampi) who accepts "job
requests" from
individuals, queues them, and runs them using mpirun one by
one.
it works just fine, except that the jobs are run as
"lampi".
we want the jobs to be run as the owner, so we tried to have
the daemon
run them as "sudo -u <user> mpirun ...".
this fails with the message

- -
-
------------------------------------------------------------
-----------------
It seems that there is no lamd running on the host
<main-cluster-server>.

This indicates that the LAM/MPI runtime environment is not
operating.
The LAM/MPI runtime environment is necessary for the
"mpirun" command.

Please run the "lamboot" command the start the
LAM/MPI runtime
environment.  See the LAM/MPI documentation for how to
invoke
"lamboot" across multiple machines.
- -
-
------------------------------------------------------------
-----------------

(as I said, lamd is running as "lampi" on all the
hosts).

what are we doing wrong?
Thanks.
Sam.
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org


iD8DBQFGgqzcPp1Qsf2qnMcRAioKAJ4tamxCbQvTeqGA9gd+2GM6w0wCrgCg
rOMq
pxMVbIEn/pACZFMMYZr6VT8=
=AmfB
-----END PGP SIGNATURE-----
_______________________________________________
This list is archived at http://www.l
am-mpi.org/MailArchives/lam/

Re: LAM: multiple users and mpirun
country flaguser name
United States
2007-06-27 13:57:48
sdsgnu.org wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
> 
> Hi
> we have a cluster on which several people want to run
their lam/mpi jobs
> as themselves. alas, this appears to be impossible.
> 
> we have a special "lampi" user and lamboot is
run as "lampi".
> we have a daemon (run as lampi) who accepts "job
requests" from
> individuals, queues them, and runs them using mpirun
one by one.
> it works just fine, except that the jobs are run as
"lampi".
> we want the jobs to be run as the owner, so we tried to
have the daemon
> run them as "sudo -u <user> mpirun
...".
> this fails with the message
> 
Typically, each user job would be a script which sets the
necessary 
environment variables, including PATH, and starts (and later
stops) its 
own MPI daemon.
_______________________________________________
This list is archived at http://www.l
am-mpi.org/MailArchives/lam/

Re: LAM: multiple users and mpirun
country flaguser name
Germany
2007-06-28 07:41:15
On Wed, 27 Jun 2007, Sam Steingold wrote:

> we have a cluster on which several people want to run
their lam/mpi 
> jobs as themselves. alas, this appears to be
impossible.

Well, this appears to be impossible because of the special
setup that 
you have. Lots of clusters just allow people to submit jobs
as 
themselves and LAM/MPI runs fine like that 

> we have a daemon (run as lampi) who accepts "job
requests" from
> individuals, queues them, and runs them using mpirun
one by one.

LAM/MPI has the concept of sessions. Normally there is only
one 
session per user per node, meaning that there is one daemon
per user 
per node that can be launched; this daemon then takes care
of all the 
jobs started via mpirun by that user on the node. To have
multiple 
sessions, you need to either:
- start the daemons as different users and then run mpirun
also as 
these users
- start several daemons as a single user, but specify for
each daemon 
a different session suffix. Then mpirun would need to be run
in an 
environment which knows about the suffix of the session
where it needs 
to connect.

For running as different users (which seems to be what you
want), you 
could use LAM/MPI's mpiexec or create a script that does:
 	lamboot
 	mpirun
 	lamhalt
and run mpiexec or this script with 'sudo -u <user>
mpiexec ...'.

-- 
Bogdan Costescu

IWR - Interdisziplinaeres Zentrum fuer Wissenschaftliches
Rechnen
Universitaet Heidelberg, INF 368, D-69120 Heidelberg,
GERMANY
Telephone: +49 6221 54 8869, Telefax: +49 6221 54 8868
E-mail: Bogdan.CostescuIWR.Uni-Heidelberg.De
_______________________________________________
This list is archived at http://www.l
am-mpi.org/MailArchives/lam/

Re: LAM: multiple users and mpirun
country flaguser name
United States
2007-06-28 13:45:50
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Bogdan Costescu wrote:
>> For running as different users (which seems to be
what you want), you
>> could use LAM/MPI's mpiexec

thanks, indeed, from the manual it appears that mpiexec is
what I want.
alas, I get this error:

mpiexec -ssi boot rsh -ssi boot_rsh_agent "ssh -x"
-machinefile
/etc/bhost.main -x OCAMLRUNPARAM C /path/to/mytest.exe list

sh: -c: line 0: unexpected EOF while looking for matching
`"'
sh: -c: line 1: syntax error: unexpected end of file
mpirun failed with exit status 2

I thought that the non-mpiexec args are passed over to
mpirun, so "-x
OCAMLRUNPARAM C /path/to/mytest.exe list" would go
there, but it did not
work ...

Suggestions?

Thanks!
Sam.


-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org


iD8DBQFGhAHdPp1Qsf2qnMcRAn0pAKCYr6ROT7Gz/SWx9rWD+Hzt4XE+pwCc
CtEc
zlSKKvI9Zz50v8g5CAykxDY=
=dbo3
-----END PGP SIGNATURE-----
_______________________________________________
This list is archived at http://www.l
am-mpi.org/MailArchives/lam/

[1-4]

about | contact  Other archives ( Real Estate discussion Medical topics )