Restore Configuration Problem

Hi Mat,

you are always using the same version of SGE? So your
backedup 
configurations are form the same SGE release, I your case
6.1?
What kind of spooling are you using?

Regards,
Marco

Bradford, Matthew wrote:
>
> I'm attempting to look at different configurations of
SGE 6.1 to see 
> the effect that the different configurations have on
running a 
> standard set of jobs. I am using the backup and restore
functionality 
> to allow me to easily switch between the different
setups that I have. 
> Unfortunately there appears to be a problem with
restoring the configs.
>
> Firstly, the restore will restore the previously backed
up accounting 
> file. I've removed this file from the restore list
within the 
> util/install_modules/inst_common.sh script, and that
seems OK.
>
> Secondly, the restore process simply does a copy of the
backed up 
> directories over the top of the existing directories.
It doesn't 
> remove any existing files from the setup. E.g. In my
current config I 
> have queue-A and queue-B. In my backed up config I only
have queue-A 
> and I want to go back to that. When I do the restore,
queue-B does not 
> get deleted. I'm currently tweaking the inst_common.sh
script to 
> remove the existing queue related files automatically,
but I'm not 
> really sure whether there are other items that need to
be removed.
>
> Any help would be appreciated,
>
> Cheers,
>
> Mat
>
>  
>
>
>

-- 

Sun Microsystems GmbH         Marco Donauer
Dr.-Leo-Ritter-Str. 7         N1 Grid Engine Engineering
D-93049 Regensburg            Phone: +49 (0)941 3075-211 
(x60211)
Germany                       Fax: +49 (0)941 3075-222 
(x60222)
http://www.sun.com/gridwa
re
mailto:marco.donauersun.com
Sitz der Gesellschaft: Sun Microsystems GmbH, Sonnenallee 1,

D-85551 Kirchheim-Heimstetten
Amtsgericht Muenchen: HRB 161028
Geschaeftsfuehrer: Wolfgang Engels, Dr. Roland Boemer
Vorsitzender des Aufsichtsrates: Martin Haering 

------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

Marco,

I'm always using SGE6.1u2 for my tests, and I'm currently
using classic
spooling. 

Cheers,

Mat

-----Original Message-----
From: Marco.DonauerSun.COM [mailto:Marco.DonauerSun.COM]

Sent: 18 October 2007 11:20
To: usersgridengine.sunsource.net
Subject: Re: [GE users] Restore Configuration Problem

Hi Mat,

you are always using the same version of SGE? So your
backedup
configurations are form the same SGE release, I your case
6.1?
What kind of spooling are you using?

Regards,
Marco

Bradford, Matthew wrote:
>
> I'm attempting to look at different configurations of
SGE 6.1 to see 
> the effect that the different configurations have on
running a 
> standard set of jobs. I am using the backup and restore
functionality 
> to allow me to easily switch between the different
setups that I have.
> Unfortunately there appears to be a problem with
restoring the
configs.
>
> Firstly, the restore will restore the previously backed
up accounting 
> file. I've removed this file from the restore list
within the 
> util/install_modules/inst_common.sh script, and that
seems OK.
>
> Secondly, the restore process simply does a copy of the
backed up 
> directories over the top of the existing directories.
It doesn't 
> remove any existing files from the setup. E.g. In my
current config I 
> have queue-A and queue-B. In my backed up config I only
have queue-A 
> and I want to go back to that. When I do the restore,
queue-B does not

> get deleted. I'm currently tweaking the inst_common.sh
script to 
> remove the existing queue related files automatically,
but I'm not 
> really sure whether there are other items that need to
be removed.
>
> Any help would be appreciated,
>
> Cheers,
>
> Mat
>
>  
>
>
>

-- 

Sun Microsystems GmbH         Marco Donauer
Dr.-Leo-Ritter-Str. 7         N1 Grid Engine Engineering
D-93049 Regensburg            Phone: +49 (0)941 3075-211 
(x60211)
Germany                       Fax: +49 (0)941 3075-222 
(x60222)
http://www.sun.com/gridwa
re
mailto:marco.donauersun.com
Sitz der Gesellschaft: Sun Microsystems GmbH, Sonnenallee
1,
D-85551 Kirchheim-Heimstetten
Amtsgericht Muenchen: HRB 161028
Geschaeftsfuehrer: Wolfgang Engels, Dr. Roland Boemer
Vorsitzender des
Aufsichtsrates: Martin Haering 

------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

Mat,

I will investigate your problem. To make sure how you
processed your 
backup/restore.

1. Backup of cluster with queue A and B
2. Backup of cluster with queue A
3. switching between the 2 configs, but queue B does not
disappear.

Is this right?
So I guess the the restore of classic spooling will do some
wrong, 
that's right!
I will have a look on it!

regards,
Marco

Bradford, Matthew wrote:
> Marco,
>
> I'm always using SGE6.1u2 for my tests, and I'm
currently using classic
> spooling. 
>
> Cheers,
>
> Mat
>
> -----Original Message-----
> From: Marco.DonauerSun.COM
[mailto:Marco.DonauerSun.COM] 
> Sent: 18 October 2007 11:20
> To: usersgridengine.sunsource.net
> Subject: Re: [GE users] Restore Configuration Problem
>
> Hi Mat,
>
> you are always using the same version of SGE? So your
backedup
> configurations are form the same SGE release, I your
case 6.1?
> What kind of spooling are you using?
>
> Regards,
> Marco
>
> Bradford, Matthew wrote:
>   
>> I'm attempting to look at different configurations
of SGE 6.1 to see 
>> the effect that the different configurations have
on running a 
>> standard set of jobs. I am using the backup and
restore functionality 
>> to allow me to easily switch between the different
setups that I have.
>> Unfortunately there appears to be a problem with
restoring the
>>     
> configs.
>   
>> Firstly, the restore will restore the previously
backed up accounting 
>> file. I've removed this file from the restore list
within the 
>> util/install_modules/inst_common.sh script, and
that seems OK.
>>
>> Secondly, the restore process simply does a copy of
the backed up 
>> directories over the top of the existing
directories. It doesn't 
>> remove any existing files from the setup. E.g. In
my current config I 
>> have queue-A and queue-B. In my backed up config I
only have queue-A 
>> and I want to go back to that. When I do the
restore, queue-B does not
>>     
>
>   
>> get deleted. I'm currently tweaking the
inst_common.sh script to 
>> remove the existing queue related files
automatically, but I'm not 
>> really sure whether there are other items that need
to be removed.
>>
>> Any help would be appreciated,
>>
>> Cheers,
>>
>> Mat
>>
>>  
>>
>>
>>
>>     
>
>   

-- 

Sun Microsystems GmbH         Marco Donauer
Dr.-Leo-Ritter-Str. 7         N1 Grid Engine Engineering
D-93049 Regensburg            Phone: +49 (0)941 3075-211 
(x60211)
Germany                       Fax: +49 (0)941 3075-222 
(x60222)
http://www.sun.com/gridwa
re
mailto:marco.donauersun.com
Sitz der Gesellschaft: Sun Microsystems GmbH, Sonnenallee 1,

D-85551 Kirchheim-Heimstetten
Amtsgericht Muenchen: HRB 161028
Geschaeftsfuehrer: Wolfgang Engels, Dr. Roland Boemer
Vorsitzender des Aufsichtsrates: Martin Haering 

------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

Marco,

Your summary is correct.

Cheers,

Mat 

-----Original Message-----
From: Marco.DonauerSun.COM [mailto:Marco.DonauerSun.COM]

Sent: 18 October 2007 11:33
To: usersgridengine.sunsource.net
Subject: Re: [GE users] Restore Configuration Problem

Mat,

I will investigate your problem. To make sure how you
processed your
backup/restore.

1. Backup of cluster with queue A and B
2. Backup of cluster with queue A
3. switching between the 2 configs, but queue B does not
disappear.

Is this right?
So I guess the the restore of classic spooling will do some
wrong,
that's right!
I will have a look on it!

regards,
Marco

Bradford, Matthew wrote:
> Marco,
>
> I'm always using SGE6.1u2 for my tests, and I'm
currently using 
> classic spooling.
>
> Cheers,
>
> Mat
>
> -----Original Message-----
> From: Marco.DonauerSun.COM
[mailto:Marco.DonauerSun.COM]
> Sent: 18 October 2007 11:20
> To: usersgridengine.sunsource.net
> Subject: Re: [GE users] Restore Configuration Problem
>
> Hi Mat,
>
> you are always using the same version of SGE? So your
backedup 
> configurations are form the same SGE release, I your
case 6.1?
> What kind of spooling are you using?
>
> Regards,
> Marco
>
> Bradford, Matthew wrote:
>   
>> I'm attempting to look at different configurations
of SGE 6.1 to see 
>> the effect that the different configurations have
on running a 
>> standard set of jobs. I am using the backup and
restore functionality

>> to allow me to easily switch between the different
setups that I
have.
>> Unfortunately there appears to be a problem with
restoring the
>>     
> configs.
>   
>> Firstly, the restore will restore the previously
backed up accounting

>> file. I've removed this file from the restore list
within the 
>> util/install_modules/inst_common.sh script, and
that seems OK.
>>
>> Secondly, the restore process simply does a copy of
the backed up 
>> directories over the top of the existing
directories. It doesn't 
>> remove any existing files from the setup. E.g. In
my current config I

>> have queue-A and queue-B. In my backed up config I
only have queue-A 
>> and I want to go back to that. When I do the
restore, queue-B does 
>> not
>>     
>
>   
>> get deleted. I'm currently tweaking the
inst_common.sh script to 
>> remove the existing queue related files
automatically, but I'm not 
>> really sure whether there are other items that need
to be removed.
>>
>> Any help would be appreciated,
>>
>> Cheers,
>>
>> Mat
>>
>>  
>>
>>
>>
>>     
>
>   

-- 

Sun Microsystems GmbH         Marco Donauer
Dr.-Leo-Ritter-Str. 7         N1 Grid Engine Engineering
D-93049 Regensburg            Phone: +49 (0)941 3075-211 
(x60211)
Germany                       Fax: +49 (0)941 3075-222 
(x60222)
http://www.sun.com/gridwa
re
mailto:marco.donauersun.com
Sitz der Gesellschaft: Sun Microsystems GmbH, Sonnenallee
1,
D-85551 Kirchheim-Heimstetten
Amtsgericht Muenchen: HRB 161028
Geschaeftsfuehrer: Wolfgang Engels, Dr. Roland Boemer
Vorsitzender des
Aufsichtsrates: Martin Haering 

------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

Mat,

you found a bug, I will file an issue. The restore of a
classic spooling 
cluster does not delete the old configuration.
The configuration, wich is filebase for classic spooling, is
only copied 
to the configuration directory.
The configuration for your second queue won't be deleted.
The result is, 
that the second queue is still configured.
Only the classic spooling is concerned by this bug.  It is
no problem to 
delete the queue manually!

Regards,
Marco

Bradford, Matthew wrote:
> Marco,
>
> Your summary is correct.
>
> Cheers,
>
> Mat 
>
> -----Original Message-----
> From: Marco.DonauerSun.COM
[mailto:Marco.DonauerSun.COM] 
> Sent: 18 October 2007 11:33
> To: usersgridengine.sunsource.net
> Subject: Re: [GE users] Restore Configuration Problem
>
> Mat,
>
> I will investigate your problem. To make sure how you
processed your
> backup/restore.
>
> 1. Backup of cluster with queue A and B
> 2. Backup of cluster with queue A
> 3. switching between the 2 configs, but queue B does
not disappear.
>
> Is this right?
> So I guess the the restore of classic spooling will do
some wrong,
> that's right!
> I will have a look on it!
>
> regards,
> Marco
>
> Bradford, Matthew wrote:
>   
>> Marco,
>>
>> I'm always using SGE6.1u2 for my tests, and I'm
currently using 
>> classic spooling.
>>
>> Cheers,
>>
>> Mat
>>
>> -----Original Message-----
>> From: Marco.DonauerSun.COM
[mailto:Marco.DonauerSun.COM]
>> Sent: 18 October 2007 11:20
>> To: usersgridengine.sunsource.net
>> Subject: Re: [GE users] Restore Configuration
Problem
>>
>> Hi Mat,
>>
>> you are always using the same version of SGE? So
your backedup 
>> configurations are form the same SGE release, I
your case 6.1?
>> What kind of spooling are you using?
>>
>> Regards,
>> Marco
>>
>> Bradford, Matthew wrote:
>>   
>>     
>>> I'm attempting to look at different
configurations of SGE 6.1 to see 
>>> the effect that the different configurations
have on running a 
>>> standard set of jobs. I am using the backup and
restore functionality
>>>       
>
>   
>>> to allow me to easily switch between the
different setups that I
>>>       
> have.
>   
>>> Unfortunately there appears to be a problem
with restoring the
>>>     
>>>       
>> configs.
>>   
>>     
>>> Firstly, the restore will restore the
previously backed up accounting
>>>       
>
>   
>>> file. I've removed this file from the restore
list within the 
>>> util/install_modules/inst_common.sh script, and
that seems OK.
>>>
>>> Secondly, the restore process simply does a
copy of the backed up 
>>> directories over the top of the existing
directories. It doesn't 
>>> remove any existing files from the setup. E.g.
In my current config I
>>>       
>
>   
>>> have queue-A and queue-B. In my backed up
config I only have queue-A 
>>> and I want to go back to that. When I do the
restore, queue-B does 
>>> not
>>>     
>>>       
>>   
>>     
>>> get deleted. I'm currently tweaking the
inst_common.sh script to 
>>> remove the existing queue related files
automatically, but I'm not 
>>> really sure whether there are other items that
need to be removed.
>>>
>>> Any help would be appreciated,
>>>
>>> Cheers,
>>>
>>> Mat
>>>
>>>  
>>>
>>>
>>>
>>>     
>>>       
>>   
>>     
>
>   

-- 

Sun Microsystems GmbH         Marco Donauer
Dr.-Leo-Ritter-Str. 7         N1 Grid Engine Engineering
D-93049 Regensburg            Phone: +49 (0)941 3075-211 
(x60211)
Germany                       Fax: +49 (0)941 3075-222 
(x60222)
http://www.sun.com/gridwa
re
mailto:marco.donauersun.com
Sitz der Gesellschaft: Sun Microsystems GmbH, Sonnenallee 1,

D-85551 Kirchheim-Heimstetten
Amtsgericht Muenchen: HRB 161028
Geschaeftsfuehrer: Wolfgang Engels, Dr. Roland Boemer
Vorsitzender des Aufsichtsrates: Martin Haering 

------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

Bradford, Matthew wrote:
> 
> 
> I'm attempting to look at different configurations of
SGE 6.1 to see the 
> effect that the different configurations have on
running a standard set 
> of jobs. I am using the backup and restore
functionality to allow me to 
> easily switch between the different setups that I have.


Matt, the $SGE_ROOT directory might be a good way for your
to change 
between configurations.

On your system, there should be an SGE_ROOT directory in
/usr/local/sge6

How about making a copy of that, let's say we have:

/usr/local/sge6-A
/usr/local/sge6-B

where sge6N-A is the original configuration.
You could rsync sge6N-A  to sge6N-B

Then make a symbolic link which is
/usr/local/sge6  --> sge6-B
OR /usr/local/sge6  ---> sge6-A

Restart the sgemaster and sgeexecd each time you want to
flip between them.

I know this isn't a great solution, but it will work for
testing like this.

Alternatively, you could have two directories, and change
the SGE_ROOT 
environment variable, though you would have to make sure the
init 
scripts pick it up also.













------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

John,

It's OK for the configurations, but you lose the single
accounting file.
Ideally, I'd like to keep the same file for looking at
results ...then
again, it may be simpler for accessing the results from the
different
configurations. It means that I won't confuse results
obtained from
different configurations, as they are stored in separate
locations,
along with the configurations from which they were
generated. If I do
want to look at all the results together, I can cat the
accounting files
together.

I think it may be the solution.

Cheers,

Mat

-----Original Message-----
From: John Hearns [mailto:john.hearnsstreamline-computing.com] 
Sent: 18 October 2007 15:00
To: usersgridengine.sunsource.net
Subject: Re: [GE users] Restore Configuration Problem

Bradford, Matthew wrote:
> 
> 
> I'm attempting to look at different configurations of
SGE 6.1 to see 
> the effect that the different configurations have on
running a 
> standard set of jobs. I am using the backup and restore
functionality 
> to allow me to easily switch between the different
setups that I have.

Matt, the $SGE_ROOT directory might be a good way for your
to change
between configurations.

On your system, there should be an SGE_ROOT directory in
/usr/local/sge6

How about making a copy of that, let's say we have:

/usr/local/sge6-A
/usr/local/sge6-B

where sge6N-A is the original configuration.
You could rsync sge6N-A  to sge6N-B

Then make a symbolic link which is
/usr/local/sge6  --> sge6-B
OR /usr/local/sge6  ---> sge6-A

Restart the sgemaster and sgeexecd each time you want to
flip between
them.

I know this isn't a great solution, but it will work for
testing like
this.

Alternatively, you could have two directories, and change
the SGE_ROOT
environment variable, though you would have to make sure the
init
scripts pick it up also.













------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net

------------------------------------------------------------
---------
To unsubscribe, e-mail: users-unsubscribegridengine.sunsource.net
For additional commands, e-mail: users-helpgridengine.sunsource.net