List Info

Thread: 32Gb and no clue




32Gb and no clue
country flaguser name
United States
2007-08-14 11:03:28
How would you tune a 32Gb RAM box running one Cosmo instance
and MySQL?

Say, hypothetically, you had a big honking server you wanted
to deploy a 
large instance of Cosmo onto it; maybe call it Chandler
Hub.

There's a whole art to tuning Java VMs; I am admittedly
deficient in 
this art.  I can spend weeks/months googling for the finer
points, but I 
was hoping to get some insight here.

Of course, the settings are also JVM-dependent; we're
intending a 
JRockit deployment, so I'll use their names for things.

I assume we need to decide on the following parameters for
Hub:
* Minimum heap size (initial probably set maximum heap)
* Maximum heap size (has a 1Gb max out of the box?)
* Nursery size (less than max heap of course>
* -server (decision made, I assume)
* -Xverbose:memory (show paging)
* -Xgcpause (document collection pause durations)
* Garbage thread priority (parallel, throughput, gencon?)
* Thread stack size (defaults to 320KB)
* Any other garbage collection settings
* Any other general settings?

My understanding is that setting the heap very large (20Gb)
will result 
in long pauses during collection, which we want to avoid. 
(Java is 
probably going to be conservative in its memory use, with
most of the 
surplus going to MySQL.)

We apparently could also go with a dynamic GC setting by
setting a 
"-Xpausetarget" of a specific time say 300ms.

Of course many of these options are interdependent.

On doing a little reading, I guess I remember more about
this than I 
thought, but are there any books people have read with good
tuning sections?

Back in cosmo-demo days, we used:

-Xns:500m -Xms:700m -Xmx:700m -server -Xgcpause -Xgcreport
-Xverbose:memory

It just occurred to me that we could do another "Java
Runtime Analyzer" 
run; we did that back in the cosmo-demo days to try to track
down some 
performance bugs, but maybe there's some GC/heap info in it
too.

There's another thread needed about MySQL tuning, but that
one might be 
a little more straightforward.

-- Jared
_______________________________________________
cosmo-dev mailing list
cosmo-devlists.osafoundation.org
http://lists.osafoundation.org/mailman/listinfo/cosmo-d
ev

Re: 32Gb and no clue
country flaguser name
United States
2007-08-14 12:15:17
On Aug 14, 2007, at 12:03 PM, Jared Rhine wrote:

> How would you tune a 32Gb RAM box running one Cosmo
instance and MySQL?

<snip>

> It just occurred to me that we could do another
"Java Runtime 
> Analyzer" run; we did that back in the cosmo-demo
days to try to track 
> down some performance bugs, but maybe there's some
GC/heap info in it 
> too.

The answer from all the research I did way back when Java
and Tomcat 
were new to OSAF was this:  you can tweak all you want but
without 
having the analyzer running it will be nothing but
dart-tosses and 
chicken-runs.

I would stick with the values we last used and hook up the
analyzer and 
start looking at trends.

> There's another thread needed about MySQL tuning, but
that one might 
> be a little more straightforward.

Now this is a bit simpler, but only a bit - because while
the Cosmo 
data is stored in MySQL, I'm willing to bet the usage
patterns for each 
table has not been determined and index/query plans have not
been 
determined.

The answer to this will also be the same as above - let's
hook up a 
runtime stats collector and start flinging large test runs
at it.  We 
may find that more indexes are needed or some of the larger
tables may 
need performance tweaks (or in database lingo: normalization
and 
aggregation - we are probably at 2nd normal form right now
with an eye 
towards 3rd)

---
Bear

Build and Release Engineer
Open Source Applications Foundation (OSAF)
bearosafoundation.org
http://www.osafoundation
.org

bearcode-bear.com
http://code-bear.com

PGP Fingerprint = 9996 719F 973D B11B E111  D770 9331 E822
40B3 CD29



_______________________________________________
cosmo-dev mailing list
cosmo-devlists.osafoundation.org
http://lists.osafoundation.org/mailman/listinfo/cosmo-d
ev

Re: 32Gb and no clue
user name
2007-08-14 13:05:54
On 8/14/07, Jared Rhine <jaredwordzoo.com> wrote:
> How would you tune a 32Gb RAM box running one Cosmo
instance and MySQL?

to be honest, i still can't answer this question
intelligently. jvm
tuning makes my head spin. bkirsch learned a lot about it
last time
around. i seem to recall him sending a message or two
discussing what
he found. probably worth digging those out of the archives.
_______________________________________________
cosmo-dev mailing list
cosmo-devlists.osafoundation.org
http://lists.osafoundation.org/mailman/listinfo/cosmo-d
ev

Re: 32Gb and no clue
country flaguser name
United States
2007-08-14 15:24:17
Jared Rhine wrote:
> Back in cosmo-demo days, we used:
>
> -Xns:500m -Xms:700m -Xmx:700m -server -Xgcpause
-Xgcreport 
> -Xverbose:memory

I would start out by doubling (or tripling) these numbers. 
I'm not sure 
how much can be gained from tuning the other parameters
until we get a 
really high load on the server.

-Randy
_______________________________________________
cosmo-dev mailing list
cosmo-devlists.osafoundation.org
http://lists.osafoundation.org/mailman/listinfo/cosmo-d
ev

[1-4]

about | contact  Other archives ( Real Estate discussion Medical topics )