Re: High volume (200k+ cached daily) questions

Tim Palmer wrote:
> I wasn't there when the primary event happened (db
connects failing 
> regularly), but from what I heard, CPU and memory
utilization were fine 
> - the problem was disk I/O. Don't have the numbers,
however.
> 
> 100 db connects per second (or a little more) is where
mysql topped out. 
> Each connection is fairly large query, generally
requiring database 
> reads. My boss is pretty proficient in mysql, and
general optimization. 
> I don't know exactly what he did for tuning, but he
certainly would have 
> worked with connection pooling, InnoDB settings and
anything else he 
> could think of.

Hmm, 100 queries per second seem to be a rather modest load.
We're
running maia for 14,000 users and recently had to split the
bayes db off
to a separate server - a temporary move while we shop for
bigger hardware.

The bayes server is already a fairly busy server with bb
monitoring
duties, time server and smtp relay. The average db activity
on the bayes
db server since last december is 224 qps, with peaks of 1000
or so observed.

The old db server with the rest of the maia db is averaging
about 170
qps since december, with peaks near 1000 qps observed.

Just for reference here are the server specs:

old db server -
-------------
HP DL580 G2
4 * 3 Ghz Xeon/512k L1 cache
8 GB RAM
400 GB hardware Raid 5
SLES 9 32 bit

new db server -
------------
HP DL580 G3
4 * 3 Ghz Xeon/2MB L1 cache
16 GB RAM
400 GB hardware raid 10
SLES 10 64 bit
_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

Joel,

400 gb array,  are you using SATA hds?  If so what SATA
hardware raid 
controller are you using under SUSE 10?


Todd




----- Original Message ----- 
From: "joel" <joelmainphrame.com>
To: <maia-usersrenaissoft.com>
Sent: Tuesday, March 04, 2008 10:51 AM
Subject: Re: [Maia-users] High volume (200k+ cached daily)
questions


> Tim Palmer wrote:
>> I wasn't there when the primary event happened (db
connects failing
>> regularly), but from what I heard, CPU and memory
utilization were fine
>> - the problem was disk I/O. Don't have the numbers,
however.
>>
>> 100 db connects per second (or a little more) is
where mysql topped out.
>> Each connection is fairly large query, generally
requiring database
>> reads. My boss is pretty proficient in mysql, and
general optimization.
>> I don't know exactly what he did for tuning, but he
certainly would have
>> worked with connection pooling, InnoDB settings and
anything else he
>> could think of.
>
> Hmm, 100 queries per second seem to be a rather modest
load. We're
> running maia for 14,000 users and recently had to split
the bayes db off
> to a separate server - a temporary move while we shop
for bigger hardware.
>
> The bayes server is already a fairly busy server with
bb monitoring
> duties, time server and smtp relay. The average db
activity on the bayes
> db server since last december is 224 qps, with peaks of
1000 or so 
> observed.
>
> The old db server with the rest of the maia db is
averaging about 170
> qps since december, with peaks near 1000 qps observed.
>
> Just for reference here are the server specs:
>
> old db server -
> -------------
> HP DL580 G2
> 4 * 3 Ghz Xeon/512k L1 cache
> 8 GB RAM
> 400 GB hardware Raid 5
> SLES 9 32 bit
>
> new db server -
> ------------
> HP DL580 G3
> 4 * 3 Ghz Xeon/2MB L1 cache
> 16 GB RAM
> 400 GB hardware raid 10
> SLES 10 64 bit
> _______________________________________________
> Maia-users mailing list
> Maia-usersrenaissoft.com
> http://www.renaissoft.com/mailman/listinfo/maia-users
> 

_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users