List Info

Thread: Re: mysql scaling questions




Re: mysql scaling questions
country flaguser name
United States
2007-12-30 07:18:31
Gergely CZUCZY wrote:
> On Sat, Dec 01, 2007 at 12:22:34PM -1000, Jeff Roberson
wrote:
>> On Sat, 1 Dec 2007, Gergely CZUCZY wrote:
>>
>>> On Sat, Dec 01, 2007 at 04:06:55PM -0500, Mike
Tancsa wrote:
>>>> At 03:56 PM 12/1/2007, Gergely CZUCZY
wrote:
>>>>> I don't quite understand the question.
It's the very same box, with
>>>>> a dualboot configuration.
>>>> Fire up the 3ware controller's RAID
management software and make sure the same write caching
strategy is set for FreeBSD and Linux. The
>>>> driver my default to different values.
>>>>
>>>> i.e. under "controller settings"
make sure "write cache" and "queuing"
are the same values for linux and freebsd.
>>> Let's get back to this on monday. I'm at home
now, and the
>>> box is at me workplace, still running a test (i
can't reboot it).
>> Also, can you verify with a read-only test to see
where it's at?  I have not tested writes with that many
threads.  I notice mysql goes much faster 
>> with a fresh table too.  So can you blow away and
recreate the sysbench tables and then do read-only?  If that
is much slower we'll know there is some 
>> configuration problem or similar.
> It will all be available here:
> http://phoemix.harm
less.hu/mysql/

Hi,

Sorry for the late reply, I was on vacation.  I have a
couple of 
comments about this:

* You are using some very old mysql versions and trying to
compare 
between diferent versions.  New minor releases in the 5.0
series had 
very different performance, and you really need to be using
at least 
5.0.45 (I didn't notice a performance change between 5.0.45
and 5.0.51 
but there was a big improvement in every release up to .45. 
In 
addition, versions older than (I think) .37 have serious
performance bugs).

I appreciate that you might be constrained by local
requirements, but 
it's really not meaningful to compare different mysql
versions if your 
goal is to study OS performance.

* What database engine are you using?  I have only tested
with innodb 
but maybe you are using myisam?  Please provide your exact
sysbench 
command lines.

* Compare to my config file here:

http:/
/people.freebsd.org/~kris/scaling/my.cnf

The default mysql config has very poor performance for
innodb (you need 
at least innodb_thread_concurrency = 0 to disable some mysql

brain-death).  Maybe tuning is required for myisam also.

* Also make sure you are using identical config settings on
the two systems.

* With the above, please compare read-only mode also (I
think Jeff 
already asked you about this but I didnt see a reply).  That
will allow 
us to calibrate what is going on.

Kris

_______________________________________________
freebsd-performancefreebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-p
erformance
To unsubscribe, send any mail to
"freebsd-performance-unsubscribefreebsd.org"

Re: mysql scaling questions
country flaguser name
Hungary
2007-12-30 07:24:51
ON SUN, DEC 30, 2007 AT 02:18:31PM +0100, KRIS KENNAWAY
WROTE:
> GERGELY CZUCZY WROTE:
> >ON SAT, DEC 01, 2007 AT 12:22:34PM -1000, JEFF
ROBERSON WROTE:
> >>ON SAT, 1 DEC 2007, GERGELY CZUCZY WROTE:
> >>
> >>>ON SAT, DEC 01, 2007 AT 04:06:55PM -0500,
MIKE TANCSA WROTE:
> >>>>AT 03:56 PM 12/1/2007, GERGELY CZUCZY
WROTE:
> >>>>>I DON'T QUITE UNDERSTAND THE
QUESTION. IT'S THE VERY SAME BOX, WITH
> >>>>>A DUALBOOT CONFIGURATION.
> >>>>FIRE UP THE 3WARE CONTROLLER'S RAID
MANAGEMENT SOFTWARE AND MAKE SURE THE SAME WRITE CACHING
STRATEGY IS SET FOR FREEBSD AND LINUX. 
> >>>>THE
> >>>>DRIVER MY DEFAULT TO DIFFERENT VALUES.
> >>>>
> >>>>I.E. UNDER "CONTROLLER
SETTINGS" MAKE SURE "WRITE CACHE" AND
"QUEUING" ARE THE SAME VALUES FOR LINUX AND
FREEBSD.
> >>>LET'S GET BACK TO THIS ON MONDAY. I'M AT
HOME NOW, AND THE
> >>>BOX IS AT ME WORKPLACE, STILL RUNNING A
TEST (I CAN'T REBOOT IT).
> >>ALSO, CAN YOU VERIFY WITH A READ-ONLY TEST TO
SEE WHERE IT'S AT?  I HAVE NOT TESTED WRITES WITH THAT MANY
THREADS.  I NOTICE MYSQL 
> >>GOES MUCH FASTER WITH A FRESH TABLE TOO.  SO
CAN YOU BLOW AWAY AND RECREATE THE SYSBENCH TABLES AND THEN
DO READ-ONLY?  IF THAT IS 
> >>MUCH SLOWER WE'LL KNOW THERE IS SOME
CONFIGURATION PROBLEM OR SIMILAR.
> >IT WILL ALL BE AVAILABLE HERE:
> >HTTP://PHOEMIX.HARMLESS.HU/MYSQL/
> 
> HI,
> 
> SORRY FOR THE LATE REPLY, I WAS ON VACATION.  I HAVE A
COUPLE OF COMMENTS ABOUT THIS:
> 
> * YOU ARE USING SOME VERY OLD MYSQL VERSIONS AND TRYING
TO COMPARE BETWEEN DIFERENT VERSIONS.  NEW MINOR RELEASES IN
THE 5.0 SERIES HAD 
> VERY DIFFERENT PERFORMANCE, AND YOU REALLY NEED TO BE
USING AT LEAST 5.0.45 (I DIDN'T NOTICE A PERFORMANCE CHANGE
BETWEEN 5.0.45 AND 
> 5.0.51 BUT THERE WAS A BIG IMPROVEMENT IN EVERY RELEASE
UP TO .45.  IN ADDITION, VERSIONS OLDER THAN (I THINK) .37
HAVE SERIOUS 
> PERFORMANCE BUGS).
> 
> I APPRECIATE THAT YOU MIGHT BE CONSTRAINED BY LOCAL
REQUIREMENTS, BUT IT'S REALLY NOT MEANINGFUL TO COMPARE
DIFFERENT MYSQL VERSIONS IF 
> YOUR GOAL IS TO STUDY OS PERFORMANCE.
IT'D BE A PITA TO INSTALL THE BOTH VERSIONS. MAYBE NOW, THAT
THE PORTS FREEZE IS OVER, I CAN
DO SOMETHING. BUT HONESTLY, EVERY MYSQL VERSION WAS FASTER
ON LINUX, THAN ENY ON FREEBSD,
EVEN THE .22 ONE WAS FASTER. WE START WORK ON JAN02, I WILL
SEE WHAT CAN I DO.

> 
> * WHAT DATABASE ENGINE ARE YOU USING?  I HAVE ONLY
TESTED WITH INNODB BUT MAYBE YOU ARE USING MYISAM?  PLEASE
PROVIDE YOUR EXACT 
> SYSBENCH COMMAND LINES.
MYISAM, OF COURSE. INNODB IS NOT ANY GOOD WITH REPLICATION,
AND WE NEED BACKUP.

> * COMPARE TO MY CONFIG FILE HERE:
> 
> HTTP://PEOPLE.FREEBSD.ORG/~KRIS/SCALING/MY.CNF
> 
> THE DEFAULT MYSQL CONFIG HAS VERY POOR PERFORMANCE FOR
INNODB (YOU NEED AT LEAST INNODB_THREAD_CONCURRENCY = 0 TO
DISABLE SOME MYSQL 
> BRAIN-DEATH).  MAYBE TUNING IS REQUIRED FOR MYISAM
ALSO.
> 
> * ALSO MAKE SURE YOU ARE USING IDENTICAL CONFIG
SETTINGS ON THE TWO SYSTEMS.
HTTP://PHOEMIX.HARMLESS.HU/MYSQL/ VERIFY YOURSELF. ONLY THE
PATHS ARE
UPDATED, BUT THE MAIN PARAMETERS ARE JUST THE SAME.

> * WITH THE ABOVE, PLEASE COMPARE READ-ONLY MODE ALSO (I
THINK JEFF ALREADY ASKED YOU ABOUT THIS BUT I DIDNT SEE A
REPLY).  THAT WILL 
> ALLOW US TO CALIBRATE WHAT IS GOING ON.
HTTP://PHOEMIX.HARMLESS.HU/MYSQL/RO-ALL.PNG
THE GRAPH IS MISTITLED AS READ-WRITE, BUT IT'S A READONLY
TEST.


SINCERELY,

GERGELY CZUCZY
MAILTO: GERGELY.CZUCZYHARMLESS.HU

-- 
WEENIES TEST. GENIUSES SOLVE PROBLEMS THAT ARISE.
[1-2]

about | contact  Other archives ( Real Estate discussion Medical topics )