List Info

Thread: degraded RAID performance after OS upgrade, and drives added.




degraded RAID performance after OS upgrade, and drives added.
user name
2006-11-30 02:18:00
We updated to 6.1 this weekend and added 3 300gb drives to
the  
external raid cabinet, they were to go on a seprate
controller but  
the server happens to have a few other boxes on top making
it  
impossible at that time, so we put the 3x300  (RAID5) ,
upgraded the  
OS and  performance is very poor. When I run systat I see
upward of  
300 tps on the problematic array (da2) and under systat
-vmstat :

Disks   da0   da1   da2 pass0 pass1 pass2
KB/t     0.00  0.00 15.00  0.00  0.00  0.00
tps       0          0      341     0     0     0
MB/s   0.00  0.00  4.99  0.00  0.00  0.00
% busy    0     0    95     0     0     0

the busy percentage is consistenly over 90% sometimes over
100%. I'm  
not sure where to go next with providing info for someone to
look at  
or testing to run..

camcontrol devlist
<COMPAQ RAID 1  VOLUME OK>         at scbus0 target 0
lun 0 (da0,pass0)
<COMPAQ RAID 0  VOLUME OK>         at scbus0 target 1
lun 0 (da1,pass1)
<COMPAQ RAID 5  VOLUME OK>         at scbus0 target 2
lun 0 (da2,pass2)

out of dmesg:

ciss0: <Compaq Smart Array 5i> port 0x3000-0x30ff mem 

0xf05c0000-0xf05fffff,0xf04f0000-0xf04f3fff irq 30 at device
3.0 on
pci1
ciss0: [GIANT-LOCKED]


da0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 1  VOLUME OK> Fixed Direct Access
SCSI-0 device
da0: 135.168MB/s transfers
da0: 140006MB (286734240 512 byte sectors: 255H 32S/T
35139C)
da1 at ciss0 bus 0 target 1 lun 0
da1: <COMPAQ RAID 0  VOLUME OK> Fixed Direct Access
SCSI-0 device
da1: 135.168MB/s transfers
da1: 140006MB (286734240 512 byte sectors: 255H 32S/T
35139C)
da2 at ciss0 bus 0 target 2 lun 0
da2: <COMPAQ RAID 5  VOLUME OK> Fixed Direct Access
SCSI-0 device
da2: 135.168MB/s transfers
da2: 572195MB (1171856412 512 byte sectors: 255H 63S/T
65535C)



dmesg
Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991,
1992, 1993, 1994
         The Regents of the University of California. All
rights  
reserved.
FreeBSD 6.1-RELEASE-p10 #0: Sat Nov 25 15:52:17 PST 2006
     rootmail.vfs.com:/usr/src/sys/i386/compile/SMP
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2786.87-MHz 686-class
CPU)
   Origin = "GenuineIntel"  Id = 0xf25  Stepping =
5
    
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,AP
IC,SEP,MTRR,PGE 
,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HT
T,TM,PBE>
   Features2=0x4400<CNTX-ID,<b14>>
   Logical CPUs per core: 2
real memory  = 2147459072 (2047 MB)
avail memory = 2096439296 (1999 MB)
ACPI APIC Table: <COMPAQ 00000083>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  1
cpu2 (AP): APIC ID:  6
cpu3 (AP): APIC ID:  7
MADT: Forcing active-low polarity and level trigger for SCI
ioapic0 <Version 1.1> irqs 0-15 on motherboard
ioapic1 <Version 1.1> irqs 16-31 on motherboard
ioapic2 <Version 1.1> irqs 32-47 on motherboard
ioapic3 <Version 1.1> irqs 48-63 on motherboard
kbd1 at kbdmux0
acpi0: <COMPAQ P29> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz
quality 1000
acpi_timer0: <32-bit timer at 3.579545MHz> port
0x920-0x923 on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <display, VGA> at device 3.0 (no driver
attached)
pci0: <base peripheral> at device 4.0 (no driver
attached)
pci0: <base peripheral> at device 4.2 (no driver
attached)
isab0: <PCI-ISA bridge> at device 15.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <ServerWorks CSB5 UDMA100 controller> port  
0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x2000-0x200f at device
15.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
ohci0: <OHCI (generic) USB controller> mem
0xeeef0000-0xeeef0fff irq  
7 at device 15.2 on pci0
ohci0: [GIANT-LOCKED]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00,
addr 1
uhub0: 4 ports with 4 removable, self powered
pcib1: <ACPI Host-PCI bridge> on acpi0
pci1: <ACPI PCI bus> on pcib1
ciss0: <Compaq Smart Array 5i> port 0x3000-0x30ff mem 

0xf05c0000-0xf05fffff,0xf04f0000-0xf04f3fff irq 30 at device
3.0 on pci1
ciss0: [GIANT-LOCKED]
pcib2: <ACPI Host-PCI bridge> on acpi0
pci2: <ACPI PCI bus> on pcib2
bge0: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev.
0x1002> mem  
0xf06f0000-0xf06fffff irq 29 at device 1.0 on pci2
miibus0: <MII bus> on bge0
brgphy0: <BCM5703 10/100/1000baseTX PHY> on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX,
1000baseTX,  
1000baseTX-FDX, auto
bge0: Ethernet address: 00:11:0a:9e:2f:49
bge1: <Broadcom BCM5703 Gigabit Ethernet, ASIC rev.
0x1002> mem  
0xf06e0000-0xf06effff irq 31 at device 2.0 on pci2
miibus1: <MII bus> on bge1
brgphy1: <BCM5703 10/100/1000baseTX PHY> on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX,
1000baseTX,  
1000baseTX-FDX, auto
bge1: Ethernet address: 00:11:0a:9e:2f:48
pcib3: <ACPI Host-PCI bridge> on acpi0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI Host-PCI bridge> on acpi0
pci6: <ACPI PCI bus> on pcib4
pci6: <base peripheral, PCI hot-plug controller> at
device 30.0 (no  
driver attached)
acpi_tz0: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64
irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse, device ID 3
sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4
flags 0x10 on acpi0
sio0: type 16550A
fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5
irq 6 drq 2 on  
acpi0
fdc0: [FAST]
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem
0xc0000-0xc7fff,0xc8000-0xcbfff, 
0xcc000-0xcd7ff,0xee000-0xeffff on isa0
ppc0: parallel port not found.
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem
0xa0000-0xbffff on  
isa0
Timecounters tick every 1.000 msec
acd0: CDROM <COMPAQ CD-ROM SN-124/N104> at ata0-master
PIO4
SMP: AP CPU #2 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
da0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 1  VOLUME OK> Fixed Direct Access
SCSI-0 device
da0: 135.168MB/s transfers
da0: 140006MB (286734240 512 byte sectors: 255H 32S/T
35139C)
da1 at ciss0 bus 0 target 1 lun 0
da1: <COMPAQ RAID 0  VOLUME OK> Fixed Direct Access
SCSI-0 device
da1: 135.168MB/s transfers
da1: 140006MB (286734240 512 byte sectors: 255H 32S/T
35139C)
da2 at ciss0 bus 0 target 2 lun 0
da2: <COMPAQ RAID 5  VOLUME OK> Fixed Direct Access
SCSI-0 device
da2: 135.168MB/s transfers
da2: 572195MB (1171856412 512 byte sectors: 255H 63S/T
65535C)



_______________________________________________
freebsd-questionsfreebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-que
stions
To unsubscribe, send any mail to
"freebsd-questions-unsubscribefreebsd.org"
degraded RAID performance after OS upgrade, and drives added.
user name
2006-11-30 18:39:07
On Nov 29, 2006, at 6:18 PM, Derrick MacPherson wrote:
> We updated to 6.1 this weekend and added 3 300gb drives
to the  
> external raid cabinet, they were to go on a seprate
controller but  
> the server happens to have a few other boxes on top
making it  
> impossible at that time, so we put the 3x300  (RAID5) ,
upgraded  
> the OS and  performance is very poor. When I run systat
I see  
> upward of 300 tps on the problematic array (da2) and
under systat - 
> vmstat :

It's normal for RAID-5 to perform worse than a single
drive-- and  
sometimes it performs much worse, as in nearly an order of
magnitude  
slower, for the case of very small writes.  If you value
performance,  
choose another RAID level like RAID-0, RAID-1, or RAID-10.

-- 
-Chuck

_______________________________________________
freebsd-questionsfreebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-que
stions
To unsubscribe, send any mail to
"freebsd-questions-unsubscribefreebsd.org"
[1-2]

about | contact  Other archives ( Real Estate discussion Medical topics )