[SunHELP] High Wait I/O( Average SAR Value %wio 25 to 35%)
BINOY P.V
binoypv at hotmail.com
Sat Dec 20 01:22:03 CST 2003
Dear All, We are facing High Wait I/O(SAR %wio 25 to 35% ) in our
Database server running solaris 8 with oracle8i. Dbase server is
SunFire4800 with 12gb RAM,750MHZ*8CPU with 20gb swap space. We are using
Veritas Volume Manger 3.1 and veritas Filesystem Manger3.4. Ours is a SAN
setup with 4T3's (each T3 is 36gb*9HDD) we are using RAID (0+1) Striped
at hardware level and Mirrored at Volume Manager level.
Can anyone help us resolve the issue.
Attached the SAR,VMSTAT,IOSTAT Values
Thanks and Regards
Binoy
IOSTAT AT Differnt time
Extended device statistics-10:45
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t6d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t2d1
26.0 193.8 215.8 1854.6 0.0 0.8 0.0 3.5 0 34 c1t2d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c2t2d1
31.0 233.8 503.6 3473.3 0.0 0.7 0.0 2.7 0 32 c2t2d0
18.0 865.3 143.9 10112.1 0.0 4.5 0.0 5.1 0 68 c2t4d0
25.0 725.4 199.8 6262.1 0.0 7.5 0.0 10.0 0 77 c1t4d0
extended device statistics-11:30
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
1.0 0.0 1.0 0.0 0.0 0.0 0.0 11.6 0 1 c0t0d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t6d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t2d1
45.0 94.0 775.9 1055.8 0.0 0.7 0.0 5.0 0 25 c1t2d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c2t2d1
288.0 97.0 2615.6 1177.3 0.0 1.5 0.0 4.0 0 80 c2t2d0
37.0 72.0 439.9 817.9 0.0 0.5 0.0 4.6 0 28 c2t4d0
15.0 68.0 120.0 718.9 0.0 0.3 0.0 4.0 0 23 c1t4d0
extended device statistics-11:45
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t6d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t2d1
33.0 54.0 264.0 528.0 0.0 0.5 0.0 5.6 0 29 c1t2d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c2t2d1
33.0 53.0 552.0 552.5 0.0 0.5 0.0 5.8 0 27 c2t2d0
57.0 39.0 456.0 422.5 0.0 0.6 0.0 6.3 0 41 c2t4d0
76.0 37.0 911.9 355.5 0.0 1.0 0.0 8.5 0 53 c1t4d0
extended device statistics-5:15
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 1.0 0.0 8.0 0.0 0.0 0.0 7.4 0 1 c0t0d0
0.0 1.0 0.0 8.0 0.0 0.0 0.0 7.2 0 1 c0t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t6d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t2d1
1.0 11.0 8.0 152.0 0.0 0.0 0.0 2.7 0 3 c1t2d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c2t2d1
2.0 12.0 16.0 192.5 0.0 0.0 0.0 2.3 0 3 c2t2d0
375.0 15.0 4504.0 207.5 5.3 25.5 13.6 65.3 16 60 c2t4d0
661.0 22.0 7143.9 247.0 191.8 64.0 280.8 93.7 100 100 c1t4d0
extended device statistics-5:15
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t6d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t2d1
124.7 61.8 1402.1 898.8 1.3 16.5 6.8 88.3 13 45 c1t2d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c2t2d1
40.4 73.0 422.4 1353.8 0.0 0.9 0.0 7.8 0 25 c2t2d0
96.6 153.9 1042.6 1977.4 0.1 4.8 0.3 19.0 1 41 c2t4d0
380.9 118.0 3739.0 1109.5 129.0 35.9 258.7 72.0 52 82 c1t4d0
extended device statistics-5:30
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t6d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t2d1
42.0 98.0 983.8 1679.7 0.0 1.3 0.0 9.6 0 40 c1t2d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c2t2d1
80.0 99.0 991.8 1728.7 0.0 2.0 0.0 11.2 0 40 c2t2d0
322.0 84.0 3495.5 1440.8 0.2 12.1 0.5 29.7 3 84 c2t4d0
79.0 83.0 799.9 1308.3 0.0 1.8 0.0 11.1 0 48 c1t4d0
extended device statistics-5:30
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 24.0 0.0 180.0 0.0 4.5 0.0 186.7 0 11 c0t0d0
0.0 27.0 0.0 204.0 0.0 4.2 0.0 157.1 0 11 c0t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t6d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t2d1
49.0 255.1 424.1 2928.6 0.0 2.1 0.0 6.8 0 60 c1t2d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c2t2d1
64.0 263.1 624.1 3252.7 0.0 2.2 0.0 6.6 0 60 c2t2d0
100.0 274.9 1455.7 5421.4 0.0 2.2 0.0 6.0 0 65 c2t4d0
60.0 179.0 607.9 1894.6 0.0 1.5 0.0 6.3 0 52 c1t4d0
extended device statistics-5:30
r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t0d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t1d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c0t6d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c1t2d1
51.0 410.3 800.7 4083.5 0.0 2.8 0.0 6.1 0 66 c1t2d0
0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c2t2d1
50.0 471.4 536.5 6588.6 0.0 2.7 0.0 5.1 0 67 c2t2d0
104.1 814.7 1385.2 12360.5 0.0 5.1 0.0 5.6 0 88 c2t4d0
130.1 617.5 1273.1 5463.6 0.0 9.4 0.0 12.5 0 89 c1t4d0
VMSTAT
DB-12:00
procs memory page disk faults cpu
r b w swap free re mf pi po fr de sr s0 s1 s6 sd in sy cs us sy
id
0 1 0 28740880 7853640 594 2145 1492 6 6 0 0 3 2 0 0 276 1410 1680 9 7
84
0 1 0 27809432 7232200 1549 5643 2992 0 0 0 0 0 0 0 0 7342 19378 12334 20 19
61
0 3 0 27811448 7233600 1971 4719 3312 0 0 0 0 0 0 0 0 7764 18108 12893 17 13
70
0 0 0 27811152 7233392 2169 9627 3272 0 0 0 0 0 0 0 0 9231 20717 16811 21 23
56
0 0 0 27813432 7235232 2885 5805 4208 0 0 0 0 0 0 0 0 6830 19637 10759 20 15
64
0 1 0 27811736 7233768 2398 5581 5624 0 0 0 0 0 0 0 0 7883 18294 13387 22 19
59
0 1 0 27812064 7234064 2222 8801 5120 0 0 0 0 0 0 0 0 8705 21079 15172 24 21
54
1 1 0 27813008 7234816 2370 3581 3744 0 0 0 0 0 0 0 0 7721 21814 12951 28 18
55
0 4 0 27813232 7235040 2066 2831 3888 0 0 0 0 0 0 0 0 6409 14972 10275 15 16
69
0 5 0 27809600 7232200 2016 5956 7816 0 0 0 0 0 0 0 0 7430 19951 12612 20 20
60
sib-db at 2:30
procs memory page disk faults cpu
r b w swap free re mf pi po fr de sr s0 s1 s6 sd in sy cs us sy
id
0 1 0 28736584 7850784 596 2157 1497 6 6 0 0 3 2 0 0 305 1476 1721 9 7
83
0 1 0 27905032 7304920 1114 3960 816 0 0 0 0 2 2 0 0 5813 12982 8605 10 12
78
1 0 0 27905768 7305352 5476 3512 944 0 0 0 0 0 0 0 0 5836 11414 9064 15 15
70
0 2 0 27906640 7306032 5245 4401 1264 0 0 0 0 0 0 0 0 5508 11049 7901 14 13
73
0 0 0 27905440 7305072 5086 3455 2192 0 0 0 0 0 0 0 0 5614 10882 8418 16 12
71
0 0 0 27903528 7303432 5032 3964 600 0 0 0 0 0 0 0 0 5329 12837 7852 16 15
69
0 0 0 27904440 7304312 5170 6029 688 0 0 0 0 0 0 0 0 6480 22637 14635 18 24
58
0 1 0 27906736 7306176 4688 2817 600 0 0 0 0 0 0 0 0 5178 13734 7060 17 19
63
0 0 0 27906240 7305608 5218 3393 1416 0 0 0 0 0 0 0 0 5911 15737 8303 17 18
65
1 0 0 27902256 7303720 4708 5399 1376 0 0 0 0 0 0 0 0 7153 17682 11674 23 21
56
SAR VALUE
SunOS sib-db 5.8 Generic_108528-19 sun4u 11/18/03
10:33:37 %usr %sys %wio %idle
10:33:38 12 15 13 60
10:33:39 17 18 30 36
10:33:40 20 25 43 13
10:33:41 13 12 45 31
10:33:42 20 14 33 34
10:33:43 17 11 43 30
10:33:44 19 7 44 31
10:33:46 7 14 34 46
10:33:47 10 12 37 42
10:33:48 12 16 19 54
Average 15 14 34 37
SunOS sib-db 5.8 Generic_108528-19 sun4u 11/18/03
11:22:35 %usr %sys %wio %idle
11:22:36 21 24 22 32
11:22:37 30 28 14 28
11:22:38 23 10 17 50
11:22:39 21 10 27 42
11:22:40 19 13 16 52
11:22:41 21 12 27 41
11:22:42 19 11 27 43
11:22:43 18 15 18 49
11:22:44 23 23 16 39
11:22:45 23 16 15 47
Average 22 16 20 42
SunOS sib-db 5.8 Generic_108528-19 sun4u 11/18/03
11:24:04 %usr %sys %wio %idle
11:24:05 15 17 30 37
11:24:06 23 29 13 35
11:24:07 24 31 12 33
11:24:08 12 12 23 53
11:24:09 13 17 26 44
11:24:10 12 15 29 44
11:24:11 17 17 14 52
11:24:12 12 11 24 54
11:24:13 13 19 22 46
11:24:14 13 17 17 53
Average 15 18 21 45
SunOS sib-db 5.8 Generic_108528-19 sun4u 11/18/03
11:40:22 %usr %sys %wio %idle
11:40:23 13 18 19 50
11:40:24 16 20 18 47
11:40:25 10 16 12 62
11:40:26 10 14 13 63
11:40:27 10 13 13 65
11:40:28 15 19 17 48
11:40:29 17 21 32 30
11:40:30 19 22 28 31
11:40:31 20 20 24 37
11:40:32 19 31 24 27
Average 15 19 20 46
SunOS sib-db 5.8 Generic_108528-19 sun4u 11/18/03
15:12:12 %usr %sys %wio %idle
15:12:13 45 22 22 12
15:12:14 55 23 17 5
15:12:15 40 20 29 12
15:12:16 31 22 39 8
15:12:17 25 23 50 2
15:12:18 29 20 43 8
15:12:19 32 24 33 11
15:12:20 42 26 19 13
15:12:21 40 12 26 22
15:12:22 41 26 21 13
Average 38 22 30 10
SunOS sib-db 5.8 Generic_108528-19 sun4u 11/18/03
16:08:19 %usr %sys %wio %idle
16:08:20 22 19 43 17
16:08:21 25 29 34 13
16:08:22 26 24 32 18
16:08:23 13 13 53 21
16:08:24 30 15 33 23
16:08:25 16 9 38 38
16:08:26 17 24 31 28
16:08:27 12 18 41 29
16:08:28 15 21 37 27
16:08:29 18 25 34 22
Average 19 20 38 24
SunOS sib-db 5.8 Generic_108528-19 sun4u 11/18/03
17:11:28 %usr %sys %wio %idle
17:11:29 27 18 51 4
17:11:30 24 19 51 6
17:11:32 27 3 63 7
17:11:33 33 21 43 3
17:11:34 38 27 23 13
17:11:35 37 37 11 16
17:11:36 37 32 14 18
17:11:37 44 36 10 11
17:11:38 46 33 9 12
17:11:39 44 15 17 25
Average 35 24 29 11
More information about the SunHELP
mailing list