[SunHELP] masive IO wait with kernel using most of the CPU

[Michelle Loranger]

If anyone has any ideas as to how I can track down this mysterious IO
wait problem, It would help me a ton.  It seems that I have many
machines on my network experienceing this ridiculous IO wait but not for
any processes that I can pin down.  It doesn't appear to be platform
specific as I am seeing it on servers as well as workstations.  The only
common ground I can pin down (but am not allowed to test) is the all
these machine has SUn Grid Engine and Orcallator running.  Below is the
results of top:

last pid:  1517;  load averages:  1.53,  1.24,  1.48                  
15:28:25
50 processes:  49 sleeping, 1 on cpu
CPU states:  0.0% idle,  0.4% user, 25.0% kernel, 74.6% iowait,  0.0%
swap
Memory: 2048M real, 31M free, 56M swap in use, 1992M swap free

  PID USERNAME THR PRI NICE  SIZE   RES STATE   TIME    CPU COMMAND
 5718 root       1  -5    0 5880K 1464K sleep  30:09 12.49% bptm
 1514 root       1 -25    0 1600K 1464K cpu/1   0:15  6.25% top
 5717 root       1  34    0 6104K 1872K sleep  95:30  2.00% bpbkar
20838 root       8  33    0 4976K 1992K sleep   8:56  1.84% mountd
  487 root       1  33    0 3592K 1304K sleep  71:39  0.52% rpcbind
17494 root      25  25    0 4080K 2264K sleep   1:53  0.02% nscd
 6488 root       1  33    0   24M 4472K sleep  24:33  0.00% se.sparc.5.6
  539 root       6  34    0 3224K 1656K sleep  14:02  0.00% automountd
 6652 root       1  33    0 3280K  968K sleep  12:08  0.00% cdsd
  720 root       1  13    0 2264K  968K sleep   6:24  0.00% arraymon
 1046 root       1  33    0 1952K 1112K sleep   5:57  0.00% mibiisa
 5715 root       1  33    0 2920K 1704K sleep   4:27  0.00% bpbrm
    1 root       1  33    0  704K   88K sleep   3:24  0.00% init
20840 root       1  33    0 1824K 1136K sleep   2:50  0.00% nfsd
  517 root       1  33    0 1880K 1120K sleep   1:36  0.00% inetd

Let me know what anyone thinks, in the meantime, I'll keep searchin.

THX
michelle