[ic] Most Common Performance Issues

Michael Stearne interchange-users@icdevgroup.org
Mon Aug 26 12:17:32 2002


  cfm@maine.com wrote:

>On Thu, Aug 22, 2002 at 03:57:14PM -0700, Barry Treahy, Jr. wrote:
>  
>
>>Michael Stearne wrote:
>>
>>    
>>
>>>Our site is running IC on a DP 800Mhz Redhat box with 512MB of RAM 
>>>with SCSI disk.  This machine runs only IC.  The site is based off of 
>>>the foundation sample site and contains about 300 product using the 
>>>standard (non-RDBMS) database.  We have seen decreasing performance 
>>>over the last 6 months the site has been up.  There is up to 4 IC 
>>>processes running at a time because of traffic.  Each page on the site 
>>>takes from 2-10 secs to generate.  This is across all platforms and 
>>>browsers at LAN speed. If an IC process has the machine to itself 
>>>(only 1 user on the site), that process will take 97% of the CPU.  
>>>While this is understandable, even when there is 1 process, it still 
>>>takes ~4 seconds to generate a page.  I don't know how a machine as 
>>>powerful can get floored by 4 concurrent users.
>>>
>>>Currently we run expireall each day.  This seems to help a little.
>>>
>>>What else could I do (configuration, cron, etc) to work on performance? 
>>>      
>>>
>
>I'd suggest you get someone with sysadmin experience to look at it
>first.  You say **only** IC.  Do you mean **only** IC PLUS
>apache+mod_ssl+ whatever, etc...?
>  
>
I am the sysadmin.  Apache has never been the one to bog down a machine 
for me.  There are many things running, but the process that slows the 
machine is interchange.  That's why I mentioned that.  And by only 
Interchange, I meant no Oracle, J2EE, etc that could be labor intensive.  

>What does top tell you?  yadda yadda.
>  
>
 11:48am  up 29 days, 11:04,  2 users,  load average: 3.17, 1.64, 0.95
93 processes: 82 sleeping, 11 running, 0 zombie, 0 stopped
CPU states: 93.0% user,  6.9% system,  0.0% nice,  0.0% idle
Mem:   512780K av,  501716K used,   11064K free,      64K shrd,   97904K 
buff
Swap:  506036K av,   30604K used,  475432K free                  219388K 
cached

  PID USER     PRI  NI  SIZE  RSS SHARE STAT %CPU %MEM   TIME COMMAND
 2872 interch   20   0 22432  21M 15220 R    10.9  4.3   0:07 interchange
 2887 interch   14   0 23008  22M 16216 R    10.7  4.4   0:02 interchange
 2889 interch   14   0 22900  22M 16232 R    10.7  4.4   0:02 interchange
 2891 interch   14   0 22904  22M 16232 R    10.7  4.4   0:02 interchange
 2893 interch   14   0 22920  22M 16232 R    10.7  4.4   0:01 interchange
 2895 interch   14   0 22976  22M 16232 R    10.7  4.4   0:01 interchange
 2898 interch   14   0 21324  20M 15812 R    10.7  4.1   0:01 interchange
 2904 interch   14   0 22812  22M 14996 R     9.5  4.4   0:00 interchange
 2907 interch   14   0 21732  21M 15800 R     9.5  4.2   0:00 interchange
 2821 interch   11   0  1092 1092   836 R     0.5  0.2   0:00 top
    1 root       8   0   496  460   428 S     0.0  0.0   0:34 init
    2 root       9   0     0    0     0 SW    0.0  0.0   0:00 keventd
    3 root       9   0     0    0     0 SW    0.0  0.0   0:00 kapm-idled
    4 root      19  19     0    0     0 SWN   0.0  0.0   0:00 ksoftirqd_CPU0
    5 root       9   0     0    0     0 SW    0.0  0.0   1:27 kswapd
    6 root       9   0     0    0     0 SW    0.0  0.0   0:00 kreclaimd
    7 root       9   0     0    0     0 SW    0.0  0.0   0:00 bdflush
    8 root       9   0     0    0     0 SW    0.0  0.0   0:02 kupdated
    9 root      -1 -20     0    0     0 SW<   0.0  0.0   0:00 mdrecoveryd
  453 root       9   0   576  560   516 S     0.0  0.1   0:00 syslogd
  458 root       9   0   944  292   292 S     0.0  0.0   0:00 klogd

>Nor do you say if you are making 15 thousand sales a day or 15.  How
>many pages a day are you serving?
>
>  
>
Well, because of the performance issues we are serving less pages than 
we would like to.  But there are about 20-30 orders a day.  With ssl 
used only for the order pages.


bash-2.04$ /usr/sbin/ab -n 30 -c 5 
http://www.feamerch.com/cgi-bin/fea/index.html
This is ApacheBench, Version 1.3d <$Revision: 1.58 $> apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2001 The Apache Group, http://www.apache.org/

Benchmarking www.feamerch.com (be patient)...
Server timed out

: Operation now in progress

--------------------------------------------------------
bash-2.04$ /usr/sbin/ab http://www.feamerch.com/cgi-bin/fea/index.html
This is ApacheBench, Version 1.3d <$Revision: 1.58 $> apache-1.3
Copyright (c) 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright (c) 1998-2001 The Apache Group, http://www.apache.org/

Benchmarking www.feamerch.com (be patient).....done
Server Software:        Apache/1.3.22                                     
Server Hostname:        www.feamerch.com
Server Port:            80

Document Path:          /cgi-bin/fea/index.html
Document Length:        122075 bytes

Concurrency Level:      1
Time taken for tests:   57.820 seconds
Complete requests:      1
Failed requests:        0
Broken pipe errors:     0
Total transferred:      122488 bytes
HTML transferred:       122075 bytes
Requests per second:    0.02 [#/sec] (mean)
Time per request:       57820.00 [ms] (mean)
Time per request:       57820.00 [ms] (mean, across all concurrent requests)
Transfer rate:          2.12 [Kbytes/sec] received


-Michael