Server load,bad robots and server config

[Chris Daniel <krskrem@speedfactory.net>]

******    message to minivend-users from Chris Daniel <krskrem@speedfactory.net>     ******

Hello all,
My minivend site is receving around 6000 to 7000 hits a day.
I had set the mv servers running at 15.
When I checked the netstat command it sometimes is running all 15
servers at a time.
And in TOP, it is running several instances of minivend as well. zombie
and perl.
This demand slows the server down a little. The server is a single
processor P2/400 w/256 ram running redhat/apache and mv3.12
This just about uses all the memory and cpu. And server load at this
level is 9.0+, guess its time for more memory.
Other than placing more static pages in the store, is there a way to
increase performance and decrease server load?
Is there benchmark data on server setups and configs?
I limit the graphics a bit, ie: using same graphics on all pages,they
are optimised.
As the site is adult it will recieve more "just looking" customers than
mainstream sites.
So in order to be profitable I must show the store to lots of folks.

And in error.log I see bad_robot warnings up to 600+ calls..
I imagine I can fix that,if they are spiders with <meta index no follow>

But I have limited the bad_robot stuff to 50. Does this not block them?
Does each element of a page count as a robot access? As in a chopped up
graphic or table?

Well I am interested to hear what kind of configs are out there,server
loads,traffic etc..
And ideas about squeezing as much as I can outta mv and my server.
If you can help ,thanks.
Chris Daniel

-
To unsubscribe from the list, DO NOT REPLY to this message.  Instead, send
email with 'UNSUBSCRIBE minivend-users' in the body to Majordomo@minivend.com.
Archive of past messages: http://www.minivend.com/minivend/minivend-list