Using spamd instead of Perl module (was RE: [Mimedefang] Bayes locking)

[ISI]

When mail flow is primarily addressed to real mailboxes there is little
benefit from useing spamc/spamd, but during a heavy distributed dictionary
attack, when our filter servers may be receiving hundreds of messages a
second coming from hundreds of addresses we see profound benefits from using
spamc/spamd for the reasons mentioned.  Same goes for virus blasts.  We run
60-100 MD threads, but only 15 spamd children and never have all 15 in use
at one time.

John Scully

----- Original Message ----- 
From: "David F. Skoll" <dfs at roaringpenguin.com>
To: <mimedefang at lists.roaringpenguin.com>
Sent: Wednesday, October 06, 2004 2:10 PM
Subject: Using spamd instead of Perl module (was RE: [Mimedefang] Bayes
locking)


>
> On Wed, 6 Oct 2004 Matthew.van.Eerde at hbinc.com wrote:
>
> > This lends itself to my "using spamc/spamd from MIMEDefang"
> > question.  Adding MySQL support or PostgreSQL support further inflates
> > an already large Mail::SpamAssassin object.
>
> Not by that much.  The client library code (pgsql.so in the case of
> PostgreSQL) is shared, and compared to the rest of SpamAssassin, it's
> tiny.
>
> > When the largest thing in a MIMEDefang slave is the SpamAssassin
> > object, the idea of factoring it out comes to my mind.  Instead of ten
> > active MIMEDefang slaves, each hoarding their own private SpamAssassin
> > object, consider twenty active MIMEDefang slaves - each calling spamc
> > to connect to a pool of five running spamd daemons.
>
> This might be a good idea.  I wouldn't fork/exec spamc, but rather
implement
> the SA client-server protocol directly in Perl (I don't think it's
> all that complex.)  Now that spamd has a preforked model, it might work
> quite well.
>
> > It would interest me to see some real-world statistics on what
> > percentage of the time a given MIMEDefang slave spends in:
>
> I have statistics for CanIt, and I can tell you that over 90% of the
average
> slave's busy time is spent inside SpamAssassin (or in our case, doing
> DB queries.)  This is pretty consistent over hundreds of customers.
>
> Regards,
>
> David.
> _______________________________________________
> Visit http://www.mimedefang.org and http://www.canit.ca
> MIMEDefang mailing list
> MIMEDefang at lists.roaringpenguin.com
> http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
>
>