Spillover queue (was RE: [Mimedefang] Quarantine based on con tent)

[Cormack, Ken]

David,

I think this is an excellent idea.  I know that queue processing is slowed
tremendously, when a large number of messages are present.  Each pass
through the queue takes what seems like forever, some days.  Granted, it's
better now than it's been in the past.  Prior to adding some custom
LOCAL_RULESETS and MIMEDefang, our queue averaged between 2000 and 3000
messages at any given time.  Since building up the defenses over the past 8
months or so, that average has dropped closer to 500-600.  It still takes a
while to run through it, though.

I think your solution is a solid compromise.  Thanks much, for the
suggestion (and for MIMEDefang!)

Ken

-----Original Message-----
From: David F. Skoll [mailto:dfs at roaringpenguin.com]
Sent: Tuesday, August 05, 2003 5:08 PM
To: 'mimedefang at lists.roaringpenguin.com'
Subject: Spillover queue (was RE: [Mimedefang] Quarantine based on
content)


On Tue, 5 Aug 2003, Cormack, Ken wrote:

> Ideally, I think the best option may just be to wait until the sendmail
> "spillover host" that I proposed gets budgeted for.

I use a "spillover host concept" on my main machine.  If you look in
the Sendmail "contrib" directory, there's a very useful tool called
"qtool.pl" for moving messages from one queue directory to another.

Once an hour from cron, I run "/bin/move-old-mail-messages.sh"

and move-old-mail-messages.sh looks like this:

#!/bin/sh
#
# Move messages with more than 10 retransmission attempts to slow queue
SLOWQUEUE=/var/spool/slow-mqueue
QUEUE=/var/spool/mqueue
qtool.pl -e '$msg{num_delivery_attempts} >= 10' $SLOWQUEUE $QUEUE

So any messages that have been tried at least ten times in the regular
queue get moved to the slow queue.  The last piece of the puzzle is
that I have another queue runner for the slow queue, running once
every eight hours.

Bottom line:  If a message doesn't make it out of the regular queue
within the first 5 hours, it gets shunted out to the slow queue that
runs 1/16th as often as the regular queue.

Regards,

David.
_______________________________________________
MIMEDefang mailing list
MIMEDefang at lists.roaringpenguin.com
http://lists.roaringpenguin.com/mailman/listinfo/mimedefang