[Mimedefang] Performance Benchmarking / Experiances
Cormack, Ken
kcormack at acs.roadway.com
Thu Sep 25 10:25:01 EDT 2003
Joe,
Below, I'm posting some portions of a report that I generate daily, from my
gateway system. The box is a Compaq DL380 with 512MB RAM, and a single
900MHz PIII. The system uses 3 9GB drives with hardware RAID5 driven off
the onboard Compaq RAID controller.
The OS is RedHat 8.0, with Sendmail 8.12.10 compiled from source, MIMEDefang
is version 2.36, Mail::SpamAssassin is Version 2.55, with
Central Command's Vexira Antivirus / Linux Version 2.1.8-8 and File::Scan
Version 0.66. In addition to the defenses offered by MIMEDefang, SA, and
Vexira, we also run a number of anti-spam sendmail rules (you'll see them
tallied, below.) One note about out MD config. We do minimal filtering
against outbound mail, so the performance numbers may be half of what you
might normally see for the volume of mail, if we were fully filtering the
outbound traffic.
We will be adding a second proc and bumping up the RAM to 2GB soon (we want
to put MD's scratch dir on a RAM disk), but otherwise, the system is running
just fine (and you'll see some sar averages in the info below).
I've munged some of the domainnames and email addresses given in the report
that would identify too many specifics of this system, but the numbers are
real. I measure midnight to midnight. This system may or may not be close
to what your environment is like (with regard to mail flow, etc.), but it
should give you some idea to start with.
Statistics from Wed Sep 24 00:26:09 2003
M msgsfr bytes_from msgsto bytes_to msgsrej msgsdis Mailer
4 23950 727377K 20132 675881K 2113 1783 esmtp
9 12552 1416132K 20002 1521606K 6 1 DOMAIN1
11 66 1676K 101 11007K 0 0 DOMAIN2
12 9 282K 129 580K 0 0 DOMAIN3
13 12 84K 1200 33178K 0 0 DOMAIN4
14 422 9606K 640 35136K 0 0 DOMAIN5
16 0 0K 8 25K 0 0 DOMAIN6
17 5582 122904K 854 17705K 0 0 DOMAIN7
19 6609 996790K 1033 4665K 40 1 local
=============================================================
T 49202 3274851K 44099 2299783K 2159 1785
C 47122 49060 5134
DISTINCT HOSTS WITH WHOM CONNECTIONS WERE ATTEMPTED IN PRECEDING 24HRS:
5925 Total distinct individual hosts
OUT OF ALL THOSE HOSTS WITH WHOM WE'VE ATTEMPTED A CONNECTION,
THE LATEST CONNECTION ATTEMPT FOR EACH BREAKS DOWN AS FOLLOWS:
5488 Successfully completed transactions with us
11 Reset the connection on us, during a transaction
291 Timed-out on us, during a transaction
129 Refused connections from us
6 Failed for other reasons
SENDMAIL RULESET REJECTION TALLIES
73 CheckFrom
26 CheckMessageId
1507 CheckSubject
226 CheckTo
501 check_mail
60 check_rcpt
1204 check_relay
3597 total
MIMEDEFANG "MILTER" REJECTION TALLIES
67 bad_filename
1 charset_korean
2543 high_sa_score
23 suspicious_chars
279 virus
2913 total
SPAMASSASSIN SCORES
Msgs Scoring 5 or Higher: 7865
Highest Recorded Score: 42.4
Average Spam Score: 10.67
MIMEDEFANG STOPPED THE FOLLOWING VIRUSES
55 Hits: Worm/Bugbear.B
168 Hits: Worm/Gibe.C.1
7 Hits: Worm/Klez.E
38 Hits: Worm/MiMail.A1
11 Hits: Worm/Yaha.M
MAX NUMBER OF MIMEDEFANG MILTERS
25 Max Allowed
24 Busy
24 Loaded
MIMEDEFANG "MILTER" PROCESSING TIME TALLIES
Shortest time to process: 44ms
Longest time to process: 129957ms
AVERAGE MESSAGE SIZE: 59 KB
SMALLEST MESSAGE(S)
Size: 1 Bytes
Msg=h8O6RhmV008558
from=<seal at xxxxxxxxxxxxx.com>
to=<tweaks at xxxxxxx.com>
LARGEST MESSAGE(S)
Size: 33310297 Bytes
Msg=h8O9PUmV025945
from=<maps at xxxxxxx.com>
to=<ussa1229 at xxxxxxxxx.com>
A note about the sar data below... Since compiling a new kernel from source,
I've somehow managed to disable the kernel's reporting of sar's "%iowait"
metric, so take the 0 %iowait with a pound of salt. But other than that the
numbers are correct.
MIDNIGHT-8AM SYSTEM PERFORMANCE AVERAGE
CPU %user %nice %system %iowait %idle
Average: all 22.56 0.06 3.10 0.00 74.29
kbmemfree kbmemused %memused kbmemshrd kbbuffers kbcached
kbswpfree kbswpused %swpused
Average: 91139 425101 82.35 0 119059 46858
1011420 41196 3.91
PEAK SWAP IN USE MIDNIGHT-8AM: 11.99%
8AM-5PM SYSTEM PERFORMANCE AVERAGE
CPU %user %nice %system %iowait %idle
Average: all 50.25 0.00 7.48 0.00 42.27
kbmemfree kbmemused %memused kbmemshrd kbbuffers kbcached
kbswpfree kbswpused %swpused
Average: 82165 434075 84.08 0 83780 36190
1011038 41578 3.95
PEAK SWAP IN USE 8AM-5PM: 15.92%
5PM-MIDNIGHT SYSTEM PERFORMANCE AVERAGE
CPU %user %nice %system %iowait %idle
Average: all 23.92 0.00 2.38 0.00 73.70
kbmemfree kbmemused %memused kbmemshrd kbbuffers kbcached
kbswpfree kbswpused %swpused
Average: 100150 416090 80.60 0 90748 30637
1022253 30363 2.88
PEAK SWAP IN USE 5PM-MIDNIGHT: 13.76%
24 HOUR SYSTEM PERFORMANCE AVERAGE
CPU %user %nice %system %iowait %idle
Average: all 33.36 0.02 4.54 0.00 62.09
kbmemfree kbmemused %memused kbmemshrd kbbuffers kbcached
kbswpfree kbswpused %swpused
Average: 90389 425851 82.49 0 97582 38137
1014426 38190 3.63
PEAK SWAP IN USE 24 HOUR: 15.92%
STATUS OF QUEUE AS OF: Thu Sep 25 00:17:26 EDT 2003
723 Messages in Queue
297 One Day old
217 Two Days old
202 Expired Today
Messages per hour (each dot is 69 messages)
________________
0: 713 ..........
1: 658 .........
2: 619 ........
3: 680 .........
4: 1785 .........................
5: 447 ......
6: 675 .........
7: 1252 ..................
8: 2749 .......................................
9: 3409 .................................................
10: 2997 ...........................................
11: 2889 .........................................
12: 2795 ........................................
13: 3486 ..................................................
14: 2945 ..........................................
15: 3031 ...........................................
16: 2943 ..........................................
17: 2910 ..........................................
18: 1555 ......................
19: 1162 ................
20: 1421 ....................
21: 1167 ................
22: 732 ..........
23: 775 ...........
8693 sending hosts attempted 43173 messages
5616 destination hosts received 19618 messages
16751 senders sent a combined 48169 messages.
TOP 20 HIGHEST-SCORING SPAMS...
SCORE MESSAGE ID QUARANTINE DIRECTORY
===== ============== ============================
42.4 h8OFjomV008360 qdir-2003-09-24-11.45.57-001
41.6 h8P1YlmV003952 qdir-2003-09-24-21.34.52-001
41.6 h8ONMCmV019440 qdir-2003-09-24-19.22.18-001
41.6 h8OJGEmV031551 qdir-2003-09-24-15.16.23-001
39 h8P0aLmV027251 qdir-2003-09-24-20.36.31-001
38.1 h8OJWXmV003640 qdir-2003-09-24-15.32.44-001
33.7 h8O7Q3mV011917 qdir-2003-09-24-03.26.29-001
33.4 h8P34dmV010557 qdir-2003-09-24-23.04.48-001
32.6 h8O5vomV006285 qdir-2003-09-24-01.57.51-001
32.5 h8OCr1mV018956 qdir-2003-09-24-08.53.09-001
32.3 h8O7sKmV013702 qdir-2003-09-24-03.54.23-001
32 h8O5m5mV005536 qdir-2003-09-24-01.48.53-001
32 h8O4axmV000791 qdir-2003-09-24-00.37.13-001
31.7 h8O9FcmV025545 qdir-2003-09-24-05.15.42-002
31.5 h8OKHSmV015887 qdir-2003-09-24-16.17.40-001
31 h8P3nBmV013938 qdir-2003-09-24-23.49.12-001
31 h8O69omV007137 qdir-2003-09-24-02.10.01-001
30.6 h8P0k3mV027960 qdir-2003-09-24-20.46.05-001
30.4 h8O9txmV027143 qdir-2003-09-24-05.56.06-001
30.2 h8P0vZmV030381 qdir-2003-09-24-20.57.52-001
1691 TOTAL MESSAGES QUARANTINED
-----Original Message-----
From: Joe Stevens [mailto:joe at dvt.spin.ad.jp]
Sent: Thursday, September 25, 2003 4:17 AM
To: mimedefang at lists.roaringpenguin.com
Subject: [Mimedefang] Performance Benchmarking / Experiances
Hello,
I am interested in deploying Mimedefang at a fairly large mail site, and
would be interested in hearing how many messages get handled by what
hardware from any list members that also run large sites (our current
load is about 100,000 messages a day).
After looking at a number of solutions, Mimedefang was unquestionably my
favorite, but wasn't able to find any hard performance numbers on
google...
I am sure the exact performance changes with which filters you are
running, but any experiances as well as performance tuning tips I could
get would be greatly appreciated.
Thanks,
--
Joe
_______________________________________________
MIMEDefang mailing list
MIMEDefang at lists.roaringpenguin.com
http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
More information about the MIMEDefang
mailing list