[Mimedefang] graphdefang cores with large amounts of data

[Lee Dilkie]

I was having a problem with graphdefang just "losing" history. It was
happening at irregular intervals but I couldn't keep more than a day and a
half before everything would reset.

On a hunch, I modified the md_graphlog function in mimedefang.pl to replace
the $Subject that is syslogged with just "Dummy Subject". This was a hunch
because I noticed that a number of the syslogs had not-so-nice characters in
them, extracted from the subject lines of the emails and the syslog parser
might have gotten confused. I say "might" because this is my first
experience with Perl and it looks a lot like APL so far...

Anyway, won't know for sure if this worked until tomorrow but things are
still holding together.

Anyway, if it doesn't work, has anyone else seen this behaviour? I'm not
processing millions of messages, maybe a couple hundred a day.

Regards,

-lee
> On Wed, 15 Oct 2003, cam wrote:
>
> > On Tue, 14 Oct 2003, Patrick Morris wrote:
> >
> > > Happens to me constantly.  I'm lucky if I can keep a
> week's worth of
> > > data without losing my SummaryDB file, and I've only got
> 500 or so users
> > > (though, admittedly, a much higher than average mail and
> spam volume
> > > than the average 500-user site).
> >
> >
> >
> > i had this happen to me last week sometime (don't remember
> off hand exact
> > day without looking).  processing time had gotten up to
> about 10 to 12
> > minutes per run (running once per hour) even after trimming down the
> > number of graphs built.  the db was ~500 Meg at this point.
>  even with 2g
> > ram the box was taking a serious performance hit for  a while due to
> > swapping to hand the 1.6g to 1.8g process.  /sigh
> >
> > cam
> >
> >
> >
> > ------------------------------
> >
> _______________________________________________
> MIMEDefang mailing list
> MIMEDefang at lists.roaringpenguin.com
> http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
>