[Mimedefang] OT: SpamAssassin - Lots of bayes_toks.expire##### files

[Paul Murphy]

Ben,

See
http://lists.roaringpenguin.com/pipermail/mimedefang/2004-January/019591.html
and also
http://64.233.183.104/search?q=cache:jOETeNyHoVsJ:lists.elvandar.org/pipermail/s
pamassassin-users/2004-March/002321.html+bayes_toks.expire&hl=en (the original
site is down, so this is via Google's cache).

It appears that opportunistic expiry is failing due to either the time it takes,
or to problems with the database contents - I'd be tempted to disable the auto
expiry, and run it manually in debug mode first, then take it from there:

	sa-learn -D --force-expiry

Edited highlights:

debug: SpamAssassin version 3.0.0
debug: Score set 0 chosen.
debug: running in taint mode? yes
debug: Running in taint mode, removing unsafe env vars, and resetting PATH
debug: PATH included '/usr/local/bin', keeping.
debug: PATH included '/usr/bin', keeping.
debug: PATH included '/bin', keeping.
debug: PATH included '/usr/bin/X11', keeping.
debug: PATH included '/usr/games', keeping.
debug: Final PATH set to: /usr/local/bin:/usr/bin:/bin:/usr/bin/X11:/usr/games
debug: using "/etc/spamassassin/init.pre" for site rules init.pre
debug: config: read file /etc/spamassassin/init.pre
debug: using "/usr/share/spamassassin" for default rules dir
...
debug: Score set 0 chosen.
debug: Initialising learner
debug: Syncing Bayes and expiring old tokens...
debug: lock: 25900 created /home/defang/.spamassassin/bayes.lock.<sysname>.25900
debug: lock: 25900 trying to get lock on /home/defang/.spamassassin/bayes with 0
retries
debug: lock: 25900 link to /home/defang/.spamassassin/bayes.lock: link ok
debug: bayes: 25900 tie-ing to DB file R/W /home/defang/.spamassassin/bayes_toks
debug: bayes: 25900 tie-ing to DB file R/W /home/defang/.spamassassin/bayes_seen
debug: bayes: found bayes db version 3
...
debug: bayes: expiry check keep size, 0.75 * max: 112500
debug: bayes: token count: 454525, final goal reduction size: 342025
debug: bayes: First pass?  Current: 1114625225, Last: 1099313917, atime: 0,
count: 0, newdelta: 0, ratio: 0, period: 43200
debug: bayes: Can't use estimation method for expiry, something fishy,
calculating optimal atime delta (first pass)
debug: bayes: expiry max exponent: 9
debug: bayes: atime     token reduction
debug: bayes: ========  ===============
debug: bayes: 43200     461600
debug: bayes: 86400     458506
debug: bayes: 172800    454129
debug: bayes: 345600    449149
debug: bayes: 691200    430194
debug: bayes: 1382400   402891
debug: bayes: 2764800   357505
debug: bayes: 5529600   269873
debug: bayes: 11059200  134212
debug: bayes: 22118400  79
debug: bayes: First pass decided on 5529600 for atime delta
debug: refresh: 25800 refresh /home/defang/.spamassassin/bayes.lock
debug: bayes: 25800 untie-ing
debug: bayes: 25800 untie-ing db_toks
debug: bayes: 25800 untie-ing db_seen
debug: bayes: files locked, now unlocking lock
debug: unlock: 25800 unlink /home/defang/.spamassassin/bayes.lock
expired old Bayes database entries in 195 seconds
199580 entries kept, 269873 deleted
token frequency: 1-occurence tokens: 52.02%
token frequency: less than 8 occurrences: 28.98%
debug: Syncing complete.

Best Wishes,

Paul.
__________________________________________________
Paul Murphy
Head of Informatics
Ionix Pharmaceuticals Ltd
418 Science Park, Cambridge, CB4 0PA

Tel. 01223 433741
Fax. 01223 433788


_______________________________________________________________________
DISCLAIMER:
This email and any files transmitted with it are confidential and 
intended solely for the use of the individual or entity to which they
are addressed.  If you have received this email in error please contact
the sender or the Ionix IT Helpdesk on +44 (0) 1223 433741
_______________________________________________________________________