List Info

Thread: Bayes token expiry




Bayes token expiry
user name
2008-01-17 07:31:04
Gentleman,

What does the bottom line mean after running maiadbtool.pl
--expire-bayes
in debug mode?  (Giving others for context)  It stops and
doesn't do
anything (dunno if it needs to or not).
TIA,


2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
expiry
starting
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
expiry check
keep size, 0.75 * max: 112500
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
token count:
124573, final goal reduction size: 12073
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
first pass?
current: 1200576306, Last: 1200576257, atime: 67308, count:
135446,
newdelta: 755122, ratio: 11.2189182473287, period: 43200
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
can't use
estimation method for expiry, unexpected result, calculating
optimal atime
delta (first pass)
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
expiry max
exponent: 9
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
atime token
reduction
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
========
===============
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
43200 40387
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
86400 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
172800 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
345600 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
691200 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
1382400 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
2764800 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
5529600 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
11059200 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
22118400 0
2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg: bayes:
couldn't find
a good delta atime, need more token difference, skipping
expire

-- 
Richard Zeman
Director of Information Technology
Melwood ~ Growing Together
301.599.4574 - HelpDesk
301.599.4560 - MyDesk
http://www.melwood.org

_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

Re: Bayes token expiry
country flaguser name
Canada
2008-01-17 15:37:48
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Rick Zeman wrote:
> Gentleman,
> 
> What does the bottom line mean after running
maiadbtool.pl --expire-bayes
> in debug mode?  (Giving others for context)  It stops
and doesn't do
> anything (dunno if it needs to or not).
> TIA,
> 
> 
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: expiry
> starting
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: expiry check
> keep size, 0.75 * max: 112500
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: token count:
> 124573, final goal reduction size: 12073
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: first pass?
> current: 1200576306, Last: 1200576257, atime: 67308,
count: 135446,
> newdelta: 755122, ratio: 11.2189182473287, period:
43200
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: can't use
> estimation method for expiry, unexpected result,
calculating optimal atime
> delta (first pass)
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: expiry max
> exponent: 9
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: atime token
> reduction
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: ========
> ===============
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 43200 40387
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 86400 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 172800 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 345600 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 691200 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 1382400 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 2764800 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 5529600 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 11059200 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: 22118400 0
> 2008-01-17 08:25:07 Maia: [maiadbtool] [28025] dbg:
bayes: couldn't find
> a good delta atime, need more token difference,
skipping expire

This means that your Bayes database doesn't have enough
tokens in it yet
to do a proper expiry.  Let your database grow a little more
before
trying to prune it--it clearly doesn't need it yet.  Once a
week should
be more than sufficient (and in any case the expire function
won't work
any more often than once every 24 hours).

The other thing to note is that by default, SpamAssassin
tries to expire
its own Bayes tokens every time a new email is
processed--i.e. it
expires in real time.  On a low-traffic site this is
generally fine, and
it does a good job of keeping the database clean, such that
running a
manual expiry process like this only needs to be done every
few months
to tidy things up.

On busier sites, though, that real-time token expiry means
extra work
for the database and can slow transactions down a fair bit,
so it's
better to disable that feature and just schedule a cron job
to run a
forced expiry process once a day at a more optimal time.  To
do this,
set "bayes_auto_expire 0" in your local.cf file,
and schedule a daily
cron job to run "maiadbtool.pl --expire-bayes".

- --
Robert LeBlanc <rjlrenaissoft.com>
Renaissoft, Inc.
Maia Mailguard <http://www.maiamail
guard.com/>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org


iD8DBQFHj8qsGmqOER2NHewRAlkbAJ9mrJ6Yh7I/tUMQYXRggxxjB7qIJACe
LWz6
53LHm69MrQ/CD8jqxaKbP64=
=tNwl
-----END PGP SIGNATURE-----
_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

Re: Bayes token expiry
country flaguser name
Canada
2008-01-17 20:42:12
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Robert Fitzpatrick wrote:
> On Thu, 2008-01-17 at 13:37 -0800, Robert LeBlanc
wrote:
>> On busier sites, though, that real-time token
expiry means extra work
>> for the database and can slow transactions down a
fair bit, so it's
>> better to disable that feature and just schedule a
cron job to run a
>> forced expiry process once a day at a more optimal
time.  To do this,
>> set "bayes_auto_expire 0" in your
local.cf file, and schedule a daily
>> cron job to run "maiadbtool.pl
--expire-bayes".
> 
> Yes, we have very busy servers. So, all our remote
servers should have
> auto expire disabled in SA and only need to run
maiadbtool.pl on the db
> server daily?

Exactly.  If all of these SpamAssassin hosts are feeding the
same Bayes
database, then none of those hosts should be doing real-time
expiry.
Just run the expiry as a daily cron job on the database
server at a time
when your traffic level is low.

- --
Robert LeBlanc <rjlrenaissoft.com>
Renaissoft, Inc.
Maia Mailguard <http://www.maiamail
guard.com/>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org


iD8DBQFHkBIEGmqOER2NHewRAjQgAJwK3xyjGPREpL0+cQTjAxa11UYU1ACc
DG42
CYsuCaZ2a5k+9y6m2mEAQ8I=
=+Xbe
-----END PGP SIGNATURE-----
_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

[1-3]

about | contact  Other archives ( Real Estate discussion Medical topics )