maia_sa_rules_trigered is huge (6.6 million records)

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


On Feb 11, 2008, at 12:56 PM, Douglas Mortensen wrote:

> Hi,
>
> We’re having some problems w/ our Maia’s
mysql performance. I’m  
> wondering whether any of this may be caused by the fact
that the  
> maia_sa_rules_triggered has 6,617,135 records in it.

That seems excessive.  What version are you using?  What
database?

Records are supposed to be deleted from that table whenever
the  
matching mail item is removed.  I have encountered one other
time when  
this table was crazy big, but it was leftover from an RC5
system, and  
I haven't been able to duplicate it.

Are you running the maintenance scripts?



David Morton
Maia Mailguard http://www.maiamailguard
.com
mortondadgrmm.net



-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.7 (Darwin)

iD8DBQFHsPfcUy30ODPkzl0RAq5eAJ4sBeXw/PTjyT/Uwzc4lu+4W4tCiACg
iUfU
ID/CdIvlg7DJ5tijkR8iiYQ=
=2yDl
-----END PGP SIGNATURE-----
_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

> > We're having some problems w/ our Maia's mysql
performance. I'm 
> > wondering whether any of this may be caused by the
fact that the 
> > maia_sa_rules_triggered has 6,617,135 records in
it.
> 
> That seems excessive.  What version are you using? 
What database?
> 
> Records are supposed to be deleted from that table
whenever 
> the matching mail item is removed.  I have encountered
one 
> other time when this table was crazy big, but it was
leftover 
> from an RC5 system, and I haven't been able to
duplicate it.
> 
> Are you running the maintenance scripts?
> 

Humm, just looked at my Maia DB, the maia_sa_rules_triggered
is at
6,419,781, the maia_mail is at 941,145 (InnoDB estimates) 
This is after
running in production for 8 days.

I have "HAM" expire in 4 days, SPAM expire in 14. 
So of course, SPAM is not
expiring yet. 

Things seem normal.  I have yet to see the system slowdown
or get behind.

Perhaps your records are not too far off normal?

(77,000 messages handled by Maia yesterday, and thats
probably a low average
daily score)

Just my 2cents worth.

Dave




_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

In seeing your post, It got me to thinking. So I checked my
DB.

When I checked it last night, ...triggered was at approx
13.7 Million. This morning it's at 8.7 Million.

Nightly maintenance job report shows:

2008-02-13 00:04:07 Maia: [expire-quarantine-cache] 30537
Suspected Spam items expired
2008-02-13 00:04:07 Maia: [expire-quarantine-cache] 11067
Suspected Non-Spam items expired

My server is barely ever above 5% utilization.

So I don't think the size of that table makes a big
difference.



-- 

Mike Abraham
Netmail & GroupWise Administrator
Conestoga College Institute of Technology and Advanced
Learning 


>>> On 2/11/2008 at 1:56 PM, "Douglas
Mortensen" <dougimpalanetworks.com>
wrote:
  Hi,
  
   
  
  We're having some problems w/ our Maia's mysql
performance. I'm
  wondering whether any of this may be caused by the fact
that the
  maia_sa_rules_triggered has 6,617,135 records in it. We've
also had over
  1 million records each in both bayes_token and bayes_seen
tables. I've
  purged them entirely and turned off bayes filtering for
now. So the box
  is going pretty fast now, but I really want to figure out
the problem &
  get it fixed so that we can enjoy the benefits of bayesian
filtering.
  
   
  
  Anybody know whether 6.6 million records in the
maia_sa_rules_triggered
  database would cause problems, as well as whether maia
should be able to
  handle a bayes table w/ more than a million records and
still give good
  performance? Right now our bayes tokes expire script is
taking about 10
  hours to run (/usr/bin/sa-learn --sync --force-expire).
See the output:
  
   
  
  expired old bayes database entries in 35643 seconds
  
  4029122 entries kept, 1032203 deleted
  
  token frequency: 1-occurrence tokens: 0.00% token
frequency: less than 8
  occurrences: 0.00%
  
   
  
  Any help would be greatly appreciated.
  
   
  
  Sincerely,
  
  __
  
  Douglas Mortensen
  
        Network Consultant
  
           Impala Networks
  
   
  
                CCNA,
  
              A+, Linux+, Network+
  
   
  
   

_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users