Performance problems with large quarantine areas

Hi,

currently we`re using Mailguard as primary AV &
SPAM-Filter for our
enterprise. Since a few months we noticed performance
problems with
the quarantine-area if there were more than 5k messages in.

Some of our users gets around 10k spam-mails / per day.
All this mails will be quarantined, but the user isn`t able
to
clean the quarantine area because the latency (> 5min. +)
to
open the web-gui is to big.


The load on our server (3GHz Xeon, 1,5G RAM, RAID-1)  is
normal.
We also monitored an tuned the MySQL-Backend (InnoDB)
- without success.

Every time such an user opens the web-gui the disk-i/o
increases
significantly.

My questions:

- did anyone else know about such a problem?

- is there a way to limit the number of quarantined items?

- is there a way to optimize the select-query`s (e.g. with a
LIMIT
  statement & an increment?)


Thanks in advance,

kind regars Sebastian


_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

smtd-fn.net wrote:

> currently we`re using Mailguard as primary AV &
SPAM-Filter for our
> enterprise. Since a few months we noticed performance
problems with
> the quarantine-area if there were more than 5k messages
in.
> 
> Some of our users gets around 10k spam-mails / per day.
> All this mails will be quarantined, but the user isn`t
able to
> clean the quarantine area because the latency (>
5min. +) to
> open the web-gui is to big.
> 
> 
> The load on our server (3GHz Xeon, 1,5G RAM, RAID-1) 
is normal.
> We also monitored an tuned the MySQL-Backend (InnoDB)
> - without success.
> 
> Every time such an user opens the web-gui the disk-i/o
increases
> significantly.
> 
> My questions:
> 
> - did anyone else know about such a problem?
> 
> - is there a way to limit the number of quarantined
items?
> 
> - is there a way to optimize the select-query`s (e.g.
with a LIMIT
>   statement & an increment?)

The trunk version contains some optimisations that help with
this; you
might want to check it out and see whether the trunk version
solves the
problem for you.

On a more general note, though, when I hear people talk
about a single
user receiving 10k mail items a day, I wonder whether
they're doing any
filtering upstream from Maia.  Understand that Maia is a
very thorough
analysis tool, and it consumes a lot of resources, so you
don't want
Maia to have to look at /everything/ you receive--a lot of
spam can be
detected and rejected at the upstream MTA based on things
like invalid
recipients, invalid HELO, invalid sender domains, etc. 
Tools like Maia
exist to handle the "tough" cases--the emails
that aren't "obviously"
spam--so when your traffic levels are high you should
consider ways to
screen out the "obvious" stuff upstream at
Postfix/Sendmail/etc.  That
lets you conserve your resources for Maia to use on the
"non-obvious"
items--and it will consequently reduce the number of items
that end up
in your users' quarantines/caches.

-- 
Robert LeBlanc <rjlrenaissoft.com>
Renaissoft, Inc.
Maia Mailguard <http://www.maiamail
guard.com/>

_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

greylisting is also very helpful upstream.


Robert LeBlanc wrote:

> On a more general note, though, when I hear people talk
about a single
> user receiving 10k mail items a day, I wonder whether
they're doing any
> filtering upstream from Maia.  Understand that Maia is
a very thorough
> analysis tool, and it consumes a lot of resources, so
you don't want
> Maia to have to look at /everything/ you receive--a lot
of spam can be
> detected and rejected at the upstream MTA based on
things like invalid
> recipients, invalid HELO, invalid sender domains, etc. 
Tools like Maia
> exist to handle the "tough" cases--the
emails that aren't "obviously"
> spam--so when your traffic levels are high you should
consider ways to
> screen out the "obvious" stuff upstream at
Postfix/Sendmail/etc.  That
> lets you conserve your resources for Maia to use on the
"non-obvious"
> items--and it will consequently reduce the number of
items that end up
> in your users' quarantines/caches.
> 
> 
> 
>
------------------------------------------------------------
------------
> 
> _______________________________________________
> Maia-users mailing list
> Maia-usersrenaissoft.com
> http://www.renaissoft.com/mailman/listinfo/maia-users


-- 
# CONFIG_TCG_TPM is not set

Adam Kosmin
GNU/Linux SA
Visual Trading Systems, LLC

Empire State Building
350 Fifth Avenue, Suite 6420
New York, NY 10118, USA

Email: akosminvtsystems.com
Phone: 212 871-1747 ext. 340
_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users