ANNOUNCE amavisd-new-2.5.2 has been released

Version 2.5.2 of amavisd-new is available at:

  http://www.ijs.si/software/amavisd/amavisd-new-2.5.2.
tar.gz

The 2.5.2 is primarily a maintenance release over 2.5.1.




amavisd-new-2.5.2 release notes

BUG FIXES

- in a milter setup log_id was left undefined, which
resulted in log lines
  without id, and a SQL constraint violation "Column
'am_id' cannot be null"
  when logging to SQL was enabled. The bug was introduced in
2.5.1;
  problem reported by Martin Svensson; 

- suppress a quarantining attempt if the message also needs
to be archived
  to the same location (same sql key or same local
filename);
  reported by Wazir Shpoon;

- adjust $socketname in amavisd-release to match its default
counterpart
  in amavisd (i.e. /var/amavis/amavisd.sock); reported by
Stanley Appel;


NEW FEATURES

- add snmp-like counters for PenPalsSavedFromKill,
PenPalsSavedFromTag3
  and PenPalsSavedFromTag2, which correspond to the number
of messages
  where spam level would have exceeded a corresponding level
had there
  not been for (negative) score points contributed by pen
pals lookups.
  Note that for any message only one of the three counters
could
  increment, the one corresponding to the highest level
crossed.
  To find more information about rescued mail messages,
search the log
  for a string 'PenPalsSavedFrom' (available at log level 2
or higher).
  Practical value: mail saved by pen pals from being blocked
usually
  indicate false positives by SpamAssassin; examining rules
which
  contributed most to the score may indicate these rules
need adjustment;

- when preparing a SQL SELECT clause in lookup_sql, provide
an additional
  placeholder %a in a clause template, which is much like
the existing %k,
  but evaluates to an exact mail address (i.e. the same as
the first entry
  in the %k list), which makes it suitable for SQL pattern
matching;
  suggested by Daniel Duerr;

- macro supplementary_info can supply information on two
additional
  SpamAssassin tags: AUTOLEARNSCORE and LANGUAGES if
corresponding plugins
  are enabled in SpamAssassin; see README.customize for the
complete list;

- provide two new subroutines available for calling from
config files:
  include_config_files() and
include_optional_config_files(), each take
  a list of filenames as arguments, and reads &
evaluates them just like
  normal configuration files specified on a command line
(option -c
  or a default amavisd.conf). This provides a simplified and
uniform
  mechanism for 'including' additional configuration files,
which formerly
  could be invoked through a perl do() function. The only
difference
  between include_config_files and
include_optional_config_files is that
  the former aborts if some specified file does not exist,
while the later
  silently ignores specified but missing files. Both/each
subroutine
  may be called multiple times, recursion is allowed (but
some sanity
  limit to recursion is provided); based on a suggestion by
Gary V.

  Example line in amavisd.conf:
    include_config_files('/etc/amavisd-custom.conf');


OTHER

- provide a workaround for a crashing altermime by removing
its leftover
  temporary file which would otherwise cause a temporary
failure:
    TempDir::check: Unexpected file
  problem reported by Dennis A. Kanevsky;

- add a mapping to 'doc' for a result 'Microsoft Installer'
from a file(1)
  utility; it seems like versions 4.20 and 4.21 of file(1)
(possibly earlier
  versions too) misclassify all MS Word, Excel, and
PowerPoint documents
  as 'Microsoft Installer';  problem investigated and a
workaround
  suggested by Noel Jones, Mike Cappella and Michael
Scheidell;

- add a mapping to 'asc' for a result 'COM executable for
DOS' from a file(1)
  utility; it seems like later versions of file(1) can
misclassify a text
  in a GB2312 character set as a COM file; reported by
Daniel J McDonald;

- updated AV entry for ESET NOD32 Linux Mail Server again -
command line
  interface (nod32cli): added a status 3 (e.g. corrupted
archive) back to
  the list of clean statuses;  the 3 was removed in 2.5.1 as
the entry
  was substituted with the one from a NOD32 documentation;
reported by
  Tamás  Gregorics;

- updated AV entry for 'F-Secure Antivirus for Linux
servers' to cope
  with version 5.5 and later; a new entry provided by Peter
Bieringer;

- when a command line option -g requests changing of group
ID, do so
  by calling POSIX::setgid, after also attempting to assign
to perl
  variables $( and $), which may not work correctly on
systems where
  group ID can be negative (like group 'nobody' being -2 on
Mac OS X);
  follows a SpamAssassin problem report 3994, investigated
  by Sidney Markowitz;

- when an AUTH command parameter (RFC 2554) is supplied on a
MAIL FROM
  SMTP command but AUTH support has not been previously
offered
  (like when authentication is disabled by an empty auth_mech_avail),
  no longer treat the situation as a fatal error:
    503 5.7.4 Error: authentication disabled
  but mercifully ignore the parameter and just log an
informational
  message. This is a deviation from RFC 2554, but makes it
friendlier
  for those insisting on running amavisd as a Postfix
pre-queue smtp
  proxy; suggested by Alexander 'Leo' Bergolth;

- adjust the list of pre-loaded perl modules required by
SpamAssassin;

- internal: pass a mail message to SpamAssassin as a GLOB
instead of an
  array reference, saving one in-memory copy of a message
during a SA call;

- internal: make it slightly easier to switch message digest
from MD5 to
  a Digest::SHA family by turning a hard-wired key length
into a parameter
  (admittedly it is still ugly, requiring a change in three
places for
  switching); also pave a transition from Digest::SHA1 to
Digest::SHA;

- documentation: updated files README.postfix and
README.postfix.html
  now include a section 'Advanced Postfix and amavisd-new
configuration'
  explaining a multiple cleanup service architecture; thanks
to
  Patrick Ben Koetter;  retired file: README.postfix.old

- documentation: updated README.sql-pg to include a faster
alternative to
  purging a SQL logging database: the alternative 'DELETE
FROM maddr' on
  PostgreSQL runs faster by a factor of 1.5 to 2 from the
one previously
  suggested;

- suggestion: when using SpamAssassin plugin Rule2XSBody
  (available in more recent versions of SA), adding an entry
like:
    Mail::SpamAssassin::CompiledRegexps::body_0
  to the additional_perl_modules list allows preloading of
compiled rules.

  Adding the following two lines to amavisd.conf adds the
directory name
  containing modules with compiled rules to Perl modules
search path and
  allows Perl to find the listed module(s):
    my($sa_instdir) =
'/var/db/spamassassin/compiled/3.002001';
    unshift(INC, $sa_instdir, $sa_instdir.'/auto');



Mark

------------------------------------------------------------
-------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and
take
control of your XML. No limits. Just data. Click to get it
now.
http://sourcefor
ge.net/powerbar/db2/
_______________________________________________
AMaViS-user mailing list
AMaViS-userlists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user

AMaViS-FAQ:http://www.amav
is.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/ho
wto/

Mark wrote:

> Version 2.5.2 of amavisd-new is available at:

>   http://www.ijs.si/software/amavisd/amavisd-new-2.5.2.
tar.gz

> The 2.5.2 is primarily a maintenance release over
2.5.1.

>   Adding the following two lines to amavisd.conf adds
the directory name
>   containing modules with compiled rules to Perl
modules search path and
>   allows Perl to find the listed module(s):
>     my($sa_instdir) =
'/var/db/spamassassin/compiled/3.002001';
>     unshift(INC, $sa_instdir, $sa_instdir.'/auto');

The majority would use
/var/lib/spamassassin/compiled/3.002001

> Mark

Gary V



------------------------------------------------------------
-------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and
take
control of your XML. No limits. Just data. Click to get it
now.
http://sourcefor
ge.net/powerbar/db2/
_______________________________________________
AMaViS-user mailing list
AMaViS-userlists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user

AMaViS-FAQ:http://www.amav
is.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/ho
wto/

Out of curiosity, why is this necessary?   Why doesn't SA
find these 
things by default?

Mark Martinec wrote:
> - suggestion: when using SpamAssassin plugin
Rule2XSBody
>   (available in more recent versions of SA), adding an
entry like:
>     Mail::SpamAssassin::CompiledRegexps::body_0
>   to the additional_perl_modules list allows
preloading of compiled rules.
> 
>   Adding the following two lines to amavisd.conf adds
the directory name
>   containing modules with compiled rules to Perl
modules search path and
>   allows Perl to find the listed module(s):
>     my($sa_instdir) =
'/var/db/spamassassin/compiled/3.002001';
>     unshift(INC, $sa_instdir, $sa_instdir.'/auto');

-- 
Jo Rhett
Net Consonance ... net philanthropy, open source and other
randomness

------------------------------------------------------------
-------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
AMaViS-user mailing list
AMaViS-userlists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user

AMaViS-FAQ:http://www.amav
is.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/ho
wto/

* Jo Rhett <jrhettnetconsonance.com>:
> Out of curiosity, why is this necessary?   Why doesn't
SA find these 
> things by default?

Do I get this right? SA when used from amavisd-new does NOT
use the
precompiled rules by default?

> > - suggestion: when using SpamAssassin plugin
Rule2XSBody
> >   (available in more recent versions of SA),
adding an entry like:
> >     Mail::SpamAssassin::CompiledRegexps::body_0
> >   to the additional_perl_modules list allows
preloading of compiled rules.
> > 
> >   Adding the following two lines to amavisd.conf
adds the directory name
> >   containing modules with compiled rules to Perl
modules search path and
> >   allows Perl to find the listed module(s):
> >     my($sa_instdir) =
'/var/db/spamassassin/compiled/3.002001';
> >     unshift(INC, $sa_instdir, $sa_instdir.'/auto');

-- 
Ralf Hildebrandt (i.A. des IT-Zentrums)        
Ralf.Hildebrandtcharite.de
Charite - Universitätsmedizin Berlin            Tel.  +49
(0)30-450 570-155
Gemeinsame Einrichtung von FU- und HU-Berlin    Fax.  +49
(0)30-450 570-962
IT-Zentrum Standort CBF                    send no mail to
plonkcharite.de

------------------------------------------------------------
-------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
AMaViS-user mailing list
AMaViS-userlists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user

AMaViS-FAQ:http://www.amav
is.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/ho
wto/

> > > - suggestion: when using SpamAssassin plugin
Rule2XSBody
> > >   (available in more recent versions of SA),
adding an entry like:
> > >    
Mail::SpamAssassin::CompiledRegexps::body_0
> > >   to the additional_perl_modules
list allows preloading of
> > >   compiled rules.
> > >
> > > Adding the following two lines to
amavisd.conf adds the directory
> > > name containing modules with compiled rules
to Perl modules search path
> > > and allows Perl to find the listed
module(s):
> > >     my($sa_instdir) =
'/var/db/spamassassin/compiled/3.002001';
> > >     unshift(INC, $sa_instdir,
$sa_instdir.'/auto');

Jo Rhett wrote:
> > Out of curiosity, why is this necessary?   Why
doesn't SA find these
> > things by default?

Ralf Hildebrandt wrote:
> Do I get this right? SA when used from amavisd-new does
NOT use the
> precompiled rules by default?

The Rule2XSBody plugin _does_ find these rules by the end of
the
rules parsing, and compiled rules _are_ used. The problem is
that it
happens rather late, after daemonization and after chrooting
(if used),
and pollutes the log with entries like:

amavis[44356]: (44356) extra modules loaded:
  Mail/SpamAssassin/CompiledRegexps/body_0.pm

Other than that, it works just fine in a non-chrooted
setup.

I'll reduce the log clutter a bit with the next version.

  Mark

------------------------------------------------------------
-------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
AMaViS-user mailing list
AMaViS-userlists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user

AMaViS-FAQ:http://www.amav
is.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/ho
wto/

On Sep 25, 2007, at 3:13 AM, Mark Martinec wrote:
> The Rule2XSBody plugin _does_ find these rules by the
end of the
> rules parsing, and compiled rules _are_ used. The
problem is that it
> happens rather late, after daemonization and after
chrooting (if  
> used),
> and pollutes the log with entries like:
>
> amavis[44356]: (44356) extra modules loaded:
>   Mail/SpamAssassin/CompiledRegexps/body_0.pm
>
> Other than that, it works just fine in a non-chrooted
setup.

So in a non-chroot setup these lines aren't necessary?

Also, if we don't use these lines are the rules loaded just
once or  
each time it parses a message (just trying to understand the
issue)

-- 
Jo Rhett
Net Consonance : consonant endings by net philanthropy, open
source  
and other randomness



------------------------------------------------------------
-------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
AMaViS-user mailing list
AMaViS-userlists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user

AMaViS-FAQ:http://www.amav
is.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/ho
wto/

Jo,

> > and pollutes the log with entries like:
> > amavis[44356]: (44356) extra modules loaded:
> >   Mail/SpamAssassin/CompiledRegexps/body_0.pm
> > Other than that, it works just fine in a
non-chrooted setup.

> So in a non-chroot setup these lines aren't necessary?

Right.

> Also, if we don't use these lines are the rules loaded
just once or
> each time it parses a message (just trying to
understand the issue)

Yes, only once by a master process, not even once by a child
process.

The following patch to 2.5.2 avoids the unwarranted and
repeated
log lines about module loading:

--- amavisd~	Wed Jun 27 12:43:00 2007
+++ amavisd	Thu Sep 27 00:39:06 2007
 -7953,4
+7953,10 
     }
     Amavis::SpamControl::init_pre_fork()  if
$extra_code_antispam;
+    my(modules_extra) = grep {!exists $modules_basic{$_}}
keys %INC;
+    if (modules_extra) {
+      do_log(1, "extra modules loaded after
daemonizing: %s",
+        join(", ", sort modules_extra));
+      %modules_basic = %INC;
+    }
     1;
   } or do {


Mark

------------------------------------------------------------
-------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
AMaViS-user mailing list
AMaViS-userlists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user

AMaViS-FAQ:http://www.amav
is.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/ho
wto/