|
List Info
Thread: Re: web pages hang on maia, forced to reboot server. ..
|
|
| Re: web pages hang on maia, forced to
reboot server. .. |
  United States |
2007-06-28 14:23:24 |
Pete Barnwell wrote:
> Kurt Buff wrote:
> > In addition to the problem with (some) quarantined
emails being
> > unretrievable, we had to reboot the server today.
> >
> > I am unable to track the reason why it locked up,
but
> thought I'd put what I
> > know in front of folks to see if I can get a
response.
> >
> > The web pages were hanging, that is, people would
click on
> a link (any link)
> > and the page would just sit there and go no
further . I
> tried restarting
> > apache with apachectl, but while it did restart,
the
> problem didn't go away.
> >
> > I'm not finding much in the logs, except some PHP
errors. a
> sample from my
> > syslog is attached.
> >
> >
>
>
> 2007-06-27 09:15:15 Local7.Notice zmx1 Jun 27 09:15:15
> httpd[4228]: PHP Fatal error: Allowed memory size of
8388608
> bytes exhausted (tried to allocate 1464539 bytes) in
> /usr/local/share/pear/Mail/mimeDecode.php on line 401
>
>
> Try increasing the amount of memory allowed to php by
changing
>
> memory_limit =
>
> in /etc/php.ini I'm finding 60M is enough YMMV etc.
>
> Rgds
>
> Pete
That was it!
Thanks!
Kurt
_______________________________________________
Maia-users mailing list
Maia-users renaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users
|
|
| Re: web pages hang on maia, forced to
reboot server. .. |

|
2007-06-28 18:10:25 |
|
On 6/28/07, Kurt Buff < KBuff zetron.com">KBuff zetron.com> wrote:
Pete Barnwell wrote: > Kurt Buff wrote: > > In addition to the problem with (some) quarantined emails being > > unretrievable, we had to reboot the server today. > > > > I am unable to track the reason why it locked up, but
> thought I'd put what I > > know in front of folks to see if I can get a response. > > > > The web pages were hanging, that is, people would click on > a link (any link) > > and the page would just sit there and go no further . I
> tried restarting > > apache with apachectl, but while it did restart, the > problem didn't go away. > > > > I'm not finding much in the logs, except some PHP errors. a
> sample from my > > syslog is attached. > > > > > > > 2007-06-27 09:15:15 Local7.Notice zmx1 Jun 27 09:15:15 > httpd[4228]: PHP Fatal error: Allowed memory size of 8388608
> bytes exhausted (tried to allocate 1464539 bytes) in > /usr/local/share/pear/Mail/mimeDecode.php on line 401 > > > Try increasing the amount of memory allowed to php by changing >
> memory_limit = > > in /etc/php.ini I'm finding 60M is enough YMMV etc.
This requirement seems to be a direct function of the largest emails you allow maia to process. I had to raise it to 96MB the other day after running at 32MB for a long time because one user got a huge attachment that was quarantined. I lowered it back once the beast was flushed, but I got me thinking..
Is the entire message being read into ram by either maia or smarty when it's dequeued? This seems unneccesary but maybe I'm missing something.. ? Would it be possible to do things in a fixed size buffer or to add a setting for "dont do whatever it is that eats ram if the message is > x amount"?. If it weren't for this one function, I think we could leave that setting at a much lower (saner) value. It worries me that a handful of sessions could eat up the entire memory of the server. I could just tell maia to ignore huge mails I guess (or postfix to refuse them) but I'd rather not.
-Aaron
> > Rgds > > Pete
That was it!
Thanks!
Kurt
_______________________________________________ Maia-users mailing list Maia-users renaissoft.com">Maia-users renaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users
|
| Re: web pages hang on maia, forced to
reboot server. .. |
  United States |
2007-06-28 18:27:50 |
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On Jun 28, 2007, at 6:10 PM, Aaron Wolfe wrote:
>
> Is the entire message being read into ram by either
maia or smarty
> when it's dequeued? This seems unneccesary but maybe
I'm missing
> something.. ?
It probably is, and it may even be copied a few times. It
wouldn't
hurt for us to look it over and see if there's any room for
improvement, but there are many parts that we don't have
complete
access to. For example, the whole message is in the
database, and
I don't know of any way to stream from the database call
straight to
the browser without loading it all in memory.
If Smarty is done properly, it should be passing by
reference, and so
it shouldn't duplicate the message there.
David Morton
Maia Mailguard http://www.maiamailguard
.com
mortonda dgrmm.net
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.5 (Darwin)
iD8DBQFGhEP4Uy30ODPkzl0RAgaoAJ977/X/m5pwHl054v+fihS1CsPeNACg
mJ9R
Tprq0oZsQ/82n+VQzQvabzo=
=z0hq
-----END PGP SIGNATURE-----
_______________________________________________
Maia-users mailing list
Maia-users renaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users
|
|
| Re: web pages hang on maia, forced to
reboot server. .. |
  United States |
2007-06-28 22:20:10 |
Why would you want to put such a large email in your
database anyway?
Not to mention spend time scanning it... The average
spam/virus is only
a few KB, with even the largest of all of the spam and
viruses on my
server being < 700KB according to maia's stats. What's
the point of
scanning large emails when they are almost certainly
legitimate?
-Blake
>
>
> This requirement seems to be a direct function of the
largest emails
> you allow maia to process. I had to raise it to 96MB
the other day
> after running at 32MB for a long time because one user
got a huge
> attachment that was quarantined. I lowered it back
once the beast was
> flushed, but I got me thinking..
>
> Is the entire message being read into ram by either
maia or smarty
> when it's dequeued? This seems unneccesary but maybe
I'm missing
> something.. ? Would it be possible to do things in a
fixed size
> buffer or to add a setting for "dont do whatever
it is that eats ram
> if the message is > x amount"?. If it weren't
for this one function,
> I think we could leave that setting at a much lower
(saner) value. It
> worries me that a handful of sessions could eat up the
entire memory
> of the server. I could just tell maia to ignore huge
mails I guess
> (or postfix to refuse them) but I'd rather not.
>
> -Aaron
_______________________________________________
Maia-users mailing list
Maia-users renaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users
|
|
| Re: web pages hang on maia, forced to
reboot server. .. |

|
2007-06-28 22:40:22 |
|
Viruses, and to a lesser degree providing a consistent view of a user's mail activity.
-Aaron
On 6/28/07, Blake Hudson < blake ispn.net" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
blake ispn.net> wrote:
Why would you want to put such a large email in your database anyway? Not to mention spend time scanning it... The average spam/virus is only a few KB, with even the largest of all of the spam and viruses on my
server being < 700KB according to maia's stats. What's the point of
scanning large emails when they are almost certainly legitimate?
-Blake
> > > This requirement seems to be a direct function of the largest emails > you allow maia to process. I had to raise it to 96MB the other day
> after running at 32MB for a long time because one user got a huge > attachment that was quarantined. I lowered it back once the beast was > flushed, but I got me thinking.. > > Is the entire message being read into ram by either maia or smarty
> when it's dequeued? This seems unneccesary but maybe I'm missing > something.. ? Would it be possible to do things in a fixed size > buffer or to add a setting for "dont do whatever it is that eats ram
> if the message is > x amount"?. If it weren't for this one function, > I think we could leave that setting at a much lower (saner) value. It > worries me that a handful of sessions could eat up the entire memory
> of the server. I could just tell maia to ignore huge mails I guess > (or postfix to refuse them) but I'd rather not. > > -Aaron
_______________________________________________ Maia-users mailing list
Maia-users renaissoft.com" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">Maia-users renaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users
|
| Re: web pages hang on maia, forced to
reboot server. .. |

|
2007-06-28 23:06:24 |
|
On 6/28/07, Blake Hudson < blake ispn.net">blake ispn.net> wrote:
David Morton wrote: > Blake Hudson wrote: > > Why would you want to put such a large email in your database anyway? > > Not to mention spend time scanning it... The average spam/virus is only > > a few KB, with even the largest of all of the spam and viruses on my
> > server being < 700KB according to maia's stats. What's the point of > > scanning large emails when they are almost certainly legitimate? > > That's the point of the option in the system config concerning large
> files... > you can set what your threshold is for Maia to store, and whether to > accept or > reject oversized messages. > > yup, just surprised anyone would set this to more than 1MB since the
benefit is negligible and the downside is that you can run into memory and load issues from scanning large messages.
Boss: I thought you said we had virus protection for email! How did the CEO's machine get infected?
Admin: Well.. we do.. but we only scan little files. The CEO's brother sent him this (funny screensaver thing / macro infected Excel monstrosity / zip file full of gad knows what /etc, etc) that was kinda big, so we just didn't scan it.
Boss: What!?! Admin: Well...yeah..
|
[1-6]
|
|