List Info

Thread: Re: web pages hang on maia, forced to reboot server. ..




Re: web pages hang on maia, forced to reboot server. ..
country flaguser name
United States
2007-07-18 18:32:16
Update below - the problem isn't resolved.

Kurt Buff wrote:
> Pete Barnwell wrote:
> > Kurt Buff wrote:
> > > In addition to the problem with (some)
quarantined emails being
> > > unretrievable, we had to reboot the server
today.
> > >
> > > I am unable to track the reason why it locked
up, but 
> > thought I'd put what I
> > > know in front of folks to see if I can get a
response.
> > >
> > > The web pages were hanging, that is, people
would click on 
> > a link (any link)
> > > and the page would just sit there and go no
further . I 
> > tried restarting
> > > apache with apachectl, but while it did
restart, the 
> > problem didn't go away.
> > >
> > > I'm not finding much in the logs, except some
PHP errors. a 
> > sample from my
> > > syslog is attached.
> > >
> > >   
> > 
> > 
> > 2007-06-27 09:15:15	Local7.Notice	zmx1	Jun 27
09:15:15 
> > httpd[4228]: PHP Fatal error:  Allowed memory size
of 8388608 
> > bytes exhausted (tried to allocate 1464539 bytes)
in 
> > /usr/local/share/pear/Mail/mimeDecode.php on line
401
> > 
> > 
> > Try increasing the amount of memory allowed to php
by changing
> > 
> > memory_limit =
> > 
> > in /etc/php.ini   I'm finding 60M is enough YMMV
etc.
> > 
> > Rgds
> > 
> > Pete
> 
> 
> That was it!
> 
> Thanks!
> 
> Kurt

I was forced again to reboot the server - Monday morning and
this morning.

Today I was able to narrow down (I hope) the time when the
problem occurred.
I'm hoping someone can give me a clue where to start
looking, because I'm
not finding a lot in the logs.

At around 10:20 to 10:40 today, the web pages for Maia
stopped responding. I
was unable to log in to the web site, as the page for login
didn't present
itself. Also, I noticed that the 10:00 hourly cron job
didn't run. This job
does process-quarantine.pl, send-quarantine-digests.pl, and
stats-snapshot.pl. After the reboot, the 11:00 cron ran, and
the 9:00 job
ran before the reboot.

I did do 'amavisd restart' and 'apachectl restart', to no
avail. I rebooted
the server at roughly 10:45, after I found over 300 messages
in the postfix
queues. This, of course, means that postfix was accepting
mail, but that
somewhere between there and delivery to our Exchange server,
things were
getting fubar'ed.

I have found nothing in the httpd-*.logs.

I notice in the maillog that postfix stopped relaying
messages to our
Exchange server at shortly after 10:00 - the last message
that shows a relay
to our Exchange server is at 10:04, which explains the
buildup of messages
in the postfix queues.

However, it doesn't look to me as if amavis has actually
finished talking
with MySQL, as shown by these eventlog entries, at the time
I rebooted the
machine (I assume that they are actually caused by the
reboot!):

2007-07-18 10:45:16     System4.Info    zmx1    Jul 18
10:45:15 kernel:
Stopping mysql.
2007-07-18 10:45:19     Mail.Warning    zmx1    Jul 18
10:45:17
amavis[58566]: (58566-08) SA TIMED OUT, backtrace: at
/usr/local/lib/perl5/site_perl/5.8.8/Mail/SpamAssassin/Bayes
Store/MySQL.
pm line 492nteval {...} called at
/usr/local/lib/perl5/site_perl/5.8.8/Mail/SpamAssassin/Bayes
Store/MySQL.pm
line
492ntMail::SpamAssassin::BayesStore::MySQL::tok_touch_all(
'Mail::SpamAss
assin::BayesStore::MySQL=HASH(0xa16e77c)',
'ARRAY(0x92d9bd4)', 1184778316)
called at
/usr/local/lib/perl5/site_perl/5.8.8/Mail/SpamAssassin/Bayes
.pm
line 1278ntMail::SpamAssassin::Bayes::s
can('Mail::SpamAssassin::Bayes=HASH(0xa15335c)',
'Mail::SpamAssassin::PerMsgStatus=HASH(0xa473b38)',
'Mail::SpamAssassin::Message=HASH(0xa94def8)') called at
/usr/local/lib/perl5/site_perl/5
.8.8/Mail/SpamAssassin/EvalTests.pm line
2517ntMail::SpamAssassin::PerMsgStatus::check_bayes('Mail:
:SpamAssassin::P
erMsgStatus=HASH(0xa473b38)', 'ARRAY(0xa956858)', 0.20,
0.40) called at /
usr/local/lib/perl5/site_perl/5.8.8/Mail/Spam...
2007-07-18 10:45:19     Mail.Warning    zmx1    Jul 18
10:45:17
amavis[58562]: (58562-09) SA TIMED OUT, backtrace: at
/usr/local/lib/perl5/site_perl/5.8.8/Mail/SpamAssassin/Bayes
Store/MySQL.
pm line 492nteval {...} called at
/usr/local/lib/perl5/site_perl/5.8.8/Mail/SpamAssassin/Bayes
Store/MySQL.pm
line
492ntMail::SpamAssassin::BayesStore::MySQL::tok_touch_all(
'Mail::SpamAss
assin::BayesStore::MySQL=HASH(0xa16e77c)',
'ARRAY(0x92d9bd4)', 1184778318)
called at
/usr/local/lib/perl5/site_perl/5.8.8/Mail/SpamAssassin/Bayes
.pm
line 1278ntMail::SpamAssassin::Bayes::s
can('Mail::SpamAssassin::Bayes=HASH(0xa15335c)',
'Mail::SpamAssassin::PerMsgStatus=HASH(0xaef53b8)',
'Mail::SpamAssassin::Message=HASH(0xad7b4a8)') called at
/usr/local/lib/perl5/site_perl/5
.8.8/Mail/SpamAssassin/EvalTests.pm line
2517ntMail::SpamAssassin::PerMsgStatus::check_bayes('Mail:
:SpamAssassin::P
erMsgStatus=HASH(0xaef53b8)', 'ARRAY(0xada2650)', 0.20,
0.40) called at /
usr/local/lib/perl5/site_perl/5.8.8/Mail/Spam...
2007-07-18 10:45:19     Mail.Error      zmx1    Jul 18
10:45:17
amavis[58566]: (58566-08) TROUBLE in check_mail: spam_scan
FAILED:
DBD::mysql::st execute failed: MySQL server has gone away a
t /usr/local/sbin/amavisd line 3219, <GEN7> line
4533.
2007-07-18 10:45:19     Mail.Warning    zmx1    Jul 18
10:45:17
amavis[59593]: (59593-02) connect_to_sql: unable to connect
to DSN
'DBI:mysql:maia:localhost': Can't connect to local MySQL se
rver through socket '/tmp/mysql.sock' (2)
2007-07-18 10:45:19     Mail.Warning    zmx1    Jul 18
10:45:17
amavis[59594]: (59594-01) connect_to_sql: unable to connect
to DSN
'DBI:mysql:maia:localhost': Can't connect to local MySQL se
rver through socket '/tmp/mysql.sock' (2)
2007-07-18 10:45:19     Mail.Warning    zmx1    Jul 18
10:45:17
amavis[59598]: (59598-01) connect_to_sql: unable to connect
to DSN
'DBI:mysql:maia:localhost': Can't connect to local MySQL se
rver through socket '/tmp/mysql.sock' (2)
2007-07-18 10:45:19     Mail.Warning    zmx1    Jul 18
10:45:17
amavis[59601]: (59601-01) connect_to_sql: unable to connect
to DSN
'DBI:mysql:maia:localhost': Can't connect to local MySQL se
rver through socket '/tmp/mysql.sock' (2)
2007-07-18 10:45:19     Mail.Warning    zmx1    Jul 18
10:45:17
amavis[59603]: (59603-01) connect_to_sql: unable to connect
to DSN
'DBI:mysql:maia:localhost': Can't connect to local MySQL se
rver through socket '/tmp/mysql.sock' (2)
2007-07-18 10:45:19     Mail.Error      zmx1    Jul 18
10:45:17
amavis[58562]: (58562-09) TROUBLE in check_mail: spam_scan
FAILED:
DBD::mysql::st execute failed: MySQL server has gone away a
t /usr/local/sbin/amavisd line 3219, <GEN7> line
54780.


  

_______________________________________________
Maia-users mailing list
Maia-usersrenaissoft.com
http://www.renaissoft.com/mailman/listinfo/maia-users

[1]

about | contact  Other archives ( Real Estate discussion Medical topics )