Re: FTP failing on large volumes of files.

Yes, I am using the built in ftp server.

Not sure about whether it is size of number of files, will have to do
some more investigation, but I have also tried my home PC and am also
unable to establish a connection.

But what I have noticed is that if I check the processes there are 8
eight running processes for ftp:

2635 root 2080 S /usr/sbin/bftpd
2636 root 2080 S /usr/sbin/bftpd
2644 admin 2080 S /usr/sbin/bftpd
2645 admin 2080 S /usr/sbin/bftpd
2654 admin 2080 S /usr/sbin/bftpd
2657 admin 2080 S /usr/sbin/bftpd
2658 admin 2080 S /usr/sbin/bftpd
2659 admin 2080 S /usr/sbin/bftpd

If I kill these off, I am then able to re-establish a connection and
the ftp continues to work for a while.

So, I wonder if for some reason either my ftp client is loosing it's
connection but the process is left running or the process drops the
connection without dying.

I am using Filezilla as my ftp client.

Ian

--- In nslu2-general%40yahoogroups.com">nslu2-generalyahoogroups.com, "Mike (mwester)&quot; <mwester...>
wrote:
&gt;
> ian_jefferyes wrote:
&gt; > Hi,
> >
> > I am trying to ftp to my slug a collection of music from my work, but
> > after a while it starts to fail with the ftp messages timing out.
>;
> What else happens? For example, so subsequent attempts to connect and
> transfer data succeed or fail? Does the device need to be restart to
> recover, or does it recover on its own? Does it always happen after a
> certain amount of time has elapsed? Or does it appear to happen
after a
> certain amount of data has been transferred? What happens if you
> attempt to transfer from another system? If your system at work is
> wirelessly connected, have you tried with that system cabled to the
> network? Does it also fail if you transfer from a non-work system?
>
> > I am trying to ftp quite a lot of files which in total will come to
> > about 10Gb.
&gt; >
> > Is there somewhere that I can look to see why it is failing?
>
> Standard places would include the log files in /var/log (especially
> /var/log/messages), and the output from the "dmesg" command. Also
check
> the logs (you may have to enable them) on your firewall/router to
see if
> it has done something.
>
> > Are there any parameters I need to set that can prevent this?
&gt;
> Er, well, until we have some idea of what causes the failure, and what
> sort of failure it is, there's no point in tweaking parameters anywhere.
>
> > I am using the latest version of unslung.
>
> I presume that since you don't mention otherwise, that also means that
> you are using the built-in FTP server?
>
> > Cheers
&gt; >
> > Ian
>
> Mike (mwester)
>

Messages in this topic (3) Reply (via web post) | Start a new topic

.

Sorry should have also said that in the log file there are lots of
lines as follows:

Thu Mar 20 22:57:05 2008 /usr/sbin/bftpd[2869]: Kicked from the server
due to control connection timeout.

Log file is:

/var/log/bftpd.log

Ian

--- In nslu2-general%40yahoogroups.com">nslu2-generalyahoogroups.com, "ian_jefferyes&quot; <nslu2...> wrote:
&gt;
> Yes, I am using the built in ftp server.
>
> Not sure about whether it is size of number of files, will have to do
> some more investigation, but I have also tried my home PC and am also
>; unable to establish a connection.
>
> But what I have noticed is that if I check the processes there are 8
> eight running processes for ftp:
>;
> 2635 root 2080 S /usr/sbin/bftpd
>; 2636 root 2080 S /usr/sbin/bftpd
>; 2644 admin 2080 S /usr/sbin/bftpd
>; 2645 admin 2080 S /usr/sbin/bftpd
>; 2654 admin 2080 S /usr/sbin/bftpd
>; 2657 admin 2080 S /usr/sbin/bftpd
>; 2658 admin 2080 S /usr/sbin/bftpd
>; 2659 admin 2080 S /usr/sbin/bftpd
>;
> If I kill these off, I am then able to re-establish a connection and
> the ftp continues to work for a while.
&gt;
> So, I wonder if for some reason either my ftp client is loosing it's
>; connection but the process is left running or the process drops the
> connection without dying.
&gt;
> I am using Filezilla as my ftp client.
>
> Ian
>
> --- In nslu2-general%40yahoogroups.com">nslu2-generalyahoogroups.com, "Mike (mwester)&quot; <mwester>
>; wrote:
&gt; >
>; > ian_jefferyes wrote:
&gt; > > Hi,
> > >
> > > I am trying to ftp to my slug a collection of music from my
work, but
> > > after a while it starts to fail with the ftp messages timing out.
>; >
> > What else happens? For example, so subsequent attempts to connect
and
> > transfer data succeed or fail? Does the device need to be restart to
> > recover, or does it recover on its own? Does it always happen
after a
> > certain amount of time has elapsed? Or does it appear to happen
&gt; after a
> > certain amount of data has been transferred? What happens if you
> > attempt to transfer from another system? If your system at work is
> > wirelessly connected, have you tried with that system cabled to the
> > network? Does it also fail if you transfer from a non-work system?
> >
> > > I am trying to ftp quite a lot of files which in total will come to
> > > about 10Gb.
&gt; > >
> > > Is there somewhere that I can look to see why it is failing?
> >
> > Standard places would include the log files in /var/log (especially
> > /var/log/messages), and the output from the "dmesg" command. Also
>; check
> > the logs (you may have to enable them) on your firewall/router to
> see if
> > it has done something.
> >
> > > Are there any parameters I need to set that can prevent this?
&gt; >
> > Er, well, until we have some idea of what causes the failure, and
what
> > sort of failure it is, there's no point in tweaking parameters
anywhere.
> >
> > > I am using the latest version of unslung.
> >
> > I presume that since you don't mention otherwise, that also means
that
> > you are using the built-in FTP server?
> >
> > > Cheers
&gt; > >
> > > Ian
> >
> > Mike (mwester)
> >
>;

Messages in this topic (4) Reply (via web post) | Start a new topic

.

In message < fruq5s%2Bu3d8%40eGroups.com">fruq5s+u3d8eGroups.com>, ian_jefferyes
< nslu2%40jefferyes.net">nslu2jefferyes.net> writes
&gt;Sorry should have also said that in the log file there are lots of
>lines as follows:
>
>;Thu Mar 20 22:57:05 2008 /usr/sbin/bftpd[2869]: Kicked from the server
&gt;due to control connection timeout.
>
>;Log file is:
>
>/var/log/bftpd.log
>
>Ian
>

I have seen this before, eventually traced this to a firmware problem
with my old BEFSX41 router. At the time it was known as the 10 minute
time out problem where the router closes every inactive connection after
10 minutes. The firmware was eventually patched to keep port 21 open for
longer if inactive. I seem to remember some users devised a temporary
work around I think using ping etc.

The sequence is br> 1. Control connection opened on port 21.
2. Data transfer starts using Passive port number ??.
3. Data transfer continues using Passive port number.
4. Router closes control port 21 after exactly 10 minutes due to
inactivity.
5. FTP client ( or perhaps FTP server) detects this so closes the
passive data port.
6. The sequence then repeats after re-negotiating the connection.

Suggest checking the log times to see if there is a time pattern.
--
Robert Hammond
PGP:0x154144DA

Messages in this topic (6) Reply (via web post) | Start a new topic

.