Re: backup and synchronize to fastmail

On Thu, 15 May 2008, Asheesh Laroia wrote:

> ui = TTY.TTYUI

It means that you get the logging on the console? ie you do
not keep a log
file?

Alejandro Jakubi

On Thu, 15 May 2008, Alejandro Jakubi wrote:

> On Thu, 15 May 2008, Asheesh Laroia wrote:
>
>> ui = TTY.TTYUI
>
> It means that you get the logging on the console? ie
you do not keep a 
> log file?

Right, I recklessly keep no log.  You might want to play
with your options 
to see what you prefer.  Screen could perhaps do your
logging for you.

-- Asheesh.

-- 
Abraham Lincoln didn't die in vain.  He died in Washington,
D.C.

>> Just to repeat myself : run it on a test system and
see what happens,=3D=
20
>> nothing beats that ...=3D20
>
> I do not have a test system with FC6, offlineimap
4.0.16, an imap serve=
r and so on.

... then run it on your FC6 cluster which does have the
version you will=20
be using, and point it to e.g. gmail or something with an
imap server=20
and no important data on it. Admittedly the configuration
will not be=20
_exactly_ the same as in the end (the imap server will be
different),=20
but as far as background / logging / whatever is concerned
you will know=20
for sure.

Actually I don't think many on this list would be using
version 4=20
anymore, so you will get your info more quickly by trying it
yourself.

  /v

--=20
Vincent Beffara
UMPA - ENS Lyon
46 All=E9e d'Italie
69364 LYON cedex 07
Tel: 04 72 72 85 25
Fax: 04 72 72 84 80

On Sat, 17 May 2008, Vincent Beffara wrote:

> ... then run it on your FC6 cluster which does have the
version you will=20
> be using, and point it to e.g. gmail or something with
an imap server=20
> and no important data on it. Admittedly the
configuration will not be=20

No, I do not have important data on my fastmail account.

> Actually I don't think many on this list would be using
version 4=20
> anymore, so you will get your info more quickly by
trying it yourself.

No, my question is about where is the documentation for this
version 4.0.16.
It is much simpler and efficient to know its features by
reading the
documentation than discover them by blind experimentation.

I have expected to receive a copy of this documentation or a
pointer to it.
Meanwhile I have found this post:

http://lists.co
mplete.org/offlineimapcomplete.org/2003/06/msg00002.html.gz

===

Subject: 	OfflineIMAP 3.99.18 released
From: 	John Goerzen <jgoerzenxxxxxxxxxxxx>
Date: 	Mon, 2 Jun 2003 10:33:21 -0500

This is an interim release for bug-fixing.  I intend to take
a look at open
bug reports soonish and hope to get 4.0 out before long. 
I've been seeing a
few intermittent bugs myself, and the -l should help for
that.

offlineimap (3.99.18) unstable; urgency=low

   * Made a fix for Python2.3 compatibility.
   * Removed warning when thread debug is specified. 
Closes: #195739.
   * New option -l to log debug info to a file without
having it spew
     on-screen.
   * New debug type "thread".

===

apparently implying that the option '-l' is available for
versions >=3.99.18,
ie available for this version 4.0.16. A confirmation would
be welcomed.

Regards, Alejandro Jakubi

On Saturday 17 May 2008 10:12:02 am Alejandro Jakubi wrote:
> On Sat, 17 May 2008, Vincent Beffara wrote:

> No, my question is about where is the documentation for
this version
> 4.0.16. It is much simpler and efficient to know its
features by reading
> the documentation than discover them by blind
experimentation.

Each release includes its documentation.  Why don't you
download it and open 
it up?

[ snip ]

> offlineimap (3.99.18) unstable; urgency=low
>
>    * Made a fix for Python2.3 compatibility.
>    * Removed warning when thread debug is specified. 
Closes: #195739.
>    * New option -l to log debug info to a file without
having it spew
>      on-screen.
>    * New debug type "thread".
>
> ===
>
> apparently implying that the option '-l' is available
for versions
> >=3.99.18, ie available for this version 4.0.16. A
confirmation would be
> welcomed.

As others have said, TRY IT.  If it works, send a bug report
asking to add it 
to the manpage.  If it doesn't work, you'll get an error. 
Why are you so 
insistent on others telling you every last detail of the
program in advance, 
when you could learn it trivially by trying it yourself?

Incidentally, if you have shell access on that Fedora
cluster, there's 
nothing stopping you from running the latest versions out of
your home 
directory.

-- John

On Sat, 17 May 2008, John Goerzen wrote:

> Each release includes its documentation.  Why don't you
download it and open
> it up?

That is the pointer that I needed. Thank you. I have
downloaded
offlineimap_4.0.16.tar.gz and found that in effect there is
a difference in
regards to the option '-l':

===
manual.txt

SYNOPSIS
        offlineimap [ -1 ] [ -P profiledir ] [ -a
accountlist ] [ -c configfile
        ] [ -d debugtype[,...] ] [ -l filename ] [ -o ] [ -u
interface ]

===
$ offlineimap -h

        offlineimap [ -1 ] [ -P profiledir ] [ -a
accountlist ]  [
        -c configfile  ] [ -d debugtype[,debugtype...]  ] [
-o ] [
        -u interface ]

===

So, now that I know that I can save a logfile, I have
thought that I would
follow the scheme suggested by Asheesh: launch offlineimap
from within screen
setting ui = TTY.TTYUI in the configuration file, so that I
do not have to
store the passwords in this file, but using instead the
option '-l' to save
logging to a file.

Alas, screen is not working in the departmental cluster
because of a permission
problem (apparently a bug). I hope that the system manager
will want to
correct that. Otherwise I will have to bother you a little
bit more to find
another solution 

> As others have said, TRY IT.  If it works, send a bug
report asking to add it
> to the manpage.  If it doesn't work, you'll get an
error.  Why are you so
> insistent on others telling you every last detail of
the program in advance,
> when you could learn it trivially by trying it
yourself?

May be that all these issues are a triviality for you
because you have been
involved with offlineimap for seven years, and apparently
this kind of
programming activities is a basic part of your life.

But my background and points of view are rather different,
you see things as
a developer and I see them as an ordinary user. I am not
much interested in
reporting bugs about offlineimap or experimenting with it,
but in making work
something very specific (as described in my previous
postings).

Do not worry, once I get it work, you will no longer get any
other message
from me...

> Incidentally, if you have shell access on that Fedora
cluster, there's
> nothing stopping you from running the latest versions
out of your home
> directory.

Because my experience with the compilation of applications
in Linux has been
mostly negative for many years. And say that I was root on
my own systems.
In this system I am a plain user, and I would not been able
to do much in case
of compilation problems. So, I prefer to avoid it as far as
possible.

Also, following distribution builders, it is recommended to
install package
versions of the applications. Presumably they are better
integrated to the
rest of the system. And no doubt they are much easier to
install.

Regards, Alejandro Jakubi

On Saturday 17 May 2008 7:27:58 pm Alejandro Jakubi wrote:
[ snip ]

> Do not worry, once I get it work, you will no longer
get any other message
> from me...

That's too bad.  I'd rather hear from you once you're
actually using it!

>
> > Incidentally, if you have shell access on that
Fedora cluster, there's
> > nothing stopping you from running the latest
versions out of your home
> > directory.
>
> Because my experience with the compilation of
applications in Linux has
> been mostly negative for many years. And say that I was
root on my own
> systems. In this system I am a plain user, and I would
not been able to do
> much in case of compilation problems. So, I prefer to
avoid it as far as
> possible.

There is no compilation or even installation necessary.

Just say "python offlineimap.py" in the top-level
untarred directory and 
that's it.

-- John

On Sat, 17 May 2008, John Goerzen wrote:

> That's too bad.  I'd rather hear from you once you're
actually using it!

OK, but if things work right as I expect, I doubt that I
will have anything
very interesting to post.

> There is no compilation or even installation
necessary.

So, I misunderstood the whole issue. I have not read in the
manual that
offlineimap is a script (or a set off) and I did not know
that the python
language executes scripts. Additionally, I have seen a
Makefile in the source
of offlineimap 4.0.16, kind of "confirming" that a
compilation is required.

> Just say "python offlineimap.py" in the
top-level untarred directory and
> that's it.

I have downloaded and untared offlineimap_5.99.15.tar.gz.
The version of
python on the cluster is 2.4.4, apparently fine. Then I have
got:

===
$ python offlineimap.py -h

        offlineimap [ -1 ] [ -P profiledir ] [ -a
accountlist ]  [
        -c configfile  ] [ -d debugtype[,debugtype...]  ] [
-o ] [
        -u interface ] [ -q ]

===

also with good aspect (except that he option '-l' is not yet
there).

Now I have (at least) two versions of offlineimap to choose.
For any of them,
apparently, the remaining issue is that of passwords, which
needs that the
system manager solve the permission problem with screen.

Regards, Alejandro Jakubi

Hi

2008/5/18 Alejandro Jakubi <jakubidf.uba.ar>:
> So, I misunderstood the whole issue. I have not read in
the manual that
> offlineimap is a script (or a set off) and I did not
know that the python
> language executes scripts. Additionally, I have seen a
Makefile in the source
> of offlineimap 4.0.16, kind of "confirming"
that a compilation is required.

Python can be somehow pre-compiled into its own bytecode
making the
run slightly faster.

offlineimap, like many python packages does provide an
installer so
you can use the offlineimap component in your own program
with
something like:
import offlineimap.

So if you want to run offlineimap a more traditional way,
you do
pythong setup.py install

Jean-Yves

I have decided to run offlineimap on the foreground for a
while (as the issue
with screen might take long), and the results were a
failure.

The .offlineimaprc had this form (following previous
advice):

===
[general]
accounts = Test

[Account Test]
localrepository = Local
remoterepository = Remote

[Repository Local]
type = IMAP
remotehost = <dept-imap-server>
remoteuser = <dept-username>

[Repository Remote]
type = IMAP
remotehost = mail.messagingengine.com
remoteuser = <fm-username>

sep = /
nametrans = lambda foldername: rs.sub('^INBOX.', 'mail/',
foldername)

ui = TTY.TTYUI

====

I have run both offlineimap 4.0.16 and 5.99.15. Both with
option '-l' to
produce a logfile.

I had expected that the passwords would be requested, after
this section of
offlineimap.conf:

# There are five ways to give the password for the remote
IMAP
# server:
#
# 1. No password at all specified in the config file. If a
matching
#    entry is found in ~/.netrc (see netrc (5) for
information) the
#    password from the matching entry will be used.
Otherwise you
#    will be prompted for the password when OfflineIMAP
starts.

but I have got no prompt for them.

So, offlineimap "worked" for a while and then
produced an error: (110,
'Connection timed out').

Find below the logfiles.

Why is offlineimap not requesting the paswords?


Regards, Alejandro Jakubi

====

This is OfflineIMAP 4.0.16
Python: 2.4.4 (#1, Oct 23 2006, 13:58:00)
[GCC 4.1.1 20061011 (Red Hat 4.1.1-30)]
Platform: linux2
Args: ['/usr/bin/offlineimap', '-l', 'offlineimap-log']
MainThread: OfflineIMAP 4.0.16
Copyright (C) 2002 - 2006 John Goerzen <jgoerzencomplete.org>
This software comes with ABSOLUTELY NO WARRANTY; see the
file
COPYING for details.  This is free software, and you are
welcome
to distribute it under the conditions laid out in COPYING.
MainThread: OfflineIMAP 4.0.16
MainThread: Copyright (C) 2002 - 2006 John Goerzen
<jgoerzencomplete.org>
MainThread: This software comes with ABSOLUTELY NO WARRANTY;
see the file
MainThread: COPYING for details.  This is free software, and
you are welcome
MainThread: to distribute it under the conditions laid out
in COPYING.
Account sync Test: ***** Processing account Test
Account sync Test: Copying folder structure from IMAP to
MappedIMAP
Account sync Test: Establishing connection to
mail.messagingengine.com:143.
MainThread: Thread 'Account sync Test' terminated with
exception:
Traceback (most recent call last):
   File
"/usr/lib/python2.4/site-packages/offlineimap/threaduti
l.py", line 153, in run
     Thread.run(self)
   File "/usr/lib/python2.4/threading.py", line
422, in run
     self.__target(*self.__args, **self.__kwargs)
   File
"/usr/lib/python2.4/site-packages/offlineimap/accounts.
py", line 113, in syncrunner
     self.sync()
   File
"/usr/lib/python2.4/site-packages/offlineimap/accounts.
py", line 133, in sync
     remoterepos.syncfoldersto(localrepos)
   File
"/usr/lib/python2.4/site-packages/offlineimap/repositor
y/Base.py", line 116, in syncfoldersto
     srcfolders = src.getfolders()
   File
"/usr/lib/python2.4/site-packages/offlineimap/repositor
y/IMAP.py", line 163, in getfolders
     imapobj = self.imapserver.acquireconnection()
   File
"/usr/lib/python2.4/site-packages/offlineimap/imapserve
r.py", line 168, in acquireconnection
     imapobj = UsefulIMAP4(self.hostname, self.port)
   File
"/usr/lib/python2.4/site-packages/offlineimap/imaplib.p
y", line 154, in _JG_
     self.open(host, port)
   File
"/usr/lib/python2.4/site-packages/offlineimap/imaplib.p
y", line 229, in open
     self.sock.connect(sa)
   File "<string>", line 1, in connect
error: (110, 'Connection timed out')


No debug messages were logged for Account sync Test.
MainThread: Thread 'Account sync Test' terminated with
exception:
MainThread: Traceback (most recent call last):
MainThread:   File
"/usr/lib/python2.4/site-packages/offlineimap/threaduti
l.py", line 153, in run
MainThread:     Thread.run(self)
MainThread:   File
"/usr/lib/python2.4/threading.py", line 422, in
run
MainThread:     self.__target(*self.__args,
**self.__kwargs)
MainThread:   File
"/usr/lib/python2.4/site-packages/offlineimap/accounts.
py", line 113, in syncrunner
MainThread:     self.sync()
MainThread:   File
"/usr/lib/python2.4/site-packages/offlineimap/accounts.
py", line 133, in sync
MainThread:     remoterepos.syncfoldersto(localrepos)
MainThread:   File
"/usr/lib/python2.4/site-packages/offlineimap/repositor
y/Base.py", line 116, in syncfoldersto
MainThread:     srcfolders = src.getfolders()
MainThread:   File
"/usr/lib/python2.4/site-packages/offlineimap/repositor
y/IMAP.py", line 163, in getfolders
MainThread:     imapobj =
self.imapserver.acquireconnection()
MainThread:   File
"/usr/lib/python2.4/site-packages/offlineimap/imapserve
r.py", line 168, in acquireconnection
MainThread:     imapobj = UsefulIMAP4(self.hostname,
self.port)
MainThread:   File
"/usr/lib/python2.4/site-packages/offlineimap/imaplib.p
y", line 154, in _JG_
MainThread:     self.open(host, port)
MainThread:   File
"/usr/lib/python2.4/site-packages/offlineimap/imaplib.p
y", line 229, in open
MainThread:     self.sock.connect(sa)
MainThread:   File "<string>", line 1, in
connect
MainThread: error: (110, 'Connection timed out')
MainThread:
MainThread:
MainThread: No debug messages were logged for Account sync
Test.

====

This is OfflineIMAP 5.99.15
Python: 2.4.4 (#1, Oct 23 2006, 13:58:00)
[GCC 4.1.1 20061011 (Red Hat 4.1.1-30)]
Platform: linux2
Args: ['offlineimap.py', '-l',
'/home/jakubi/offlineimap-log']
MainThread: OfflineIMAP 5.99.15
Copyright (C) 2002 - 2008 John Goerzen <jgoerzencomplete.org>
This software comes with ABSOLUTELY NO WARRANTY; see the
file
COPYING for details.  This is free software, and you are
welcome
to distribute it under the conditions laid out in COPYING.
MainThread: OfflineIMAP 5.99.15
MainThread: Copyright (C) 2002 - 2008 John Goerzen
<jgoerzencomplete.org>
MainThread: This software comes with ABSOLUTELY NO WARRANTY;
see the file
MainThread: COPYING for details.  This is free software, and
you are welcome
MainThread: to distribute it under the conditions laid out
in COPYING.
Account sync Test: ***** Processing account Test
Account sync Test: Copying folder structure from IMAP to
MappedIMAP
Account sync Test: Establishing connection to
mail.messagingengine.com:143.
MainThread: Thread 'Account sync Test' terminated with
exception:
Traceback (most recent call last):
   File
"/home/jakubi/offlineimap/offlineimap/threadutil.py&quo
t;, line 153, in run
     Thread.run(self)
   File "/usr/lib/python2.4/threading.py", line
422, in run
     self.__target(*self.__args, **self.__kwargs)
   File
"/home/jakubi/offlineimap/offlineimap/accounts.py"
, line 114, in syncrunner
     self.sync()
   File
"/home/jakubi/offlineimap/offlineimap/accounts.py"
, line 148, in sync
     remoterepos.syncfoldersto(localrepos, [statusrepos])
   File
"/home/jakubi/offlineimap/offlineimap/repository/Base.p
y", line 135, in syncfoldersto
     srcfolders = src.getfolders()
   File
"/home/jakubi/offlineimap/offlineimap/repository/IMAP.p
y", line 190, in getfolders
     imapobj = self.imapserver.acquireconnection()
   File
"/home/jakubi/offlineimap/offlineimap/imapserver.py&quo
t;, line 224, in acquireconnection
     imapobj = UsefulIMAP4(self.hostname, self.port)
   File "/usr/lib/python2.4/imaplib.py", line 160,
in _JG_
     self.open(host, port)
   File
"/home/jakubi/offlineimap/offlineimap/imapserver.py&quo
t;, line 61, in open
     imaplibutil.new_open(self, host, port)
   File
"/home/jakubi/offlineimap/offlineimap/imaplibutil.py&qu
ot;, line 139, in new_open
     raise socket.error(last_error)
error: 110


No debug messages were logged for Account sync Test.
MainThread: Thread 'Account sync Test' terminated with
exception:
MainThread: Traceback (most recent call last):
MainThread:   File
"/home/jakubi/offlineimap/offlineimap/threadutil.py&quo
t;, line 153, in run
MainThread:     Thread.run(self)
MainThread:   File
"/usr/lib/python2.4/threading.py", line 422, in
run
MainThread:     self.__target(*self.__args,
**self.__kwargs)
MainThread:   File
"/home/jakubi/offlineimap/offlineimap/accounts.py"
, line 114, in syncrunner
MainThread:     self.sync()
MainThread:   File
"/home/jakubi/offlineimap/offlineimap/accounts.py"
, line 148, in sync
MainThread:     remoterepos.syncfoldersto(localrepos,
[statusrepos])
MainThread:   File
"/home/jakubi/offlineimap/offlineimap/repository/Base.p
y", line 135, in syncfoldersto
MainThread:     srcfolders = src.getfolders()
MainThread:   File
"/home/jakubi/offlineimap/offlineimap/repository/IMAP.p
y", line 190, in getfolders
MainThread:     imapobj =
self.imapserver.acquireconnection()
MainThread:   File
"/home/jakubi/offlineimap/offlineimap/imapserver.py&quo
t;, line 224, in acquireconnection
MainThread:     imapobj = UsefulIMAP4(self.hostname,
self.port)
MainThread:   File
"/usr/lib/python2.4/imaplib.py", line 160, in
_JG_
MainThread:     self.open(host, port)
MainThread:   File
"/home/jakubi/offlineimap/offlineimap/imapserver.py&quo
t;, line 61, in open
MainThread:     imaplibutil.new_open(self, host, port)
MainThread:   File
"/home/jakubi/offlineimap/offlineimap/imaplibutil.py&qu
ot;, line 139, in new_open
MainThread:     raise socket.error(last_error)
MainThread: error: 110
MainThread:
MainThread:
MainThread: No debug messages were logged for Account sync
Test.

Alejandro Jakubi wrote:
> I have decided to run offlineimap on the foreground for
a while (as the issue
> with screen might take long), and the results were a
failure.
> 

Can you try it without -l and see if that improves things?

On Mon, 19 May 2008, John Goerzen wrote:

> Can you try it without -l and see if that improves
things?

In fact, I had also tried without -l, with both versions of
offlineimap, 
and there was no improvement.

Regards, Alejandro Jakubi