Cyrus 2.3.12 RC2

I just put together a second release candidate for Cyrus
2.3.12.  I'd
appreciate any independent testing before I release this to
the masses.

http://www.contrib.andrew.cmu.edu/~murch/cy
rus-imapd-2.3.12rc2.tar.gz


Noteworthy changes:

* Added statuscache.db to cache IMAP STATUS data which
significantly reduces the amount of I/O necessary when
neither the
mailbox nor Seen state has changed -- courtesy of
Fastmail.fm
* Added option to unexpunge to restore messages by time
interval --
courtesy of David Carter
* Implemented undocumented IMAP SCAN extension, which
allows
Pine/Alpine to do cross-mailbox searches -- based on work of
David Carter
* Implemented incremental squat updates (see squatter.8) --
courtesy of
David Carter
* Fixed major bugs in reconstruct -k implementation --
courtesy of David
Carter

Check doc/changes.html for a complete list of changes.

If there are any outstanding issues that you believe still
need to be
addressed in 2.3.12, please let me know.

-- 
Kenneth Murchison
Systems Programmer
Project Cyrus Developer/Maintainer
Carnegie Mellon University

Ken Murchison wrote:
> I just put together a second release candidate for
Cyrus 2.3.12.  I'd
> appreciate any independent testing before I release
this to the masses.
> 
> http://www.contrib.andrew.cmu.edu/~murch/cy
rus-imapd-2.3.12rc2.tar.gz

I have tested the following:

> * Added option to unexpunge to restore messages by time
interval --
> courtesy of David Carter

Works very nicely!

 > * Added serverinfo option to control the information
displayed in
 >       banner greetings and capability responses.

Works

> * Implemented incremental squat updates (see
squatter.8) -- courtesy of
> David Carter

Seems to work, (running it works and it doesn't barf on
virtual mailboxes)

I also tested if reconstruct does his recurstion alright on
new virtual 
mailboxes.  (With a cyrus.header file only).  That works
too.

 > * Added option to mbexamine to compare quota usage in
cyrus.index to 
  > the actual message file sizes.

This works, but has a bug.

More specific.  If I do an unexpunge on a mailbox the quota
on a replica 
mailbox isn't any more correct.

Quota mailbox on master:
cyruskavula:~$ quota -d dict.ugent.be user/rudy
    Quota   % Used     Used Root
   250000       19    48071 user/rudydict.ugent.be

Quota mailbox on replica:
cyruskavula:~$ quota -C /etc/imapd-replica.conf -d
dict.ugent.be user/rudy
    Quota   % Used     Used Root
   250000       19    48071 user/rudydict.ugent.be

Both are in sync.

I do an unexpunge:

cyruskavula:~$ unexpunge -a -d user/rudydict.ugent.be
restoring all expunged messages in mailbox
'dict.ugent.be!user.rudy'
restored 14 out of 14 expunged messages

Quota on master:
cyruskavula:~$  quota -d dict.ugent.be user/rudy
    Quota   % Used     Used Root
   250000       19    48117 user/rudydict.ugent.be

Quota on replica not in sync:
cyruskavula:~$ quota -C /etc/imapd-replica.conf -d
dict.ugent.be user/rudy
    Quota   % Used     Used Root
   250000        9    24028 user/rudydict.ugent.be

mbexamine says it's all ok
cyruskavula:~$ mbexamine -C /etc/imapd-replica.conf -q 
user/rudydict.ugent.be
Examining user/rudydict.ugent.be...  Mailbox has CORRECT
total quota usage
Examining user/rudy/Folder1_restoredict.ugent.be...  Mailbox
has 
CORRECT total quota usage
Examining user/rudy/Sentdict.ugent.be...  Mailbox
has CORRECT total 
quota usage
Examining user/rudy/Testdict.ugent.be...  Mailbox
has CORRECT total 
quota usage
Examining user/rudy/Trashdict.ugent.be...  Mailbox
has CORRECT total 
quota usage
Examining user/rudy/rudydict.ugent.be...  Mailbox
has CORRECT total 
quota usage
Examining user/rudy/rudy/Folder1_restoredict.ugent.be...  Mailbox has 
CORRECT total quota usage
Examining user/rudy/rudy/Sentdict.ugent.be...  Mailbox
has CORRECT 
total quota usage
Examining user/rudy/rudy/Testdict.ugent.be...  Mailbox
has CORRECT 
total quota usage
Examining user/rudy/rudy/Trashdict.ugent.be...  Mailbox
has CORRECT 
total quota usage

Fix the quota and it now it's in sync again:
cyruskavula:~$ quota -C /etc/imapd-replica.conf -d
dict.ugent.be -f 
user/rudy
dict.ugent.be!user.rudy: usage was 24605660, now 49272171
    Quota   % Used     Used Root
   250000       19    48117 user/rudydict.ugent.be





-- 
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
-- -- -- --
Rudy Gevaert          Rudy.GevaertUGent.be          tel:+32 9
264 4734
Directie ICT, afd. Infrastructuur ICT Department,
Infrastructure office
Groep Systemen                    Systems group
Universiteit Gent                 Ghent University
Krijgslaan 281, gebouw S9, 9000 Gent, Belgie              
www.UGent.be
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
-- -- -- --

Unless I hear something major about the current code, I'm
going to 
release 2.3.12 on Monday.  I have some new code that I want
to commit as 
the start of 2.3.13.


Ken Murchison wrote:
> I just put together a second release candidate for
Cyrus 2.3.12.  I'd
> appreciate any independent testing before I release
this to the masses.
> 
> http://www.contrib.andrew.cmu.edu/~murch/cy
rus-imapd-2.3.12rc2.tar.gz
> 
> 
> Noteworthy changes:
> 
> * Added statuscache.db to cache IMAP STATUS data which
> significantly reduces the amount of I/O necessary when
neither the
> mailbox nor Seen state has changed -- courtesy of
Fastmail.fm
> * Added option to unexpunge to restore messages by time
interval --
> courtesy of David Carter
> * Implemented undocumented IMAP SCAN extension, which
allows
> Pine/Alpine to do cross-mailbox searches -- based on
work of David Carter
> * Implemented incremental squat updates (see
squatter.8) -- courtesy of
> David Carter
> * Fixed major bugs in reconstruct -k implementation --
courtesy of David
> Carter
> 
> Check doc/changes.html for a complete list of changes.
> 
> If there are any outstanding issues that you believe
still need to be
> addressed in 2.3.12, please let me know.
> 


-- 
Kenneth Murchison
Systems Programmer
Project Cyrus Developer/Maintainer
Carnegie Mellon University

On Fri, Apr 18, 2008 at 02:32:19PM -0400, Ken Murchison
wrote:
> Unless I hear something major about the current code,
I'm going to release 
> 2.3.12 on Monday.  I have some new code that I want to
commit as the start 
> of 2.3.13.

Sounds good to me.  I've rebuilt our patches against it
(finally).
Apologies for not giving you more feedback this week, I've
been
dealing with the fallout of upgrading our libdbd-mysql-perl
and
enabling server side prepared statements.

Don't.

The fricking thing inserted '0' where we said undef, which
means
NULL.  It even wrote NULL into the binlog.  Suffice to say,
it's
amazing what assumptions this triggers.  In the case I've
been
cleaning up from, "SELECT Id FROM Table WHERE
DeleteTime < $time"
looks a whole lot different when you have '0' for
DeleteTime
instead of NULL.

Grah.

Um, anyway, as I was saying.  I've rebuilt fast_rename and
folder_limit patches, creating a transactional version of
mboxlist_findall.  It's slightly ugly in the "extending
an
interface without refactoring the whole bloody
codebase"
sort of way, but it looks good.  I'm about to test that
now.

Then I'll be ready to roll out when you release 2.3.12!

Bron.

On Sat, Apr 19, 2008 at 09:56:53PM +1000, Bron Gondwana
wrote:
> Um, anyway, as I was saying.  I've rebuilt fast_rename
and
> folder_limit patches, creating a transactional version
of
> mboxlist_findall.  It's slightly ugly in the
"extending an
> interface without refactoring the whole bloody
codebase"
> sort of way, but it looks good.  I'm about to test that
now.

Speaking of which, a big shout out to my friend
"tid" in all
its numerous forms:

struct txn *tid;
struct txn **tid;

tid for quota db...
tid for mailboxes db...

I'll have a compiling version of the above patches any day
now.

Bron.