pilerimport does not work with zarafa IMAP Server

Import with pilerimport fails for me when using the import facility to import from an IMAP Server, in my case zarafa (http://www.zarafa.com/). It does work if i test it with my cyrus server though.

i am using piler-0.1.23 on Centos 6.4, 64bit

I am not good in understanding complex C-Code, therefore i was not able to find the reason for the failing import, but from what i understand the buf Variable does not contain what "tag" and "tagok" are looking for, it is always lagging one response behind:

sh-4.1$ pilerimport -i $host -u username -p 'password'
processing folder: Public folders... error: * 0 EXISTS
* 0 RECENT
processing folder: INBOX... error: * FLAGS (\Seen \Draft \Deleted \Flagged \Answered $Forwarded)
* OK [PERMANENTFLAGS (\Seen \Draft \Deleted \Flagged \Answered $Forwarded)] Permanent flags
* OK [UIDNEXT 1] Predicted next UID
* OK [UIDVALIDITY 5] UIDVALIDITY value
processing folder: Outbox... error: A4 OK [READ-WRITE] SELECT completed
processing folder: Deleted Items... error: * 1 EXISTS
* 0 RECENT
processing folder: Sent Items... error: * FLAGS (\Seen \Draft \Deleted \Flagged \Answered $Forwarded)
* OK [PERMANENTFLAGS (\Seen \Draft \Deleted \Flagged \Answered $Forwarded)] Permanent flags
* OK [UIDNEXT 1637417] Predicted next UID
* OK [UNSEEN 1] First unseen message
* OK [UIDVALIDITY 3688533] UIDVALIDITY value
processing folder: Drafts... error: A5 OK [READ-WRITE] SELECT completed
processing folder: Junk E-mail... error: * 0 EXISTS
* 0 RECENT

For each folder it is reporting errors. now what i did is, that i entered 3 debugging lines into imap.c, line 86:

   n = recvtimeoutssl(sd, buf, sizeof(buf), 10, use_ssl, data->ssl);

   printf("debug tag: %s\n", tag);
   printf("debug tagok: %s\n", tagok);
   printf("debug folder: %s\n", folder);

   if(!strstr(buf, tagok)){

from what i understand your code checks, that the contents of tagok is contained in buf, but in my case this is the debugging information:

processing folder: Public folders... error 1: * 0 EXISTS
* 0 RECENT

debug tag: A4
debug tagok: A4 OK
debug folder: Public folders

So we are trying to find "A4 OK" in buf, but buf has "0 EXISTS * 0 RECENT"

So are packets coming in in some wrong order? The logfile of zarafa-gateway.log also shows:

Tue Jul 23 15:58:52 2013: [26889] Starting worker process for IMAP request
Tue Jul 23 15:58:53 2013: [30580] IMAP Login from $host for user $user
**Tue Jul 23 15:59:05 2013: [30587] Failed to read line: Broken pipe**
Tue Jul 23 15:59:05 2013: [30587] Client $pilerhost thread exiting
Tue Jul 23 15:59:57 2013: [26889] Starting worker process for IMAP request
Tue Jul 23 15:59:58 2013: [30619] Disconnecting client.

Could it be that pilerimap does not read until the end of the tcp stream? this is what zarafa-gateways show in detail, so it seems to be replying properly:

Tue Jul 23 14:30:20 2013: [23399] Starting worker process for IMAP request
Tue Jul 23 14:30:20 2013: [26682] > * OK [CAPABILITY IMAP4rev1 LITERAL+ STARTTLS AUTH=PLAIN] Zarafa IMAP gateway ready
Tue Jul 23 14:30:20 2013: [26682] < A1 CAPABILITY
Tue Jul 23 14:30:20 2013: [26682] > * CAPABILITY IMAP4rev1 LITERAL+ STARTTLS AUTH=PLAIN CHILDREN XAOL-OPTION NAMESPACE QUOTA IDLE
Tue Jul 23 14:30:20 2013: [26682] > A1 OK CAPABILITY Completed
Tue Jul 23 14:30:20 2013: [26682] < A2 LOGIN user "password"
Tue Jul 23 14:30:21 2013: [26682] IMAP Login from host for user user
Tue Jul 23 14:30:21 2013: [26682] > A2 OK [CAPABILITY IMAP4rev1 LITERAL+ CHILDREN XAOL-OPTION NAMESPACE QUOTA IDLE] LOGIN completed
Tue Jul 23 14:30:21 2013: [26682] < A3 LIST "" "*"
Tue Jul 23 14:30:21 2013: [26682] > * LIST (\HasChildren) "/" "Public folders"
Tue Jul 23 14:30:21 2013: [26682] > * LIST (\HasNoChildren) "/" "INBOX"
Tue Jul 23 14:30:21 2013: [26682] > * LIST (\HasNoChildren) "/" "Outbox"
Tue Jul 23 14:30:21 2013: [26682] > * LIST (\HasNoChildren) "/" "Deleted Items"
Tue Jul 23 14:30:21 2013: [26682] > * LIST (\HasNoChildren) "/" "Sent Items"
Tue Jul 23 14:30:21 2013: [26682] > * LIST (\HasNoChildren) "/" "Drafts"
Tue Jul 23 14:30:21 2013: [26682] > * LIST (\HasNoChildren) "/" "Junk E-mail"
Tue Jul 23 14:30:21 2013: [26682] > A3 OK LIST completed
Tue Jul 23 14:30:21 2013: [26682] < A4 SELECT "Public folders"
Tue Jul 23 14:30:22 2013: [26682] > * 0 EXISTS
Tue Jul 23 14:30:22 2013: [26682] > * 0 RECENT
Tue Jul 23 14:30:22 2013: [26682] > * FLAGS (\Seen \Draft \Deleted \Flagged \Answered $Forwarded)
Tue Jul 23 14:30:22 2013: [26682] > * OK [PERMANENTFLAGS (\Seen \Draft \Deleted \Flagged \Answered $Forwarded)] Permanent flags
Tue Jul 23 14:30:22 2013: [26682] > * OK [UIDNEXT 1] Predicted next UID
Tue Jul 23 14:30:22 2013: [26682] > * OK [UIDVALIDITY 5] UIDVALIDITY value
Tue Jul 23 14:30:22 2013: [26682] > A4 OK [READ-WRITE] SELECT completed
Tue Jul 23 14:30:22 2013: [26682] < A5 SELECT "INBOX"
Tue Jul 23 14:30:22 2013: [26682] > * 1 EXISTS
Tue Jul 23 14:30:22 2013: [26682] > * 0 RECENT
Tue Jul 23 14:30:22 2013: [26682] > * FLAGS (\Seen \Draft \Deleted \Flagged \Answered $Forwarded)
Tue Jul 23 14:30:22 2013: [26682] > * OK [PERMANENTFLAGS (\Seen \Draft \Deleted \Flagged \Answered $Forwarded)] Permanent flags
Tue Jul 23 14:30:22 2013: [26682] > * OK [UIDNEXT 1637417] Predicted next UID
Tue Jul 23 14:30:22 2013: [26682] > * OK [UNSEEN 1] First unseen message
Tue Jul 23 14:30:22 2013: [26682] > * OK [UIDVALIDITY 3688533] UIDVALIDITY value
Tue Jul 23 14:30:22 2013: [26682] > A5 OK [READ-WRITE] SELECT completed

i also tried it with a different zarafa server on a different network segment but the results are the same. i have no ideas anymore.

any help is appreciated. thank you j

Comments (17)