invalid message

[KEvin Devane]

Just updated to the latest repository version of mailpiler (solved my date problems with searching.. Thank you), but now getting the following while trying to import emails from a folder, also when I try to import a single email file. Pilerimport quits with a segment fault.

error importing: '/mount/emailarchive/emails/phef/05.mbox/Messages/645804.emlx' /mount/emailarchive/emails/phef/05.mbox/Messages/646610.emlx: invalid message, hdr_len: 0

the following is reported in syslog

Nov 13 21:45:50 ip-10-235-89-196 kernel: [ 3335.382843] pilerimport[6338]: segfault at 0 ip 00007f5236f4fba6 sp 00007fff19fe3e48 error 6 in libc-2.15.so[7f5236e0d000+1b5000]

Now sure what other information I need to provide.

[Janos SUTO]

please show me piler -V, and I assume you have upgraded the database schema as well. Also let's try the following command, and check if it runs properly

"pilertest /mount/emailarchive/emails/phef/05.mbox/Messages/646610.emlx"

Btw. do you get this segfault error for all emails with pilerimport?

[KEvin Devane]

Output from piler -V

piler 0.1.25-master-branch, build 850, Janos SUTO [e-mail]

Build Date: Wed Nov 13 20:59:41 UTC 2013 ldd version: ldd (Ubuntu EGLIBC 2.15-0ubuntu10.5) 2.15 gcc version: gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) Configure command: ./configure --localstatedir=/mount/emailarchive --with-database=mysql --enable-starttls --enable-tcpwrappers

Output of pilertest, also ends in segmentation fault: locale: en_US.UTF-8 build: 850 parsing... post parsing... message-id: [e-mail] from: * ****** * to: **** reference: subject: Fwd: Principle Cast body: Picture 1   * sent: 0, delivered-date: 0 hdr len: 0 body digest: 6d3ccdacbfcd79817e17ab3e4c1aca7a9671ad79ebf940a4d9f2 rules check: (null) retention period: 1605344580 i:1, name=Principle cast.JPG, type: image/jpeg, size: 6089736, int.name: /mount/emailarchive/emails/phef/05.mbox/Messages/646610.emlx.a1, digest: 8a9b7d298795eb4e4a064d498964f1c61ccb2c34ee11e6577ab7269044d80e66 attachments:image, direction: 0 spam: 0

Segmentation fault (core dumped)

---

Yes I tried importing a full folder of emails, and resulting in the same errors. Then tried individual messages one at a time, all giving the same error. Exported an email from the database and tried importing it back into the database with the same result.

I've applied the sql updates from the util folder.

[Janos SUTO]

If you have 2-3 emails that are not sensitive (preferably with attachment), then I'd clone a 10.x ubuntu, and test them. Btw. is there anything in the archiving_rules and retention_rules tables?

[KEvin Devane]

Both archiving_rules and retention_rules tables are empty. I'll download a few emails and sent them on to you for testing.

[Janos SUTO]

Thanks, I got the emails. I copied them to a fresh ubuntu 10 x64 VM, installed the master branch from scratch, and both pilertest and pilerimport could handle all 3 emails properly.

However perhaps I was mistaken and you have ubuntu 12 and not 10, right?

[KEvin Devane]

Yes, I've got ubuntu 12 installed. I can try a fresh install on another clean server (v 12) sometime today if I get some free time.

[Janos SUTO]

OK, let me try with ubuntu 12 as well.

[KEvin Devane]

Alright, a fresh install solve the issue. Not sure what went wrong. Thanks for the help

[Janos SUTO]

Found the same like you. It works properly on my freshly installed ubuntu 12. If you have some time, please try the following:

Dump the piler (mysql) database with mysqldump, copy it to the fresh machine, and import it. Then try running pilerimport again on the new machine.