"pilerimport -d" stops saying "cannot open ..." after 1,000 mails

Issue #298 resolved
Former user created an issue

I have some 250,000 mails in a folder which I'd like to import into piler. As root I do:

cd /tmp

pilerimport -d /opt/archiv/.user-backup/cur

after approx. 1,000 mails I get the error:

"cannot open /opt/archiv/.user-backup/cur/1385998831.M812551P1982.mail.com,S=44013,W=44609:2,"

It used to work with 0.1.24, yet I re-installed 0.1.25rc1 in order to benefit from the corrected date handling.

When I re-run the import statement, I just get a bunch of dublicates, then it continues for another approx. 1,000 Mails - hence it's not sth. to do with a particular mail, is it?

Sometimes it imports a lot more than 1,000 Mails, sometimes quite a few less. Therefore I can't reliably import a given number of mails using some script.

Btw, thanks for a very fine piece of software!

Alex

Comments (2)

  1. Janos SUTO repo owner

    Unfortunately there is a bug in rc1: it fails to close a tmp file thus eventually you reach the max. open files limit. To fix the issue, please download the latest master branch, and it fixes this problem by adding the missing close() call. Sorry for the trouble. In the meantime I'll release rc2 to fix it, too.

  2. Log in to comment