Pilerimport taking too long with big Mailbox

[Tobias Eßinger]

I have one mailbox with 18000+ E-Mails in it. I want to use a Cronjob to run the pilerimporter to get the mails via IMAP authentification.
If I run a import on this mailbox it takes more than 20 minutes to import the mails.

I ran the import once to fill up the archive, but now i just want to look at the new mails with every import.

Is there a possibility to just look at the mails of the last day, 10 minutes or something like this?

Thank you very much for any help!

[Janos SUTO]

The imapfetch.py utility has better support for imap. So I’d recommend you to use it to download the emails, and then use pilerimport to import the downloaded emails.

imapfetch.py also supports the --date option allowing you specify something like

--date '(SINCE "16-May-2022")'

‌

[Tobias Eßinger]

Thank you very much for your help!

But I cant specify a date…
imapfetch.py: error: unrecognized arguments: --date (SINCE "16-May-2022")

what did I do wrong?

‌

[Janos SUTO]

You didn't pay attention to the quotes. Again, see what I wrote as an example.

[Tobias Eßinger]

I used the quotes as you told me to.

Hier my terminal in-and output:

root@mailpilernew:/usr/local/libexec/piler/# python3 imapfetch.py -s outlook.office365.com -P 993 -u testbias@####.de -p #### --date '(SINCE "16-May-2022")'
usage: imapfetch.py [-h] -s SERVER [-P PORT] -u USER -p PASSWORD [-x SKIP_LIST] [-f FOLDERS] [-v]
imapfetch.py: error: unrecognized arguments: --date (SINCE "16-May-2022")

‌

[Janos SUTO]

My bad. You have an older release. Get this one, and you’ll be fine: https://bitbucket.org/jsuto/piler/src/master/util/imapfetch.py

[Tobias Eßinger]

Thank you!!!
Helped me a Lot

[Janos SUTO]

I’m glad that it worked. One more advice: if possible I’d suggest to use smtp delivery or journaling to the archive, if it’s possible in your environment. As you can see, it’s a much more efficient method than the imap.