pop3 import jobs configured at GUI don't run

[Torsten Göhler]

I use the docker-compose approach.

I configured pop3 import jobs in the GUI.

“Test Connecion” was successfull. Further, ‘pilerimport’ at the CLI for the same account works perfectly.

But, the jobs configured at the GUI remain ‘0/0 Pending’

…. is there anything to to configure additionally.

Where can I check

‌

Version:

piler -V

piler 1.3.10, build 998, Janos SUTO [e-mail]

Build Date: Mon Feb 8 20:14:34 UTC 2021

ldd version: ldd (Ubuntu GLIBC 2.31-0ubuntu9) 2.31

gcc version: gcc version 9.3.0 (Ubuntu 9.3.0-10ubuntu2)

OS: Linux 188df2d86a7d 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Configure command: ./configure --prefix=/usr --sysconfdir=/etc --localstatedir=/var --with-database=mariadb

MySQL client library version: 10.3.25

Extractors: /usr/bin/pdftotext /usr/bin/catdoc /usr/bin/catppt /usr/bin/xls2csv /usr/bin/unrtf /usr/bin/tnef libzip

root@adf7a33d25a3:/# date

Fri Dec 17 14:47:57 UTC 2021

root@adf7a33d25a3:/# ps

PID TTY TIME CMD

173 pts/0 00:00:00 bash

444 pts/0 00:00:00 ps

[Janos SUTO]

Show me piler’s crontab, and check if the cron daemon is running.

[Torsten Göhler]

Hi Janos,

voila:
root@adf7a33d25a3:/# cat /var/spool/cron/crontabs/piler

# DO NOT EDIT THIS FILE - edit the master and reinstall.

# (/usr/share/piler/piler.cron installed on Mon Feb 8 20:17:03 2021)

# (Cron version -- $Id: crontab.c,v 2.13 1994/01/17 03:20:37 vixie Exp $)

### PILERSTART

5,35 * * * * /usr/libexec/piler/indexer.delta.sh

30 2 * * * /usr/libexec/piler/indexer.main.sh

40 3 * * * /usr/libexec/piler/purge.sh

*/15 * * * * /usr/bin/indexer --config /etc/piler/sphinx.conf --quiet tag1 --rotate

*/15 * * * * /usr/bin/indexer --config /etc/piler/sphinx.conf --quiet note1 --rotate

*/5 * * * * /usr/bin/find /var/piler/www/tmp -type f -name i.\* -exec rm -f {} \;

*/5 * * * * /usr/bin/find /var/piler/error -type f|wc -l > /var/piler/stat/error

2 0 * * * /usr/libexec/piler/pilerpurge.py

### optional: populate accouting data

###30 6 * * * /usr/bin/php /usr/libexec/piler/generate_stats.php --webui /var/piler/www >/dev/null

### PILEREND

I suspected something like that but don’t know what needs to be there to process regading jobs config from the GUI.

and yes, /usr/sbin/cron is running.

thanks for care about it.

Torsten

[Janos SUTO]

Add import.sh as well, eg.

*/5 * * * * /usr/libexec/piler/import.sh

‌

[Torsten Göhler]

I tried /usr/libexec/piler/import.sh from cli and it fails for pop3 as well as for imap

when using POP3 with:

var/piler/imap /

/var/piler/imap /var/piler/imap

Traceback (most recent call last):

File "/usr/libexec/piler/imapfetch.py", line 188, in <module>

‌ main()

File "/usr/libexec/piler/imapfetch.py", line 158, in main

‌ conn = imaplib.IMAP4(server)

File "/usr/lib/python3.8/imaplib.py", line 198, in __init__

‌ self.open(host, port)

File "/usr/lib/python3.8/imaplib.py", line 303, in open

‌ self.sock = self._create_socket()

File "/usr/lib/python3.8/imaplib.py", line 293, in _create_socket

‌ return socket.create_connection((host, self.port))

File "/usr/lib/python3.8/socket.py", line 808, in create_connection

‌ raise err

File "/usr/lib/python3.8/socket.py", line 796, in create_connection

‌ sock.connect(sa)

ConnectionRefusedError: [Errno 111] Connection refused

‌

when using imap:

/var/piler/imap /

/var/piler/imap /var/piler/imap

Traceback (most recent call last):

File "/usr/libexec/piler/imapfetch.py", line 188, in <module>

‌ main()

File "/usr/libexec/piler/imapfetch.py", line 172, in main

‌ process_folder(conn, folder)

File "/usr/libexec/piler/imapfetch.py", line 64, in process_folder

‌ rc, data = conn.select(folder)

File "/usr/lib/python3.8/imaplib.py", line 747, in select

‌ typ, dat = self._simple_command(name, mailbox)

File "/usr/lib/python3.8/imaplib.py", line 1205, in _simple_command

‌ return self._command_complete(name, self._command(name, *args))

File "/usr/lib/python3.8/imaplib.py", line 1030, in _command_complete

‌ raise self.error('%s command error: %s %s' % (name, typ, data))

imaplib.error: SELECT command error: BAD [b'expected DQUOTE or \\ instead of " "']

‌

when I use the commandline tool “pilerimport” the import works

[Janos SUTO]

What are the connection parameters for the imap server? (Without the username and password).

Also try getting https://bitbucket.org/jsuto/piler/src/master/util/imapfetch.py I’ve just changed the default to tls enabled.

[Janos SUTO]

No news is good news.