Users mails are not shown in the gui (LDAP Users).

[B.JEGADEESAN]

Hi,

In our environment we configured LDAP authentication from the mail server. Now users can login successfully with their own credentials but the users mails are not shown in the gui. Am check with var/log/mail log i got the below mentioned error.

ERROR: piler piler-webui[2096]: ERROR: SQLSTATE[42000]: Syntax error or access violation: 1064 index dailydelta1,delta1,main1: query error: no field 'sender' found in schema

Please give a guidance to short it out the issue. Am attached the screenshot for your reference.

[Janos SUTO]

Please read the comments about the “STRICT_SCHEMA” in sphinx.conf file. I think your sphinx config settings doesn’t match the version of sphinx.

Also what piler and sphinx versions do you have?

[B.JEGADEESAN]

We had sphinx-2.2.11 version and piler-1.4.4 version (latest Master branch installed).

[Janos SUTO]

2.2.11 is way outdated. Please install 3.3.1 or perhaps 3.5.1.

[B.JEGADEESAN]

I am done some changes in our sphinx.conf file and after running indexer --all --config /usr/local/etc/piler/sphinx.conf command and restart the searchd i got the below output. and am checked the var/log/maillog.

OUTPUT:

/etc/init.d/rc.searchd restart
stopping searchd
starting searchd . . .
Sphinx 2.2.11-id64-release (95ae9a6)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com))

using config file '/usr/local/etc/piler/sphinx.conf'...
WARNING: key 'log' is not multi-value; value in /usr/local/etc/piler/sphinx.conf line 107 will be ignored.
listening on 127.0.0.1:9312
listening on 127.0.0.1:9306
precaching index 'tag1'
precaching index 'note1'
precaching index 'piler1'
precached 3 indexes in 0.003 sec

LOG OUTPUT:

ERROR: SQLSTATE[42000]: Syntax error or access violation: 1064 unknown local index 'main1' in search request

Now in my auditor user also not shown the mails.

‌

[Janos SUTO]

I asked you to upgrade sphinx to 3.3.1, then recreate the index data files. Let me know when you are done.

[B.JEGADEESAN]

Hi,

As per your guidance am upgraded my sphinx version from 2.2.11 to 3.3.1 after that am make the configuration changes in sphinx.conf file and then run the indexer --all --config /usr/local/etc/piler/sphinx.conf command and got the output below.

OUTPUT:

Sphinx 3.3.1 (commit b72d67b)
Copyright (c) 2001-2020, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com))

using config file '/usr/local/etc/piler/sphinx.conf'...
WARNING: key 'log' is not multi-value; value in /usr/local/etc/piler/sphinx.conf line 218 will be ignored.
indexing index 'main1'...
collected 0 docs, 0.0 MB
total 0 docs, 0.0 Kb
total 0.0 sec, 0.0 Kb/sec, 0 docs/sec
indexing index 'main2'...
collected 0 docs, 0.0 MB
total 0 docs, 0.0 Kb
total 0.0 sec, 0.0 Kb/sec, 0 docs/sec
indexing index 'main3'...
collected 0 docs, 0.0 MB
total 0 docs, 0.0 Kb
total 0.0 sec, 0.0 Kb/sec, 0 docs/sec
indexing index 'main4'...
collected 0 docs, 0.0 MB
total 0 docs, 0.0 Kb
total 0.0 sec, 0.0 Kb/sec, 0 docs/sec
indexing index 'dailydelta1'...
collected 0 docs, 0.0 MB
total 0 docs, 0.0 Kb
total 0.0 sec, 0.0 Kb/sec, 0 docs/sec
indexing index 'delta1'...
collected 0 docs, 0.0 MB
total 0 docs, 0.0 Kb
total 0.0 sec, 0.0 Kb/sec, 0 docs/sec
indexing index 'tag1'...
collected 0 docs, 0.0 MB
total 0 docs, 0.0 Kb
total 0.0 sec, 0.0 Kb/sec, 0 docs/sec
indexing index 'note1'...
collected 0 docs, 0.0 MB
total 0 docs, 0.0 Kb
total 0.0 sec, 0.0 Kb/sec, 0 docs/sec

And then am restart the searchd service i got the below output.

stopping searchd
/etc/init.d/rc.searchd: line 44: kill: `': not a pid or valid job spec
starting searchd . . .
Sphinx 3.3.1 (commit b72d67b)
Copyright (c) 2001-2020, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com))

using config file '/usr/local/etc/piler/sphinx.conf'...
WARNING: key 'log' is not multi-value; value in /usr/local/etc/piler/sphinx.conf line 218 will be ignored.
listening on 127.0.0.1:9312
listening on 127.0.0.1:9306
precaching index 'main1'
precaching index 'main2'
precaching index 'main3'
precaching index 'main4'
precaching index 'dailydelta1'
precaching index 'delta1'
precaching index 'tag1'
precaching index 'note1'
precached 8 indexes using 8 threads in 0.0 sec

Searchd is not running and am checked with the var/log/maillog there is no error regarding this issue. Please help me to fix this issue.

[B.JEGADEESAN]

Hi,

Finally am fixed the issue now everything is working fine. And now we are able to login as auditor and also LDAP user and they can get their own mails successfully.

Thanks for your support and guidance…

[Janos SUTO]

Great. Have a nice day.

[B.JEGADEESAN]

Below steps to be followed for fixed the users mail not shown issue in mailpiler with sphix version2.2.1:

Sphinx version upgradation from version 2.2.11 to 3.3.1.

SOURCE FILE : https://download.mailpiler.com/generic-local/sphinx-3.3.1-bin.tar.gz

tar -zxvf sphinx-3.3.1-bin.tar.gz

cd sphinx-3.3.1

find / -iname indexer
/usr/bin/indexer

/etc/init.d/rc.searchd stop
/etc/init.d/rc.piler stop

su - piler
crontab -e

#5,35 * * * * /usr/local/libexec/piler/indexer.delta.sh
#30 2 * * * /usr/local/libexec/piler/indexer.main.sh

mv /usr/bin/indexer /usr/bin/indexer_2.2.1
cp /var/piler/sphinx-3.3.1/bin/indexer /usr/bin/.

mv /usr/bin/indextool /usr/bin/indextool_2.2.1
cp /var/piler/sphinx-3.3.1/bin/indextool /usr/bin/.

mv /usr/bin/searchd /usr/bin/searchd_2.2.1
cp /var/piler/sphinx-3.3.1/bin/searchd /usr/bin/.

mv /usr/bin/wordbreaker /usr/bin/wordbreaker_2.2.1
cp /var/piler/sphinx-3.3.1/bin/wordbreaker /usr/bin/.

cd /usr/local/etc/piler/
mv sphinx.conf sphinx.conf_2.2.1

cd /etc/sphinx/
mv sphinx.conf sphinx.conf_2.2.1

nano sphinx.conf

cd /usr/local/etc/piler/
cp sphinx.conf /etc/sphinx/.

nano /usr/local/etc/piler/config-site.php

ADD---> $config['SPHINX_STRICT_SCHEMA'] = 1;

cd /var/piler/
cp sphinx sphinx_bkp

rm -rf sphinx/*

su - piler
indexer --all --config /usr/local/etc/piler/sphinx.conf

su - root
/etc/init.d/rc.searchd start
/etc/init.d/rc.piler start

su - piler
reindex -a

crontab -e

UNCOMMAND THE BELOW CRONS:

5,35 * * * * /usr/local/libexec/piler/indexer.delta.sh
30 2 * * * /usr/local/libexec/piler/indexer.main.sh