Indexes lost/reset

Issue #664 resolved
h created an issue

First of all, great product, very handy when you have 50GB+ of mail data :)

One small issue I'm facing, is that sometimes the Sphinxsearch indexes are 'lost'.

Initially, after importing all mail, the search/webui works perfect. Even after adding more mails, it works, so far, so good. The indexes in sphinx/ are several MBs or GBs (can't exactly remember).

But occasionally, searching in the webui just returns 'Empty search result'. Then looking at the sphinx index directory, all files are back to 0 or +-500 bytes sizes.

I'm using a non-standard path to the index, which are configured in /etc/sphinxsearch/sphinx.conf, example:

index main1 { source = main1 path = /backup/node1/piler/sphinx/main1 docinfo = extern dict = keywords min_prefix_len = 5 min_word_len = 1 }

This is similar for main2, 3, 4 and the rest of the indexes, obviously with different paths.

After reindexing and running the indexer.dela & indexer.main scripts, everything works again. And running the indexes scripts manually, does not reset the indexes. But have no clue why the indexes are 'lost' occasionally.

Thanks in advance for any ideas.

Running following versions, Debian wheezy 7.9 piler 1.1.1, build 904 sphinxsearch 2.2.10-release-1

Comments (3)

  1. Janos SUTO repo owner

    Make sure that the system doesn't run indexer --all. That effectively resets the sphinx files. See the "I can see only today's emails in the archive and not any single previous emails." in the FAQ.

  2. h reporter

    You are right, totally missed that one.

    I've commented the following line in /etc/cron.d/sphinxsearch

    @daily root . /etc/default/sphinxsearch && if [ "$START" = "yes" ] && [ -x /usr/bin/indexer ]; then /usr/bin/indexer --quiet --rotate --all; fi

    Thank you.

  3. Log in to comment