Replace Sphinx with Elasic Search Fulltext

Janos SUTO repo owner

Well, you are right, such a change would indeed be a major one. And a painful one, as the search engine is at the core of piler. For starters, I think it would be difficult for the some piler admins with little Linux skills to make the conversation.

I'm not sure about the real reason why I needed to replace such a core component. Your reasoning has some interesting stuff, but I don't see them as the real deal that would justify such a huge job. Not to mention the consequences. I mean the schema-free structure might be a nice thing, but I believe it has little value to piler, since its schema hasn't changed in the past much. Also I don't see how JSON would improve anything, and I prefer the mysql compatible interface of sphinx. Sphinx also has a helpful community. Last, but not least you may also implement sharding with sphinx.

So at the moment I don't feel the urge to replace sphinxsearch by elasticsearch. Especially when I can't see any hard evidence about the viability of such change, eg. how the archive works under load, how the piler community would receive such change, a clear and easy procedure to migrate sphinx data to elasticsearch, etc.

2018-09-18T12:33:05+00:00

Comments (2)

Janos SUTO repo owner
Well, you are right, such a change would indeed be a major one. And a painful one, as the search engine is at the core of piler. For starters, I think it would be difficult for the some piler admins with little Linux skills to make the conversation.

I'm not sure about the real reason why I needed to replace such a core component. Your reasoning has some interesting stuff, but I don't see them as the real deal that would justify such a huge job. Not to mention the consequences. I mean the schema-free structure might be a nice thing, but I believe it has little value to piler, since its schema hasn't changed in the past much. Also I don't see how JSON would improve anything, and I prefer the mysql compatible interface of sphinx. Sphinx also has a helpful community. Last, but not least you may also implement sharding with sphinx.

So at the moment I don't feel the urge to replace sphinxsearch by elasticsearch. Especially when I can't see any hard evidence about the viability of such change, eg. how the archive works under load, how the piler community would receive such change, a clear and easy procedure to migrate sphinx data to elasticsearch, etc.
- 2018-09-18T12:33:05+00:00
Janos SUTO repo owner
- changed status to closed
No news is good news.
- 2019-01-13T16:21:11+00:00
Log in to comment