Incorrect "From" and "Subject" titles in archive

[Andrey Khlebnikov]

Hello!

I'm new to mailpiler and just trying to understand is it suitable for my organization needs. I'm using preinstalled VM (date 2012.09.18) downloaded from mailpiler.org

Yesterday I've uploaded 70k+ emails into mailpiler's archive and found some issues:

1) the "From" field containing underscore ( _ ) incorrectly added in the archive, e.g. if real "From" is [e-mail] then archive will contain only [e-mail] (as shown in the attached picture). As a result any expert search based on "From" value of "[e-mail]" will not return anything, while the same search on value of "[e-mail]" will return required results.

2) the "Subject" field encoded in utf-8 in some cases is displayed incorrectly in search results (also shown in the same attached picture) The real "Subject" header value in this case is Subject: =?utf-8?B?UkU6ICDQodCj0J/QmiDQv9GA0L7RgdC40YIg0YDQsNGB0YHQvNC+0YLRgNC1?= =?utf-8?B?0YLRjCDQvdC+0LLQvtC1INC/0YDQtdC00LvQvtC20LXQvdC40LUg0LDQsdC+?= =?utf-8?B?0L3QtdC90YLQsA==?=

[Andrey Khlebnikov]

On the first picture I underlined the correct "From" with green line and thus erased the underscore symbol :-) The second picture is whithout any green/red lines

[Janos SUTO]

The underscore might be a separating character for sphinx. Can you try searching for the following:

from: word1 [e-mail]

will it provide any search hit?

The subject decoding might be fixed in the latest version, let's upgrade the web gui, and whether it's already fixed.

[Janos SUTO]

I've just updated the master branch to fix the underscore issue. Please download it, and after installing it, try sending similar emails, ie. [e-mail]

[Andrey Khlebnikov]

1) It seems now piler shows correct "From" addresses with underscore symbols. But it still can't search messages by such search string. If I try to search by address containing underscore in the "From" field the piler returns nothing. If the search string does not contain underscore then piler shows all found emails correctly.

2) Also it seems now piler correctly shows subjects encoded with utf-8. At least I did not find any malformed subject in a newly created test archive containing almost 3k of emails

[Janos SUTO]

1) Have you sent new emails with [e-mail] From: address? The fix applies to new emails only.

2) OK

[Andrey Khlebnikov]

I've reverted the VM snapshot, so piler's archive became empty. Then I've recompiled piler and tried to upload all the same messages as in the first time.

[Janos SUTO]

Have you updated the webui, too?

Btw. please try the demo site (http://www.mailpiler.org/en/demo.html), and login as the auditor user.

Then enter the following query, and check if the result looks fine:

[e-mail]

[Janos SUTO]

I believe this issue to be fixed. If think otherwise, then please reopen the issue.