Thousands of emails stuck in /var/piler/tmp/

[Former user]

I use /var/piler/tmp as my tmp storage place, and I have thousands of emails stuck there. Also, when I run the piler debug I get buffer overflows on these emails. It looks like the last line is simply a long line on most of these emails.

Output of debug: line: http://pages.exacttarget.com/page.aspx?qs=330c754b5e92df745575a3cfb913dda1b6e5e74ceb2c50631e0e538e7faba67b3bb71be99e11feb385d49a68189d35c3e5f349c0b4ee14d38d2820a68c3fe24b6255335fef7d69f34c3f511ff08343c8cf3fe9d0932dd33c1f5484803748140db68a4cd7f5c96326a10f07a31b5a11f5db63dfe91bd5ad3e27cc485698acaaaf00543a657396b3f96c1710431bf8ca1e892ecb633a0975c96cd25b9a211968c4376bd9c4e46560596ee799f7f74b4b82dc69c9202d0de7d4514ecb13e26c93b72913ec7c6ec51025f2bb7452b04737eb1100c1188bc568924353ddd81ed4587d33f5eff4d0d886e4ac918bcd31d7facbaceec9b1875098b9229b388e15b6175efc651272c1327404d95893744b7307b02db46dc60ca2e57e9dfeb8b568aa3d3cf48ae0287bd5c3d2b6bdf16acd8b5614f45be1184fb7ec7886e7cb5a9acd2a29de4be845805455c74930198fd2b3bd905d1176383c4ca9f340858ac906ea0a6afb2d29036b64edf1c6e1c2238b9f5fcb buffer overflow detected : /home/aetco/Downloads/piler-0.1.22/test/debug terminated

[Janos SUTO]

try the latest master branch. Someone else reported a very similar bug, and it's been fixed. Also please report the following output:

ldd --version gcc -v 2>&1|tail -1

[Robert Chavers]

ldd --version

ldd (Ubuntu EGLIBC 2.15-0ubuntu10.3) 2.15

gcc -v 2>&1|tail -1

gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5)

I just upgraded to .22, but this problem has been happening ever since I installed piler a few months ago. I'll pull the master branch if there is a bug fix since .22 was released.

Anyway, thanks for the great software. So far it is working great!

[Janos SUTO]

OK, if you still encounter a buffer overflow (you can test it with the pilertest utility in the source directory), then please reopen this issue.

[Robert Chavers]

I pulled the master branch and tested with both debug and pilertest. The problem still exists. I can send you a copy of some of the emails if you want.

[Janos SUTO]

yes, please send me some emails causing trouble for you. See my address in piler -V

[Robert Chavers]

Email with attachment has been sent.

Also, once this issue is fixed, what do I do with the emails in the tmp folder? Should I just delete them or should I run them through piler again?

[Janos SUTO]

I've checked all of these emails, and on an ubuntu host (glibc 2.15 + gcc 4.6.3) I couldn't reproduce the problem with build >= 739. Btw. have you replaced the libpiler.so* files, too?

[Robert Chavers]

You are right, replacing the lib files fixed the problem.

I had run configure and did a make to test the emails, but did not actually "make install" the new version. After running "make install", the emails are working correctly now.

What should I do with all the left over tmp files?

[Janos SUTO]

you can remove them. Be careful and remove only the stale files in the directory. Or if you can afford stopping piler, then stop it, and issue an rm /var/piler/tmp/*, then start piler again.