Trouble Importing using Pilerimport/pilerexport/readpst

[Former user]

Having some issues trying to get PST files imported. I initially followed the instructions in the documentation where I ran 'pilerexport -A' to get about 900 *.eml files. First tried to import en-masse using 'pilerimport -d /path/to/files' and received a ton of duplicate error messages that looked like this:

duplicate: 1.eml (duplicate id: 1)
duplicate: 2.eml (duplicate id: 2)
duplicate: 25.eml (duplicate id: 25)
duplicate: 634.eml (duplicate id: 634)

I also receive that message when trying to import them one .eml file at a time.

Since that failed, I gave another option a shot. I converted my PST to mbox format using the following command:

'readpst -o Archives2 Archives2.pst'

After the new files were created with the folder names that were included in the PST, I tried importing them using 'pstimport -m ' and received the following errors:

pilerimport -m CDW
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
failed to find text.conf in search path dirs
processed:      10

I've run searches through the issues forum here as well as Google and haven't been able to find anything related to these errors. Thanks in advance for any insight.

mailpiler latest rc2 build, centos 6.5 x86_64

Edit: I forgot to mention that I originally had these files chowned to 'piler' but still under the /root directory. I later moved them to /tmp due to some suggestions I had seen on the issues forum here, but I still received the same errors in both the mbox import and .eml import.

[Former user]

The mbox format import issue is a redhat/fedora bug. Following the workaround instructions located in the link below resolved the issue for importing, but the import is not clean.

https://bugzilla.redhat.com/show_bug.cgi?format=multiple&id=1060513

By 'not clean' I mean that messages in the web gui show up with no headers and <no subject>. Trying to restore message to the main account gets a message where the headers aren't parsed and there is a large encoded .rtf file attached to the end.

Still searching for a solution to the 'duplicate' .eml issue.

[Ludji]

'Duplicate' isn't an issue, it just tells you that you tried to import an email that was already in the piler database. It's the deduplication process

[Janos SUTO]

I think there may be a problem with the readpst results. I'd like you to run readpst -b -M aaa.pst, then check the individual files, whether they look like a correct EML format email. And make sure they don't have an extra rtf attachment. Then try importing them again.

[Former user]

Looks like they exported cleanly this time. No huge RTF attachments. However:

[root@conf-dm-piler ESRI ArcGIS]# pilerimport -e 2
duplicate: 2 (duplicate id: 0)

[root@conf-dm-piler ESRI ArcGIS]# pilerimport -e 3
duplicate: 3 (duplicate id: 0)

[root@conf-dm-piler ESRI ArcGIS]# pilerimport -e 4
duplicate: 4 (duplicate id: 0)

[root@conf-dm-piler Stored Emails]# pilerimport -d VMWare/
duplicate: VMWare//7 (duplicate id: 0)
duplicate: VMWare//2 (duplicate id: 0)
duplicate: VMWare//6 (duplicate id: 0)
duplicate: VMWare//3 (duplicate id: 0)
duplicate: VMWare//8 (duplicate id: 0)
duplicate: VMWare//4 (duplicate id: 0)
duplicate: VMWare//5 (duplicate id: 0)
processed:           7
[root@conf-dm-piler Stored Emails]#

This is the first time I've tried to import any of these specific emails. I've checked in the web GUI and these emails are not present in the archive.

[Janos SUTO]

The pilerimport utility thinks these are duplicated messages, that's why you don't see them in the archive. I suspect that these messages either have no valid message-id or they have the same message-id.

[Former user]

Made a breakthrough this morning - I was able to import .eml files successfully using 'pilerimport -e x.eml' after exporting them from my PST using the outlookfreeware tool 'Export messages to EML format'.

If you like, I can package up some export examples from all three utilities if you want to analyze them for differences. I would prefer to not post those publicly though.

[Janos SUTO]

Yes, it would be great. Please send it to my email, see piler -V