Images missing in some mails with logo in signature

[Thomas Stahl]

Hello all

User send Mails with signature. This includes corp logo.

In Outlook, Evolution, roundcube this signature shows ok.

In Piler webui in some mails this image are missing. no base64 data available.

Result is:, not verified Mail

Checking Mailfile from dovecotfolder is ok,

Export this Mail from Webgu as eml shows missing base64 data.

im frustrated, standing for a great wall

[Thomas Stahl]

Sorry, im using version 1.3.5

[Janos SUTO]

Is there such a problematic email with non sensitive data? I’d like to take a look at one, so please share it somehow. See my email in piler -V output.

[Thomas Stahl]

informed our postfmaster to send mail, thanks

[Janos SUTO]

Thanks, I got a sample. However, I can see a huge discrepancy between the email in dovecot and in piler. The email in piler has only the reference to the attachments, but the base64 encoded stuff is missing. I’d like to see the log entries for this message-id, ie.

grep '000001d549c0$bbd318e0$33794aa0$@de' /var/log/mail*log

I’m especially interested in the logged message size by piler-smtp. I suspect that by the time this message entered piler, it didn’t have any base64 stuff inside.

[Thomas Stahl]

Thanks four your time

found in maillog.

Aug 3 08:00:34 mxarch piler[28498]: 2/VI88B281OGU92KHT: 400000005d45230b0ff993a40037256c2fb4, size=16106/3000, attachments=3, reference=, message-id=000001d549c0$bbd318e0$33794aa0$@de, retention=4100, folder=0, delay=0.9802, status=stored
Aug 3 10:17:07 mxarch piler[28498]: 2/JTIDMCDKSJDVBAMJ: 400000005d45430c271d215400698ff14703, size=9428/3056, attachments=0, reference=000001d549c0$bbd318e0$33794aa0$@de, message-id=[e-mail], retention=4100, folder=0, delay=0.4662, status=stored

all clients have office 15 installed, some clients work other not. i have read outlook versions handles images in sigs in different way.

for outgoing mails whe can configer clients, but incoming mails?

again, great work

greetings

[Janos SUTO]

Well, I’ve sent your original email to my test environment, and it properly processed the email, and managed to retrieve it without any issue.

Try to get this email from the archive again, and monitor the mail log for any issues. There should be an error related to this mail.

[Thomas Stahl]

Puhhhh,

no error in log getting mal from archive.

we have extended our mailsystem

Mailserver#1 is sendmail with sm-archive (newest versions). - (not possible to replace this server at moment.)

piler #1 was version 1.3.4 and updated to 1.3.5 (make, make install) is here extra work to do?

Mailserver#2 running postfix with allways bcc

piler #2 was installed directly from 1.3.5

Sending mail over server#1 from outlook client (with igmage in sig) to mailadr on server#2 results in not verified in piler. installation #1 (Again not all Outlook Clients make this problem)

in piler#2 the mail shows good.

we will check again

• error in update, missing config entries
• problem in sm-archive ( suspicious )
• var/piler/www identical in piler#1 and piler#2

a little confused but hopefull

give us a little time to test

[Janos SUTO]

Sure, take your time.

[Thomas Stahl]

now checks completed

configs piler#1 and piler2 identical (differs only in sql settings and hostnames)

database structure identical

all compiled progs are on right places.

www folder identical

sm-archive ist testet by copy mail to annother mailadress (in sm-archive.conf). mail are completly incl. base64 data

we are at the end, no idea

debuglevel is no to 5 to get more info

oh, forgotten. install#1 is running on debian jessie. install#2 on debian stretch.

[Thomas Stahl]

sorry, false info. Mailserver #1 ist running on jessie.

both piler installations are running on debian stretch.

[Janos SUTO]

OK, let’s take a message which is sent from mailserver1 to mailserver2 and having attachments. I’d like to see the relevant logs from all 4 hosts: mailserver1, mailserver2, piler1 and piler2.

Piler has no problem processing attachments. I suspect that it’s lost at somepoint before it hits piler2/

[Thomas Stahl]

logentries has been sent. thanks

[Janos SUTO]

This is not what I expected (btw. the email you sent has no attachment).

I have the following understanding of your situation:

mailserver1 gets an email with attachments. It sends it to both piler1 and mailserver2. Then mailserver2 copies it to piler2. (Feel free to fix my preconception if necessary). So in such a scenario I’d like to see the log entries where I can see the message size for mailserver1, mailserver2, piler1 and piler2.

I don’t need the attachment sizes. From the above logs I have no clue which piler instance logged them, and if there’s a problem with this email’s attachments.

[Thomas Stahl]

oh no.

two mailservers

#1 is sendmail with sm-archve to make copy to piler 1 (this is the problematic)

#2 is postfix with allwas bcc to make copy piler 2 (hier is all fine)

Piler installation 1 and 2 are identical. (double double checked)

when a user send mail over mailserver 1 to address on mailserver 2 then situation is following

mailserver 1 delivery to mailserver 2 and make a copy to piler 1. piler archives but without attachements

mailserver 2 get mail vom mailserver 1 and make a copy to piler 2. this works fine

when an external user with included images send to user on mailserver 1 then same problems.

configering mailserver 1 to send the copy to piler 2 then piler 2 archives fine.

the problem is only wenn images in sig, include images in body are ok.

i think removing all piler relatet files incl. database from piler server 1 and then completly newinstall

we will compare the new configs und relatet files with new install and report the results.

this ist a work for weekend.

thanks for your time, but we will not stress anymore. you have another things to do

[Janos SUTO]

OK, thanks for clarifying. However, before the reinstall, I’d still check the sendmail logs and piler logs for such email. I’d really like to see the sizes for the whole email at both places.

[Thomas Stahl]

rc.piler stop, rc.searchd stop

dump archiving-rules, retention-rules from db

Deleted all Data, (mysql) and var/piler, usr/local/etc/piler

installing new from 1.3.5

changed config to values from old configs

tar var/piler , dump mysql piler for quick delete all data by restoring

restore archiving und retention rules (saves time)

with php get mails from imap, sort out all doubles, folders (trash, junk ……) and write in folder as eml

pilerimport from folder with eml (painfull in time )

pilerimport directly from imap the same, painfull.

after import:

seems all is ok, no missing images

and now? we think was a problem in database or sphinx data. (some attachments not stored)

all other is identical to old install.

thanks for your time

[Janos SUTO]

OK, I'm glad that it's finally solved.