Piler Export Mail Issue

Issue #361 wontfix
Venkateswarlu Dadagopu created an issue
While Export Mails using pilerexport -A

I have around 1000000 mails some mail getting error link this.

verification failed

verification FAILED. 321995.eml
verification FAILED. 321996.eml
verification FAILED. 321997.eml
verification FAILED. 322001.eml
verification FAILED. 322003.eml
verification FAILED. 322005.eml
verification FAILED. 322006.eml
verification FAILED. 322007.eml
verification FAILED. 322009.eml
verification FAILED. 322010.eml
verification FAILED. 322158.eml
verification FAILED. 322953.eml
verification FAILED. 322954.eml
verification FAILED. 322981.eml
verification FAILED. 322982.eml
verification FAILED. 322985.eml
verification FAILED. 323005.eml
verification FAILED. 323008.eml
verification FAILED. 323139.eml
verification FAILED. 323141.eml
verification FAILED. 323143.eml
verification FAILED. 323484.eml
verification FAILED. 323671.eml
verification FAILED. 323673.eml
verification FAILED. 323689.eml
verification FAILED. 323699.eml
verification FAILED. 323793.eml
verification FAILED. 323837.eml
verification FAILED. 323838.eml
verification FAILED. 323845.eml
verification FAILED. 323877.eml
verification FAILED. 323879.eml
verification FAILED. 323892.eml
verification FAILED. 323937.eml
verification FAILED. 323946.eml
verification FAILED. 323950.eml
verification FAILED. 323977.eml
verification FAILED. 324001.eml
verification FAILED. 324018.eml
verification FAILED. 324022.eml
verification FAILED. 324024.eml
verification FAILED. 324040.eml
verification FAILED. 324080.eml
verification FAILED. 324265.eml
verification FAILED. 324276.eml
verification FAILED. 325619.eml
verification FAILED. 325629.eml
verification FAILED. 325630.eml
verification FAILED. 325857.eml
verification FAILED. 325880.eml
verification FAILED. 327271.eml

how do i check how many mails verification failed is there any logs to check that.

Comments (14)

  1. Janos SUTO repo owner

    Probably the maillog. Can you send me 1-2 of these emails to check? If there are some not sensitive emails in the list...

  2. Venkateswarlu Dadagopu reporter

    where do i find the exact path of particular mails

    verification FAILED. 325880.eml verification FAILED. 327271.eml

    in which location /var/piler/store/00

  3. Janos SUTO repo owner

    OK, I'm checking those emails. 358787.eml and 358842.eml don't look like a valid email, since they have only a header, though they both had some attachments or mime parts as well. 356911.eml and 359391.eml have a body, though they both miss the attached file referenced. So I believe that the old archive is incomplete or damaged.

    Also please show me the ownership and permissions on /var/piler/store/00/539/36/fa, starting from /var/piler/, eg.

    ls -ld /var/piler
    ls -ld /var/piler/store
    ls -ld /var/piler/store/00
    ls -ld /var/piler/store/00/539
    ls -ld /var/piler/store/00/539/36
    ls -ld /var/piler/store/00/539/36/fa
    
  4. Venkateswarlu Dadagopu reporter

    drwxr-xr-x 9 piler piler 4096 May 24 10:36 /var/piler

    drwx------ 3 piler piler 4096 May 23 18:16 /var/piler/store

    drwx------ 9 piler piler 4096 Jul 24 00:03 /var/piler/store/00

    drwxr-x--- 258 piler piler 4096 Jun 5 14:59 /var/piler/store/00/539

    drwxr-x--- 173 piler piler 4096 Jun 17 13:20 /var/piler/store/00/539/36

    drwxr-x--- 2 piler piler 4096 Jun 13 15:56 /var/piler/store/00/539/36/fa

  5. Janos SUTO repo owner

    OK, they all seem right. Finally, show me ls -la /var/piler/store/00/539/36/fa output.

    Also connect to piler mysql database, and execute the following, and show me its output:

    select * from attachment where name='2014-0710-085248-CARE_60-cashier.log';

  6. Venkateswarlu Dadagopu reporter

    drwxr-x--- 2 piler piler 4096 Jun 13 15:56 . drwxr-x--- 173 piler piler 4096 Jun 17 13:20 .. -rw-r----- 1 piler piler 3112 Jun 12 10:54 4000000053993993324c26ec002040c036fa.m -rw-r----- 1 piler piler 2880 Jun 13 15:56 40000000539ad1e519c60f8400d979ee36fa.m

    Database changed mysql> select * from attachment where name='2014-0710-085248-CARE_60-cashier.log'; +--------+--------------------------------------+---------------+--------------------------------------+------------+------------------------------------------------------------------+------+-------+---------+ | id | piler_id | attachment_id | name | type | sig | size | ptr | deleted | +--------+--------------------------------------+---------------+--------------------------------------+------------+------------------------------------------------------------------+------+-------+---------+ | 200712 | 4000000053be072702a3607c0098ebafaf24 | 1 | 2014-0710-085248-CARE_60-cashier.log | text/plain | e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 | 3576 | 96849 | 0 | +--------+--------------------------------------+---------------+--------------------------------------+------------+------------------------------------------------------------------+------+-------+---------+ 1 row in set (3.62 sec)

  7. Venkateswarlu Dadagopu reporter
    [root@archive ~]#  ls -la /var/piler/store/00/539/36/fa
    total 16
    drwxr-x---   2 piler piler 4096 Jun 13 15:56 .
    drwxr-x--- 173 piler piler 4096 Jun 17 13:20 ..
    -rw-r-----   1 piler piler 3112 Jun 12 10:54 4000000053993993324c26ec002040c036fa.m
    -rw-r-----   1 piler piler 2880 Jun 13 15:56 40000000539ad1e519c60f8400d979ee36fa.m
    
    
    Database changed
    mysql> select * from attachment where name='2014-0710-085248-CARE_60-cashier.log';
    +--------+--------------------------------------+---------------+--------------------------------------+------------+------------------------------------------------------------------+------+-------+---------+
    | id     | piler_id                             | attachment_id | name                                 | type       | sig                                                              | size | ptr   | deleted |
    +--------+--------------------------------------+---------------+--------------------------------------+------------+------------------------------------------------------------------+------+-------+---------+
    | 200712 | 4000000053be072702a3607c0098ebafaf24 |             1 | 2014-0710-085248-CARE_60-cashier.log | text/plain | e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 | 3576 | 96849 |       0 |
    +--------+--------------------------------------+---------------+--------------------------------------+------------+------------------------------------------------------------------+------+-------+---------+
    1 row in set (3.62 sec)
    
  8. Venkateswarlu Dadagopu reporter
     pilerget 4000000053be072702a3607c0098ebafaf24
    Received: by mail-we0-f173.google.com with SMTP id t60so8370789wes.32
            for <archive@archive.carehospitals.com>; Wed, 09 Jul 2014 20:22:56 -0700 (PDT)
    X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
            d=1e100.net; s=20130820;
            h=x-original-authentication-results:x-gm-message-state:message-id
             :from:to:subject:date:content-type;
            bh=EynHo33t+wx6fux+BikuaQMdcGyQeOYnv30NXD//qio=;
            b=jRFasUwQoxn4vOZziu6mkFnvMBn7AY6bY+uCChinrG4Wo6E+4CWyYERpFaCC9yBm4H
             QYY0lPe+yahe2cBmVWvgE4yV1jZ3RDEBlqUOd6FWPuDmdCbqVdGU5FQNCaEHHxDfCfpf
             MFOgSmD5yPd7G5invioEbTNL2ttVKUQi0D0ymLUDNZ9ztYpk4upL/gx4O1ZatSCbNxAM
             zG7STOBuRJKQ54dF0nk1wMyJCQDKaHcG756hQe0L/TN3GTaLzrlq3Cr5uya0EgAqgUkl
             0EK/KaAo0oszK/QEuemYB98FgmJqKWBk9+A2J82N1B5edaKO4jtbhrX7YGzRkMY12Z2U
             prYA==
    X-Original-Authentication-Results: mx.google.com;       spf=neutral (google.com: manish@carefamily.in does                                                   not designate permitted sender hosts) smtp.mail=manish@carefamily.in
    X-Received: by 10.180.75.197 with SMTP id e5mr15957115wiw.76.1404962576709;
            Wed, 09 Jul 2014 20:22:56 -0700 (PDT)
    X-Gm-Message-State: ALoCoQliL70+8Vb4fiuwyJ44pON02c9Y6Z/lbQP98b9iXz4vRe48icPLw92wyEAT4YPQP5uw1++cMdH35xaTO71                                                  +nyAWLGG8q6+cuVJztd1ttG82w6cOEw8fQrbUfFWrkem6Z62nCWNaZDtT+eGEoYkkzQS/1HxrTw==
    X-Received: by 10.180.75.197 with SMTP id e5mr15957042wiw.76.1404962575719;
            Wed, 09 Jul 2014 20:22:55 -0700 (PDT)
    Return-Path: <manish@carefamily.in>
    Received: from carefamily.in ([115.249.62.136])
            by mx.google.com with ESMTP id bn4si10739349wib.14.2014.07.09.20.22.54
            for <gheewala.manish@carehospitals.com>;
            Wed, 09 Jul 2014 20:22:55 -0700 (PDT)
    Received-SPF: none (google.com: manish@carefamily.in does not designate permitted sender hosts) client-ip=1                                                  15.249.62.136;
    Authentication-Results: mx.google.com;
           spf=neutral (google.com: manish@carefamily.in does not designate permitted sender hosts) smtp.mail=m                                                  anish@carefamily.in
    Received: from CARE_60 by carefamily.in (MDaemon PRO v10.0.0)
            with ESMTP id md50000480932.msg
            for <gheewala.manish@carehospitals.com>; Thu, 10 Jul 2014 08:55:26 +0530
    X-Spam-Processed: carefamily.in, Thu, 10 Jul 2014 08:55:26 +0530
            (not processed: message from trusted or authenticated source)
    X-Authenticated-Sender: manish@carefamily.in
    X-MDRemoteIP: 10.10.43.227
    X-Return-Path: manish@carefamily.in
    X-Envelope-From: manish@carefamily.in
    X-MDaemon-Deliver-To: gheewala.manish@carehospitals.com
    Message-ID: <{66158B94-5C74-4B19-9F2D-7907C574AE6C}@CARE_60>
    From: "manish@carefamily.in" <manish@carefamily.in>
    To: <gheewala.manish@carehospitals.com>
    Subject: GoodSync Job='cashier' Stage=Post-Sync Result='' SyncOk=2 ChangesOk=2 SyncErr=0 Conflicts=0
    Date: 10 Jul 2014 03:22:53 +0000
    Content-type: multipart/mixed; boundary="{07385E9B-DF78-48CB-BF0A-14381E3F9E6E}"
    
    --{07385E9B-DF78-48CB-BF0A-14381E3F9E6E}
    Content-Type: text/plain; charset=UTF-8
    
    2014-07-10 08:52:48: ----- 7/10/2014 8:52:48 AM: Job 'cashier': ANALYSIS started by Periodic Timer on compu                                                  ter 'CARE_60' (GoodSync 9.3.4.5 x86 on Windows 7) -----
    2014-07-10 08:52:48: cashier: \\care_22\d$\aLL FILES =forced-PropDels=> E:\All_system_backup\Cashier\aLL FI                                                  LES, SavePrevVers, CleanupPrevVers=30d, CleanupOldGens=24m, TmpDest, EstReq, CopyLocked, DetectMovesAndRena                                                  mes, DetectFolderMoves, FileLinksDrill, Reconnect=3, ChangeLimit=10, PostAnalyzeAction=gheewala.manish@care                                                  hospitals.com, PostSyncAction=gheewala.manish@carehospitals.com
    2014-07-10 08:52:48: Exclude Hidden, Exclude System, Exclude licens*.rfo|cache.rfo|mru.rfo|mpp*.rfo|RoboFor                                                  m Online Account.rfp|name *._gstmp|/System Volume Information|Thumbs.db|.DS_Store
    2014-07-10 08:52:48: Locking folder \\care_22\d$\aLL FILES for write
    2014-07-10 08:52:48: Left: Reading State File \\care_22\d$\aLL FILES\_gsdata_\_file_state_v4._gs
    2014-07-10 08:52:51: Left: Files: 502 (excluded 10). Folders: 43 (excluded 2). \\care_22\d$ \\care_22\d$ NT                                                  FS, Free: 46.8 GB, Total: 54.9 GB
    2014-07-10 08:52:51: Locking folder E:\All_system_backup\Cashier\aLL FILES for write
    2014-07-10 08:52:51: Right: Reading State File E:\All_system_backup\Cashier\aLL FILES\_gsdata_\_file_state_                                                  v4._gs
    2014-07-10 08:52:51: Right: Files: 502 (excluded 0). Folders: 43 (excluded 1). E: NTFS, Free: 286 GB, Total                                                  : 408 GB
    2014-07-10 08:52:51: Two-side filters excluded 7 items
    2014-07-10 08:52:51: On disk smb://care_22/d$ space required for sync is 0 bytes, you have 46.8 GB
    2014-07-10 08:52:51: On disk file:///E: space required for sync is 183 KB, you have 286 GB
    2014-07-10 08:52:51: Changes: 2, Conflicts: 0, CopyTime: 0, CopyState: 0/0, Errors: 0
    2014-07-10 08:52:51: Left to Right: Copy File: 2
    2014-07-10 08:52:51: All Nodes (Live+Dead): 1195
    2014-07-10 08:52:51: ----- 7/10/2014 8:52:51 AM: Analysis Completed. Time 00:00:03, Speed: 185 files/s ----                                                  -
    2014-07-10 08:52:51: ===== 7/10/2014 8:52:51 AM: Job 'cashier': SYNC started by Periodic Timer on computer                                                   'CARE_60' =====
    2014-07-10 08:52:51: cashier: \\care_22\d$\aLL FILES =forced-PropDels=> E:\All_system_backup\Cashier\aLL FI                                                  LES, SavePrevVers, CleanupPrevVers=30d, CleanupOldGens=24m, TmpDest, EstReq, CopyLocked, DetectMovesAndRena                                                  mes, DetectFolderMoves, FileLinksDrill, Reconnect=3, ChangeLimit=10, PostAnalyzeAction=gheewala.manish@care                                                  hospitals.com, PostSyncAction=gheewala.manish@carehospitals.com
    2014-07-10 08:52:51: Copy Over '\\care_22\d$\aLL FILES\DESKTOP\REPORT 14 -15\CASH & BANK REPORT.14-15.ods'                                                   -> 'E:\All_system_backup\Cashier\aLL FILES\DESKTOP\REPORT 14 -15\CASH & BANK REPORT.14-15.ods'
    2014-07-10 08:52:52: Copy Over '\\care_22\d$\aLL FILES\DESKTOP\REPORT 14 -15\DAILY REPORT 2014 2015.ods' ->                                                   'E:\All_system_backup\Cashier\aLL FILES\DESKTOP\REPORT 14 -15\DAILY REPORT 2014 2015.ods'
    2014-07-10 08:52:52: Close Modified Folder (mod-time, acl): /DESKTOP/REPORT 14 -15
    2014-07-10 08:52:53: Save State File \\care_22\d$\aLL FILES\_gsdata_\_file_state_v4._gs
    2014-07-10 08:52:53: Save State File E:\All_system_backup\Cashier\aLL FILES\_gsdata_\_file_state_v4._gs
    2014-07-10 08:52:53: Items Synced OK: 2, Errors: 0
    2014-07-10 08:52:53: ===== 7/10/2014 8:52:53 AM: Sync Completed. Time: 00:00:02, Speed:  =====
    2014-07-10 08:52:53: Unlocking folder (set insync file) \\care_22\d$\aLL FILES\_gsdata_\_insync_v4.gsl
    2014-07-10 08:52:53: Unlocking folder (set insync file) E:\All_system_backup\Cashier\aLL FILES\_gsdata_\_in                                                  sync_v4.gsl
    2014-07-10 08:52:53:
    
    --{07385E9B-DF78-48CB-BF0A-14381E3F9E6E}
    content-disposition: attachment; filename="2014-0710-085248-CARE_60-cashier.log"
    Content-Type: text/plain; charset=UTF-8
    Content-Transfer-Encoding: quoted-printable
    
  9. Janos SUTO repo owner

    It seems that the attached file is missing from the retrieved email. Not sure what happened with it.

  10. Log in to comment