strange thumbnails

Issue #95 closed
Bertrand Roessli created an issue

Hello,

if I import new photos into the current directory, ART detects them but some of

the thumbnails are “strange” as shown in the attachment.

If I reopen ART the problem is solved.

I use ART1.3 compiled on Debian.

Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 1292800 Bytes; truncating the entry
/home/roesslib/Raw/P5260892.ORF: Corrupt data near 0xce5e
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 215552 Bytes; truncating the entry
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 965120 Bytes; truncating the entry
/home/roesslib/Raw/P5260899.ORF: Corrupt data near 0xce5c
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 1452544 Bytes; truncating the entry
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 1399296 Bytes; truncating the entry
/home/roesslib/Raw/P5260904.ORF: Corrupt data near 0xce5c
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.

Thank You,

B. Roessli

Comments (16)

  1. Bertrand Roessli reporter

    I updated to the latest version and modified CMakeCache.txt before compiling but I get the same effect.

    (

    For some reasons I found 2 CMakeCache.txt files one in the directory where I have the script written by Morgan Hardwood that updates and compiles ART and the second one in the build/ subdirectory. So I changed both…

    find -iname "CMakeCache.txt"
    ./code-art/build/CMakeCache.txt
    ./CMakeCache.txt

    )

    B. Roessli

  2. agriggio repo owner

    I also don’t see anything strange… @Bertrand Roessli do you have to restart ART, or is it enough to refresh the file browser view to fix the thumbnails?

  3. Bertrand Roessli reporter

    Something I did not notice yesterday after recompiling with WITH_MYFILE_MMAP:BOOL=OFF is that if I refresh the browser the bad thumbnails disappear. Only the good onces are left. If I reopen ART only the good ones are visible. The others are missing.

    This was not the case with WITH_MYFILE_MMAP:BOOL=ON.As far as I remember all the files were ok after reopening ART.

    I sent you a random orf file sorry. I did not think the problem might be file dependent.

    I put bunch of files in

    https://drive.google.com/drive/folders/15uiW0Q2-j4lfgSmI8V20KTzLjTx8Klx0?usp=sharing

    Some of the culprits are

    /home/roesslib/Raw/P5260891.ORF: Corrupt data near 0xce5c
    Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
    Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 1333760 Bytes; truncating the entry
    /home/roesslib/Raw/P5260892.ORF: Corrupt data near 0xce5e
    Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
    Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 1239552 Bytes; truncating the entry
    /home/roesslib/Raw/P5260893.ORF: Corrupt data near 0xce62
    Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
    Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 1481216 Bytes; truncating the entry
    /home/roesslib/Raw/P5260894.ORF: Corrupt data near 0xce5c
    Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
    Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 1427968 Bytes; truncating the entry
    /home/roesslib/Raw/P5260895.ORF: Corrupt data near 0xce5e
    Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
    Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 412160 Bytes; truncating the entry
    Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
    Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 1354240 Bytes; truncating the entry
    /home/roesslib/Raw/P5260898.ORF: Corrupt data near 0xce61
    Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
    Warning: Directory Image, entry 0x0111: Strip 0 is outside of the data area; ignored.
    Error: Upper boundary of data for directory Photo, entry 0x927c is out of bounds: Offset = 0x00000df4, size = 1481740, exceeds buffer size by 895488 Bytes; truncating the entry
    /home/roesslib/Raw/P5260901.ORF: Corrupt data near 0xce5c
    /home/roesslib/Raw/P5260903.ORF: Corrupt data near 0xce61

    Thanks

  4. agriggio repo owner

    Thanks for the samples. However, they all open fine here, no thumbnail corruption.

    Maybe your disk is failing? Did you try opening from a different medium?

  5. Bertrand Roessli reporter

    You are right!

    If I open the files from google drive directly the thumbnails are all fine.

    I repeated the exercise with Rawtherapee with the same effects as in ART. Some of the thumbnails are black. If I refresh the browser than everything is ok.

    I will recompile ART with  WITH_MYFILE_MMAP:BOOL=ON. I can live with the option of refreshing the browser.

    Thanks

    B. Roessli

  6. Bertrand Roessli reporter

    May-be the problem comes that I leave ART open and import files from the sd card to the disk and ART/Rawtherapee tries to read a file before it is copied to the end?

  7. Paul Matthijsse

    Hello Betrand, that could be quite well possible and explains why the thumbs are okay the second time you open ART/RT. Check that yourself: copy the same photos from your sd card to your disk without running Art, then start Art. Problem solved?

  8. agriggio repo owner

    It might definitely be the case that ART (and RT) tries to read the thumbnail before the file is completely copied. This might then cause the corruption that you are seeing. However, note that using WITH_MYFILE_MMAP=ON can make things worse, not better, as that might lead to ART crashing completely, instead of just not showing the thumbnail

  9. Log in to comment