MKV reconstruction fails CRC check

Issue #104 resolved

Gfy repo owner created an issue 2016-02-04

http://www.srrdb.com/release/details/Friends.S04E01.1080p.BluRay.x264-TENEIGHTY

Although the .srs file is verified against the main movie file, reconstruction fails with a CRC mismatch and is visibly broken. More samples from this season have the same problem.

More than 4k bytes are different between the two samples. An example:

00001613: 00 01
0001DA31: 0B 60
0001DA32: 77 0B
0001E42F: 0B 54
0001E430: 77 7F
0001EE2D: 0B 75
0001EE2E: 77 DB

Notice the repeating values for the broken reconstructed sample. Full difference included as attachment.

broken_good.txt

Comments (11)

Gfy reporter
The sample rebuild of The.Vampire.Diaries.S02E01.1080p.BluRay.x264-FLHD also fails: correct file size but wrong CRC.
- 2016-03-23T16:53:23+00:00

Gfy reporter

Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson

fc /b result:

Comparing files japhson-bntfosa-1080p-sample.mkv and JAPHSON-BNTFOSA-1080P-SAMPLE-BROKEN.MKV
00001610: 04 00
00042DCD: FC 7F
00042DCE: 3C FE
00042DCF: 7D 80
00042DD0: B2 01
000435A5: FC 7F
000435A6: 3C FE
000435A7: 7D 80
000435A8: B2 01

2017-08-29T19:55:44+00:00

Gfy reporter
- changed title to MKV reconstruction fails CRC check
- 2017-08-29T19:56:28+00:00
Gfy reporter
gMKVExtractGUI shows:

good sample
- "C:\Program Files\MKVToolNix\mkvextract.exe" --gui-mode --ui-language en tracks "D:\Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson\Sample\japhson-bntfosa-1080p-sample.mkv" 0:"D:\Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson\Sample\japhson-bntfosa-1080p-sample_track1_eng.avc" 1:"D:\Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson\Sample\japhson-bntfosa-1080p-sample_track2_eng_DELAY 3ms.dts"
- Extracting track 0 with the CodecID 'V_MPEG4/ISO/AVC' to the file 'D:\Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson\Sample\japhson-bntfosa-1080p-sample_track1_eng.avc'. Container format: AVC/h.264 elementary stream
- Extracting track 1 with the CodecID 'A_DTS' to the file 'D:\Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson\Sample\japhson-bntfosa-1080p-sample_track2_eng_DELAY 3ms.dts'. Container format: Digital Theater System (DTS)
- GUI#progress 3%
- GUI#progress 5%
broken reconstructed sample
- "C:\Program Files\MKVToolNix\mkvextract.exe" --gui-mode --ui-language en tracks "D:\Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson\Sample\japhson-bntfosa-1080p-sample-BROKEN.mkv" 0:"D:\Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson\Sample\japhson-bntfosa-1080p-sample-BROKEN_track1_eng.avc"
- Extracting track 0 with the CodecID 'V_MPEG4/ISO/AVC' to the file 'D:\Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson\Sample\japhson-bntfosa-1080p-sample-BROKEN_track1_eng.avc'. Container format: AVC/h.264 elementary stream
- GUI#progress 3%
- GUI#warning Track 0: NAL too big. Size according to header field: 3519159383, available bytes in packet: 262140. This NAL is defect and will be skipped.
- GUI#warning Track 0: NAL too big. Size according to header field: 2420664119, available bytes in packet: 65532. This NAL is defect and will be skipped.
- 2017-10-27T20:18:37+00:00
Gfy reporter
- 2017-10-27T20:30:40+00:00

zoke

Battle.Royale.2000.Directors.Cut.1080p.BluRay.x264-TENEIGHTY fails

Battle.Royale.2000.Directors.Cut.1080p.BluRay.x264-TENEIGHTY/Sample$ srs.py teneighty-battle.royale.directors.sample.srs ../teneighty-battle.royale.directors.rar 
SRS Load Complete...          Elapsed Time: 0.02s
Track Extraction Complete...  Elapsed Time: 0.33s
Rebuild Complete...           Elapsed Time: 0.52s

File Details:   Size           CRC
                -------------  --------
Expected    :      87.025.329  69334F2F
Actual      :      87.025.329  F7765F21

This is a known issue for LOL xvid releases.
Use -k to keep the result for investigation.

Rebuild failed for sample: teneighty-battle.royale.directors.sample.mkv

Adding this for informational purposes.

2017-10-27T20:58:59+00:00

Gfy reporter
https://www.matroska.org/technical/specs/index.html

ContentCompAlgo

The compression algorithm used. Algorithms that have been specified so far are: 0 - zlib, 1 - bzlib, 2 - lzo1x 3 - Header Stripping

ContentCompSettings

Settings that might be needed by the decompressor. For Header Stripping (ContentCompAlgo=3), the bytes that were removed from the beggining of each frames of the track.
- 2017-10-27T20:59:57+00:00

Gfy reporter

Version 0.5 is able to successfully reconstruct the sample from itself.

PS Burn.Notice.The.Fall.Of.Sam.Axe.2011.1080p.BluRay.x264-Japhson> .\srs.exe .\broken.srs .\orig.mkv
NOTE: install NumPy to speed up the reconstruction of RARs
      with a Recovery Record.
SRS Load Complete...          Elapsed Time: 0.00s
Track Location Complete...    Elapsed Time: 0.25s
Track Extraction Complete...  Elapsed Time: 0.51s
Warning: File .\broken.mkv already exists.
Do you wish to continue? (Y/N): y
Rebuild Complete...           Elapsed Time: 2.89s

File Details:   Size           CRC
                -------------  --------
Expected    :      50 060 045  12668740
Actual      :      50 060 045  12668740


Successfully rebuilt sample: broken.mkv

2017-12-29T23:14:14+00:00

Gfy reporter
MKV with header compression to sample without header compression works. (since 1.3 preview)

MKV with header compression to sample with header compression is overwriting the track data with the stripped header information when this is not needed.
- 2017-12-30T00:26:54+00:00
Gfy reporter
- changed status to resolved
Fix issue ~~#104~~ in case both mkv files use header compression

→ <<cset 98c808d56c56>>
- 2017-12-30T23:23:56+00:00
Gfy reporter
Issue ~~#132~~ was marked as a duplicate of this issue.
- 2017-12-31T11:17:23+00:00
Log in to comment

Assignee: Gfy

Type: bug

Priority: major

Status: resolved

Component: ReSample

Version: 0.6

Votes: 0

Watchers: 2

Comments (11)

good sample

broken reconstructed sample

ContentCompAlgo

ContentCompSettings