Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-8957

CRC errors reported from compressed file

    XMLWordPrintable

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.10.4
    • 3.10.8
    • Thor
    • None

    Description

      Using Std.File.VerifyFile on a file that was output using COMPRESSED is reporting CRC errors

      import std;
      
      w1 := RECORD
                      INTEGER c;
                      STRING50 w := 'test';
      END;
      onerec := DATASET([{1}], w1);
      
      w1 expr(w1 lr, INTEGER c) := TRANSFORM
                      SELF.C := C;
                      SELF.w := 'test_' + (STRING)C;
      end;
      
      recCnt := 100;
      MANYREC := distribute(NORMALIZE(onerec, recCnt, expr(LEFT, COUNTER)));
      OUTPUT(manyrec,,'~aymen::test::small_file_not_compressed',OVERWRITE);
      OUTPUT(manyrec,,'~aymen::test::small_file_compressed', COMPRESSED, OVERWRITE);
      Std.File.VerifyFile('~aymen::test::small_file_not_compressed',true);
      Std.File.VerifyFile('~aymen::test::small_file_compressed', true);
      

      Attachments

        Activity

          People

            jakesmith Jake Smith
            richardkchapman Richard Chapman
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: