Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-22911

Failing to translate uncompressed fixed width files

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.6.2, 7.4.26
    • Component/s: EclAgent, Thor
    • Labels:
      None

      Description

      Example:

      rec := RECORD
       unsigned8 id;
       string10 s;
      END;
      
      ds := DATASET(10, TRANSFORM(rec, SELF.id := COUNTER; SELF.s := (string)HASH(SELF.id)));
      
      fname := '~ds';
      
      rec2 := RECORD
       unsigned4 id;
       string12 s;
      END;
      
      dsdisk := DATASET(fname, rec2, FLAT);
      
      SEQUENTIAL(
       OUTPUT(ds, , fname, OVERWRITE, UPDATE);
       OUTPUT(dsdisk, ALL);
       COUNT(dsdisk);
      );
      

      Thor hits an error during the diskread:

      Fixed length file /home/jsmith/hpccdeb2/var/lib/HPCCSystems/hpcc-data/thor/ds._1_of_1 [DFS size=180] is not a multiple of fixed record size : 16

      HThor hits error during the disk count:

      Published record size 18 for file ~ds does not match coded record size 16

        Attachments

          Activity

            People

            • Assignee:
              jakesmith Jake Smith
              Reporter:
              jakesmith Jake Smith
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved: