Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-25317

CompressedSize missing (not published) if ECL targets a larger cluster on output

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.12.28
    • Component/s: Thor
    • Labels:
      None

      Description

      If OUTPUT, CLUSTER(<target-cluster>) is used and the target-cluster is wider then the cluster the query is running on, the compressedSize property will not be published.

      This is because Thor always writes a part per slave (no more), so when a file is targeted and published to a larger cluster, it has to pad out the file width with empty parts.
      However, it does not fill in the meta data for those parts.
      And when calculating the sum total, it stops if some of the part @compressedSize info. is missing.

        Attachments

          Activity

            People

            Assignee:
            jakesmith Jake Smith
            Reporter:
            jakesmith Jake Smith
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: