Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-12264 Rewrite the Thor SORT activity
  3. HPCC-8211

Allow SORT to specify the desired distribution/partition fields

    Details

      Description

      Currently a global

      SORT(ds, a, b)

      in thor implies that each unique combination of (a,b) must end up on the same node. There are situations where it would be useful for the distribution to be a subset of the sort criteria. E.g.,

      CHOOSEN(GROUP(SORT(ds, a, -cnt), a, 20, GROUPED);

      We could add an extra DISTRIBUTE() flag on SORT to indicate which fields must be on the same node.

      E.g.,

      SORT(ds, a, b, c, DISTRIBUTE(a,b))

      or just as easily it could indicate the trailing field

      SORT(ds, a, b, c, DISTRIBUTE(b))

      If there was no argument that could imply that no distribution was required.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ghalliday Gavin Halliday
                Reporter:
                ghalliday Gavin Halliday
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: