Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-21527

Remove #OPTION('clusterSize') from the docs

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.0.20
    • Component/s: Documentation
    • Labels:
      None

      Description

      I'm using #OPTION('clusterSize') to decrease the effective number of nodes in the cluster.

      Most of the system respects that setting, but when I use:

      DATASET(1, createRec(COUNTER), LOCAL)

      it creates one record per actual node in the cluster and does not respect the setting.

      I am able to work around this, so not waiting for a fix, but don't want anyone else to have to track it down.  It caused a SEG in my work-unit, so took me a while to isolate.

      Here is a program that recreates the problem:

      IMPORT Std.System.Thorlib;
      node := Thorlib.node();
      nodes := Thorlib.nodes();
      OUTPUT(nodes, NAMED('NodeCount'));
      #option ('clusterSize', 5);
      myRec := RECORD
        UNSIGNED num;
      END;
      d := DATASET(1, TRANSFORM(myRec, SELF.num := node), LOCAL);

      OUTPUT(d, NAMED('OnePerNode'));

      // D now has 20  records (on a 20 node thor).  Should have 5.

        Attachments

          Activity

            People

            • Assignee:
              jamesdefabia Jim DeFabia
              Reporter:
              rdev Roger Dev
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved: