Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-17521

Improve constant propagation into denormalize

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Accepted
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Code Generator
    • Labels:
      None
    • Compatibility:
      Minor

      Description

      Applies to other activities as well.

      At the moment constants are extracted from the transform of a project/denormalize (HPCC-17505 addresses a bug in this area).

      After the transformation has finished constants from the input will be percolated into the transform - so that next time the transform is called they will be constant in the output.

      This is inefficient (especially since the transform generally isn't called again). Instead there should be similar code to the rollup where any values that are preserved from the input dataset are also inherited as constant.

      I suspect the current code for rollup should be optimized and generalized. On an initial experiment with denormalize it resulted in a signficant extra number of fields being removed.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ghalliday Gavin Halliday
                Reporter:
                ghalliday Gavin Halliday
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: