Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-10377

Provide ability to analyse workunit performance

    XMLWordPrintable

    Details

      Description

      There are several situations where it would be useful to get more detailed timing information from a query, and have the system analyse. Some examples are:

      • Performance regression suite HPCC-10349 track performance improvements (and regressions) from release to release.
      • Repeated production processes - spot degradation /significant changes caused by changes in the platform, differences in the input data, or (more problematically) changes in the ECL.
      • Optimizing Thor queries - where is there significant skew in the data, and where is that causing problems? Are there sequential portions that should be executed in parallel. Are there problems with skew changing over time?
      • Optimizing roxie queries - what is the pattern of remote key access, and how does it change over time? How many disk seeks are going on? Are nodes being hit sequentially or randomly.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                shamser Shamser Ahmed
                Reporter:
                ghalliday Gavin Halliday
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated: