Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-27887 Produce new index format that can be compared compressed
  3. HPCC-28467

Add number of leaf, blob and branch nodes to published meta

    XMLWordPrintable

Details

    • Sub-task
    • Status: Resolved
    • Not specified
    • Resolution: Fixed
    • None
    • 8.10.6
    • Dali, hthor, Roxie, Thor
    • None

    Description

      Publishing the number of leaf and branch nodes helps us understand quite a few things:

      Branch-compression = (num branches * nodeSize) / (number of leaves * (keysize+8))
      Leaf compression = (#leaves + #blobs) * nodeSize / uncompressedSize
      TotalBranch size = num-branches * nodeSize
      ratio of branches/leaves = #branches/#leaves.

      Total branch size for a query/query set gives a good idea of a typical node cache size that would avoid branch misses (with scaling depending on whether it is decompressed).

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              ghalliday Gavin Halliday
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: