Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-23428

Avoid the need to backpatch indexes

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.8.0
    • Component/s: JHTree
    • Labels:
    • Compatibility:
      Minor
    • Roadmap:
      2020q1
    • Roadmap Summary:
      Refactor index format so that it can be entirely streamed without needing to seek back to update the header. This will help support external file stores where seeking is not allowed.

      Description

      Currently when an index is built the header of the file is updated after everything else.  This means that the output cannot be done through a purely streaming interface.  We should investigate what information is being updated, and allow this step to be removed.  Possibilities include defaulting to the last node if the offsets are not set up, or duplicating the header of the file at the end.

      Requires more investigation.

        Attachments

          Activity

            People

            • Assignee:
              richardkchapman Richard Chapman
              Reporter:
              ghalliday Gavin Halliday
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: