Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-19774

Avoid serializing disk layout for indexes for remote reads where it can be avoided

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Accepted
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: dafilesrv
    • Labels:
      None
    • Compatibility:
      Minor

      Description

      Currently clients send the disk layout (fetched from Dali) in the request for remote reads.
      Indexes built that are >= 7.0 already have this information built into the physical file itself, so the disk layout info needn't be serialized.

      Older indexes only have the ECL record, which may not accurately reflect the index format, e.g. due to endian of unsigned fields and definition of key fields.
      The translation in these case of the ECL to rtlType info will need to patched up (see HPCC-19552).

      Once that is done, both the engines and dafilesrv can translate the ECL dynamically to rtlinfo and the serialization of the disk layout for indexes can be removed from the client requests.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jakesmith Jake Smith
                Reporter:
                jakesmith Jake Smith
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated: