Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-22965 Next step disk refactoring
  3. HPCC-22290

Create a cache for createTypeInfoOutputMetaData(MemoryBuffer)

    XMLWordPrintable

    Details

    • Type: Sub-task
    • Status: New
    • Priority: Not specified
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Core Libraries
    • Labels:
      None

      Description

      This should improve efficiency and memory usage, and may allow pointer comparison to check if two actual outputs are identical.

      It is non trivial because
      i) the memory buffer passed is sometimes part of a stream, with no known size.
      ii) the grouping information is separate, which is a pain for the hash table

      Richard Chapman something to discuss...

      The primary benefit would be to common up definitions from the clients (especially roxie), rather than dafilesrv.

      Another possible change is to base the grouped meta data implementation on the ungrouped, but that wouldn't immediately help the comparison.

       

        Attachments

          Activity

            People

            • Assignee:
              ghalliday Gavin Halliday
              Reporter:
              ghalliday Gavin Halliday
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: