Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-22965 Next step disk refactoring
  3. HPCC-22290

Create a cache for createTypeInfoOutputMetaData(MemoryBuffer)

    XMLWordPrintable

Details

    • Sub-task
    • Status: Accepted
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • Core Libraries
    • None
    • Minor

    Description

      This should improve efficiency and memory usage, and may allow pointer comparison to check if two actual outputs are identical.

      It is non trivial because
      i) the memory buffer passed is sometimes part of a stream, with no known size.
      ii) the grouping information is separate, which is a pain for the hash table

      richardkchapman something to discuss...

      The primary benefit would be to common up definitions from the clients (especially roxie), rather than dafilesrv.

      Another possible change is to base the grouped meta data implementation on the ungrouped, but that wouldn't immediately help the comparison.

       

      Attachments

        Activity

          People

            ghalliday Gavin Halliday
            ghalliday Gavin Halliday
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: