Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-14805

Only pull logical file meta data from Dali if newer than local cached copy

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Accepted
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: DFS, EclWatch, Roxie
    • Labels:
      None
    • Compatibility:
      Major

      Description

      Currently when packages are deployed, Roxie requests pulls all the referenced file meta data from Dali.
      This can be quite expensive for Dali, every roxie node pulls all meta each deploy (possibly each time Roxie is started also).

      It would be an improvement, if we added a mechanism to request the meta file info based on a crc.
      If roxie has the meta data already, it can provide the crc and then Dali could conditionally return new meta or acknowledge that requester is already up to date.

      Anthony Fishbeck Richard Chapman

        Attachments

          Activity

            People

            • Assignee:
              richardkchapman Richard Chapman
              Reporter:
              jakesmith Jake Smith
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: