Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-18725

dafilesrv very slow at getInfo() and size() operations for files within large directories

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.0.0, 6.4.12
    • Component/s: dafilesrv
    • Labels:
      None

      Description

      These two operations used a directory iterator to get the file info, stopping after 1st element.
      They only serialized what they needed, but the server walked the directory blindly trying to match the mask, which in these cases was always a non wildcad match and could therefore only match at most 1 element.

      The directory operation itself on v. large directories is expensive (file system cost).

      Spot cases where non wildcard simple requests and avoid directory iterator on server side.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jakesmith Jake Smith
                Reporter:
                jakesmith Jake Smith
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: