Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-17483

Avoid index read operation blocking for unnecessarily long periods on critical section in lazy io implementation

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.4.0
    • Component/s: Roxie
    • Labels:

      Description

      Currently the lazy IFileIO implementation in Roxie holds a critical section per io operation (e.g. read()). It does this so that it can ensure that the asynchronous thread that closes files (if they haven't been accessed in a while), is thread safe.

      This has the unfortunate side-effect of causing all index reads to be contended/serialized.

      It should be changed so that the io operations are blocked for as little time as possible.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jakesmith Jake Smith
                Reporter:
                jakesmith Jake Smith
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: