Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-17777

Potential crash when using DICTIONARY's if memory exhausted and graph starts spilling

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.6.8, 6.2.14
    • Fix Version/s: 6.4.0
    • Component/s: Thor
    • Labels:
      None
    • Environment:

      Description

      If there is memory pressure and a graph starts spilling, it may request that a prebuilt dictionary result is committed to disk.
      The dictionary result uses a stream writer to do so, which doesn't handle the sparse array that underlies the dictionary and fails during write, hitting the assert mentioned below.

      got this:

      System error: 3000: SLAVE #60 [10.193.65.20:8720]: assert(bufpos) failed - file: /jenkins/workspace/LN-Candidate-withplugins-5.6.8-1/LN/centos-6.0-x86_64/HPCC-Platform/common/thorhelper/thorcommon.cpp, line 1445
      

      Could someone please take a look at the archive

        Attachments

          Activity

            People

            • Assignee:
              jakesmith Jake Smith
              Reporter:
              allan Allan Francis Wrobel
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: