Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-19332

Large multi file source spray stalls for a long period after data transfer is finished

    XMLWordPrintable

    Details

    • Type: Regression
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.4.16
    • Component/s: DFU Server
    • Labels:
      None

      Description

      When spraying a very large set of source files (e.g. 100's of thousands), the progress gets to 100% , but the state doesn't change to completed for a long time after that.

      Examining what dfuserver is doing during one these apparent stalls, 1 core is pegged at ~100% in a thread that's always here (with some small variation):

      Thread 40 (Thread 0x7f66ef7fe700 (LWP 289662)):
      #0  0x00007f6712f5f889 in hashc(unsigned char const*, unsigned int, unsigned int) () from /opt/HPCCSystems/lib/libjlib.so
      #1  0x00007f6712f91cec in LocalPTree::setAttribute(char const*, char const*) () from /opt/HPCCSystems/lib/libjlib.so
      #2  0x00007f6712f90014 in PTree::setProp(char const*, char const*) () from /opt/HPCCSystems/lib/libjlib.so
      #3  0x00007f6715cf1be1 in ?? () from /opt/HPCCSystems/lib/libdalift.so
      #4  0x00007f6715cf296d in ?? () from /opt/HPCCSystems/lib/libdalift.so
      #5  0x00007f6715cf7930 in ?? () from /opt/HPCCSystems/lib/libdalift.so
      #6  0x00007f6715cdb22b in ?? () from /opt/HPCCSystems/lib/libdalift.so
      #7  0x000000000040eeb3 in ?? ()
      #8  0x0000000000409279 in ?? ()
      #9  0x00007f6712fe6e1c in Thread::begin() () from /opt/HPCCSystems/lib/libjlib.so
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                attilavamos Attila Vamos
                Reporter:
                jakesmith Jake Smith
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: