Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-2623

Thor multislave optimizations

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      In Thor configurations with multiple slaves per physical node (slavesPerNode>1), there is room for improvement if the slaves/master knew that the slaves co-existed on the same node:

      1) When dllsToSlaves is active (the default) - the master will serialize the query dll to all slaves, even if they are on same node. It should spot and send once.
      2) Some of the start up scripts could be improved by ssh'ing once per node, rather than once per slave.
      3) There's scope to avoid some NIC traffic if we used inter-process communication.
      4) Scope for co-operation between slaves over other resource limits (e.g. memory)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jakesmith Jake Smith
                Reporter:
                jakesmith Jake Smith
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: