Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-14522

Affinity support in Thor

    XMLWordPrintable

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 6.0.0
    • Thor

    Description

      From various pieces of testing, processor affinity can have a big difference on the speed of multi threaded systems.

      We should consider having an option that would bind a slave process to a particular socket if there were more slaves than sockets enabled on the system. (Maybe another separate option to restrict to cores within the socket if there are > 1 processes per socket.) If we could also use the correctly associated memory that would provide more advantages.

      The disadvantage is that sort (and other cpu intensive operations) wouldn't be able to use all the cpus. In practice that is likely to lead to overcommited cpus anyway.

      The most efficient set up may possibly be 2 (number of socket) slave processes per node, and multiple slaves per slave process.

      Attachments

        Issue Links

          Activity

            People

              ghalliday Gavin Halliday
              ghalliday Gavin Halliday
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: