Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
Description
When pulling there is normally a pulling process per partition up to a maximum number of concurrent pullers.
However, if the target pullers are on the same host, they will be dedupped, meaning that if multiple partition parts are destined for the same node, there will only be 1 pull process (ftslave).
That means that if the source parts on various remote hosts, they will be read in series, not concurrently, which depending on the relative speeds of the target and network speeds/latencies, can significantly effect the throughput.
There is an option to prevent this commoning up "noCommon", but it is not exposed as an option either in dfuplus or esp/eclwatch.
Attachments
Issue Links
- relates to
-
HPCC-23300 Expose "noCommon" as DFU spray option in Eclwatch
-
- Resolved
-
-
HPCC-24627 Document "NoCommon" option for Spray operations in DFUPlus and ECLWatch
-
- Resolved
-