Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-19376

Spark use of keys: keyed join

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.12.x
    • Component/s: Spark-HPCC
    • Labels:
      None
    • Compatibility:
      Minor

      Description

      The HpccFile object will produce a Dataset<Row> implementation on a key which implements the JOIN operations.

      The idea is instead of remapping the right, the local iterator will be used and a lookup will be performed.

        Attachments

          Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HPCC-19373 Spark use of keys

          • Major - Major loss of function.
          • Resolved

            Activity

              People

              Assignee:
              rpastrana Rodrigo Pastrana
              Reporter:
              johnholt John Holt
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Due:
                Created:
                Updated:
                Resolved: