Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-12906

Roxie spilling sort allocates array too late?

    XMLWordPrintable

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Timed Out
    • None
    • None
    • Roxie

    Description

      When roxie determines that a sort needs to spill, it allocates the index array needed to make the quicksort stable (using malloc heap).

      There is no guarantee that this will succeed, and you could argue that it should be taken from the roxiemem heap. Other components allocate this array as they go along (to ensure that it will succeed).

      There are disadvantages to allocating as you go - in particular it puts a burden on the cases that don't need to spill.

      Worth discussing if there are any alternative approaches (a shared "scratch" memory area that was preallocated, for example).

      Attachments

        Activity

          People

            Unassigned Unassigned
            richardkchapman Richard Chapman
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: