Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-11642

Reintroduce CHECKPOINT as a clever persist point

    XMLWordPrintable

Details

    Description

      Currently persists are often used to checkpoint progress through a workunit - but also allow the ecl to be modified and the job resubmitted.

      The problem with that system is the persists are not automatically deleted when they are no longer needed.

      CHECKPOINT would create persist points which were also mangled with the job name. The checkpoints would be deleted when they were no longer needed - i.e. when all other checkpoints have read the checkpoint, or when the entire job is completed.

      If the job never succeeds they would be deleted when they expire.

      Attachments

        Issue Links

          Activity

            People

              ghalliday Gavin Halliday
              ghalliday Gavin Halliday
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: