Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-22632

Add a Spray option to spray a HPCC (FLAT) file.

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Scheduled
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: DFU Server, EclWatch, Plugins
    • Labels:
      None
    • Compatibility:
      Minor

      Description

      If you despray a binary (FLAT) file to a dropzone, there is no intuitive way to spray it back to a cluster.
      The main reason for that is that we don't support partitioning variable lenght binary files via spray, because there is no mechanism to discover the record boundaries.

      However, it is possible to 'trick' spray and get these files back to the cluster.
      If you use a Delimited spray and ensure nosplit is set, then the file will be copied without partitioning to the target cluster.

      That is not ideal, but it is used.

      It would be better to have an explicit way to do this via Eclwatch and fileservices, e.g. a HPCC file type spray option.
      For now this can do a nosplit copy and set the correct file type.
      We could also consider in future supplying the full record format and using it to partition.

        Attachments

          Activity

            People

            • Assignee:
              attilavamos Attila Vamos
              Reporter:
              jakesmith Jake Smith
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Due:
                Created:
                Updated: