Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-13340

Enhance PARSE function with CSV option

    Details

    • Type: New Feature
    • Status: Active
    • Priority: Not specified
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Code Generator, Language
    • Labels:

      Description

      Extend PARSE with a CSV(...) option. The idea is to expose the CSV parse for dataset to a broader use.

      Motivation:
      Some CSV files have sequences that prevent the file from being sprayed correctly and parsed correctly. In particular, embedded line end sequences in text fields can pose difficulties. One means of fixing these files is to process the stream and re-assemble the broken strings. At that point it would be convenient to be able to use the dataset CSV parse feature.

      There are 2 current work arounds available. The first is to just write the file with a OUTPUT(...CSV) action. The second option is the use PARSE and a specific rule to perform the field assignments.

        Attachments

          Activity

            People

            • Assignee:
              anybody Available for anyone
              Reporter:
              johnholt John Holt
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: