Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-24229

Downloading workunit result as files should use streaming

    XMLWordPrintable

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 7.6.x
    • 7.12.0
    • WS-Workunit Server
    • None

    Description

      In prod400, a user sent in a request:
       
      0002C737 2020-06-11 10:04:17.339 1813885 1928142 "HTTP First Line: GET /WsWorkunits/WUResultBin?Format=xls&LogicalName=thor_data400::key::ln_propertyv2::20200526::deed.fid HTTP/1.1"

      {{The key file is 69GB, and this causes memory to go up rapidly. }}

      {{}}

      Better way is streaming the file without reading in mem first.

      Both cases for getWsWuResult() and getFileResults{{() code paths need to be handled.}}

      {{}}

      Attachments

        Issue Links

          Activity

            People

              wangkx Kevin Wang
              mayx Yanrui Ma (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: