Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-28583

Remote Copy, SuperCopy, Wrap, TLK

    XMLWordPrintable

Details

    • Bug
    • Status: Resolved
    • Not specified
    • Resolution: Fixed
    • 8.10.2
    • 8.10.18
    • Azure, DFU Server
    • None
    • AKS Thor

    Description

      Presumed:  The defined target/plane “data” in https://eclwatch.us-linkinghpcc-dev.azure.lnrsg.io/ is 400 parts/width, matching the largest defined Thor.

       

      1. Attempts to copy a typical 401-part index from Alpha Prod to Linking Dev require us to use WRAP option.
      1. See D20221110-205904 for an example.  It was tried directly from ECLWatch, Remote Copy, in AKS Linking Dev.
      2. Failed, Source file format is not specified or is unsuitable for (re-)partitioning
      3. Tried immediately with WRAP enabled, D20221110-205937, and it succeeded, producing 401 part target, as expected.
      4. On-prem to on-prem 400-node Thors do not require WRAP option for 401-part index, as in https://boca-uspr-thor.hpcc.risk.regn.net:18010/?Wuid=D20221114-090934&Widget=DFUWUDetailsWidget.
      1. Attempts to copy an index subfile via a SuperCopy request, even if WRAP is enabled, resulted in a 400-part target in this environment.
      1. This appears to be what you noticed with that previous error.
      2. When copying a 1-part index this way, you get 400 parts, no complaints about (re-)partitioning.
      3. When copying a 401-part index this way, you get 400 parts, no complaints about (re-)partitioning.

       

      Oddities could be mixed, expected, errors…  not sure.

       

      1. 401-part on-prem copy to 400-part plane in Azure complaints about (re-)partitioning, where on-prem 400-node target does not.
      2. SuperCopy appears to spawn incorrectly or spawned COPY WUs react incorrectly, producing targets with same width as target Azure plane, without warning/complaint.
      3. We’re not sure if the handling of the target 400-part Azure plane is causing something or SuperCopy is different or…

       

       

      Scott’s testing notes are below.  In case you want to evaluate anything:

       

      Both 400 part and 401 part file are on the Thor:

      thor_data400::key::20221101::apartmentbuilding_401p

      thor_data400::key::20221101::apartmentbuilding

       

       

      thor::key::new_suppression::20221111::opt_out/thor::key::new_suppression::qa::opt_out key copy testing
      Copy from DFU form, Wrap and No Split selected 1 D20221111-190137 Copy
      Copy from ECL Watch from, Wrap and No Split selected 1 D20221111-185929 Copy
      Super Copy from ECL Watch form, wrap and No Split selected 400 D20221111-185228 Super Copy
          D20221111-185228-3 Copy
      Super Copy from DFU form, wrap and No Split selected 400 D20221111-184539 Super Copy
          D20221111-184540 Copy
      Super Copy from ECL Watch form, wrap and No Split selected, different target name 400 D20221111-190756 Super Copy
          D20221111-190756-3 Copy
      Copy from ECL Watch from, Wrap and No Split selected, Retain Super Structure  selected 1 D20221111-191107 Copy
           ++   
           ++   
      thor_data400::key::20221101::apartmentbuilding/thor_data400::key::apartmentbuilding::base key copy test
      Description Parts (401 expected) DFU WU child WU
      Super Copy from ECL Watch form, wrap and No Split selected 400 D20221111-191653 Super Copy
          D20221111-191654 Copy
      Copy from ECL Watch from, Wrap and No Split selected 401 D20221111-192128 Copy

       

      jakesmith millerlscott rwagner42 fuceta 

      Attachments

        Activity

          People

            attilavamos Attila Vamos
            tonymkirk Tony Kirk
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: