Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-16196

regression suite setup with roxie nodes > 1 possibly not putting files in proper place

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 6.0.6
    • Fix Version/s: 7.2.0
    • Component/s: Regression Suite
    • Labels:
      None

      Description

      I'm tryign to revisit running the regression suite against a remote multinode environment.
      I have my VM where the regression suite is located and then I have my multinode environment.
      the environment has the following format:
      10.239.20.30 - support node (dali, esp, thormaster etc)
      10.239.20.31-33 - thorslaves/ roxie servers
      ./ecl-test setup worked seemingly fine, but when I got to running the ./ecl-test against hthor, I immediately started getting failures.
      The error for aggidx4 is as such:
      System error: 1001: Could not open key file at //10.239.20.31/var/lib/HPCCSystems/hpcc-data/roxie/regress/single/simplepersonbookindex._1_of_1 or any alternate location.
      Looking for the actual file part, it was located on 20.33.
      However, looking on eclwatch, it thinks that the file parts are on 31 and 32.
      Looking more closely at the file information from dali, here is the info:
      sudo /opt/HPCCSystems/bin/daliadmin . df sfile regress::single::simplepersonbookindex
      <File directory="/var/lib/HPCCSystems/hpcc-data/roxie/regress/single"
      group="myroxie"
      modified="2016-08-31T14:55:10"
      numclusters="1"
      numparts="1"
      partmask="simplepersonbookindex._1_of_1"
      replicated="1">
      <OrigName>regress::single::simplepersonbookindex</OrigName>
      <Attr accessed="2016-08-31T14:55:10"
      fileCrc="-36549871"
      formatCrc="1841823435"
      job="setupsq-160831-105500"
      kind="key"
      owner="regress"
      recordCount="10"
      size="40960"
      workunit="W20160831-105501">
      <ECL>nestedblob := RECORD
      udecimal8 booklimit;
      END;

      bookidrec := RECORD
      unsigned4 id;
      string name;
      string author;
      unsigned1 rating100;
      udecimal8_2 price;
      END;

      RECORD
      string20 surname;
      string10 forename;
      unsigned1 aage;
      udecimal8 dob;
      nestedblob limit

      {blob};
      DATASET(bookidrec) books{blob}

      ;
      unsigned8 filepos;
      END; </ECL>
      <_record_layout xsi:type="SOAP-ENC:base64">
      AdwAAABuAQAAATsABAcEAAMoBgRzdXJuYW0DZQQUBwFhc2MIaWkAFhgaBwf4AwgHZm9yZQ+E
      EQQKFRcZGx35LyAEAwQHYWEnZ2UBATMIAwewZG9iQCMzAwU4B2xpbWl0D0iBSkxODQE2BD3n
      NAkHYm9va0uFTXRFPmUISQT9XV9zUGgAamtbcxRVCBAEbgNkAgdpZFY+NQfyKRLx/4UxH4fz
      G0cGN3V0aCaLBISGLoiViiD+A1sEcmF0aW4GZzEwMDx/bnBwcmljZXlGZpnwCgBmaWxlcG8B
      cwGvIQcAAAAc </_record_layout>
      </Attr>
      <Cluster defaultBaseDir="/var/lib/HPCCSystems/hpcc-data/roxie"
      defaultReplicateDir="/var/lib/HPCCSystems/hpcc-data2/roxie"
      mapFlags="48"
      name="myroxie">
      <Group>10.239.20.31-33</Group>
      </Cluster>
      <Part modified="2016-08-31T14:55:10"
      name="simplepersonbookindex._1_of_1"
      node="10.239.20.31"
      num="1"
      size="40960"/>
      </File>

      It should be noted that the system I'm trying to test against has a 3 way roxie and a 3 slave thor.

        Attachments

          Activity

            People

            • Assignee:
              richardkchapman Richard Chapman
              Reporter:
              cloln Chris Lo
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: