Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-23946

Simple filter against index not returning all records if layouts mismatch

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 7.6.36
    • Fix Version/s: 7.6.44
    • Component/s: None
    • Labels:
      None

      Description

      RawLayout := RECORD
      	unsigned6 did;
      	qstring10 phone;
      	qstring9 ssn;
      	integer4 dob;
      	qstring5 title;
      	qstring20 fname;
      	qstring20 mname;
      	qstring20 lname;
      	qstring5 name_suffix;
      	qstring10 prim_range;
      	string2 predir;
      	qstring28 prim_name;
      	qstring4 suffix;
      	string2 postdir;
      	qstring10 unit_desig;
      	qstring8 sec_range;
      	qstring25 city_name;
      	string2 st;
      	qstring5 zip;
      	qstring4 zip4;
      	unsigned3 addr_dt_last_seen;
      	qstring8 dod;
      	qstring17 prpty_deed_id;
      	qstring22 vehicle_vehnum;
      	qstring22 bkrupt_crtcode_caseno;
      	integer4 main_count;
      	integer4 search_count;
      	qstring15 dl_number;
      	qstring12 bdid;
      	integer4 run_date;
      	integer4 total_records;
      	unsigned8 rawaid;
      	unsigned3 addr_dt_first_seen;
      	string10 adl_ind;
      	string1 valid_ssn;
      	unsigned8 __filepos;
      END;
      
      idx1 := INDEX({RawLayout.did},{RawLayout},'~thor_data400::key::watchdog_best.did_qa',DISTRIBUTED);
      idx2 := INDEX({RawLayout.did},{RawLayout},'~thor_data400::key::watchdog_best.did_qa');
      idx3 := PULL(INDEX({RawLayout.did},{RawLayout},'~thor_data400::key::watchdog_best.did_qa'));
      
      dids := [1271967351,1243895045];
      
      OUTPUT(idx1(KEYED(did IN dids)), NAMED('idx1'));
      OUTPUT(idx2(KEYED(did IN dids)), NAMED('idx2'));
      OUTPUT(idx3(did IN dids), NAMED('idx3'));
      

      Only idx3 – where PULL is used – returns the correct result.

      W20200424-120342 on Dataland is an example run.

        Attachments

          Activity

            People

            • Assignee:
              ghalliday Gavin Halliday
              Reporter:
              dcamper Dan S. Camper
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: