Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-24474

ROXIE crashing while loading workunits that refer to python2, if python3 selected

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Not specified
    • Resolution: Fixed
    • Affects Version/s: 7.10.4
    • Fix Version/s: 7.10.10
    • Component/s: Roxie
    • Labels:
      None
    • Environment:
      CentOS 7; bare-metal config; single-node HPCC system; python 3.6 installed

      Description

      This is from DataSeers. The problem is likely not specific to ROXIE but that is where the problem is manifesting itself.

      With confirmed valid environment.conf settings (additionalPlugins=python3), the right config directory cited in environment.xml (/etc/HPCCSystems), and a working python3 environment (tested from the command line as the hpcc user), ROXIE crashes on start with the following trace:

      Program:   192.168.1.225:/opt/HPCCSystems/bin/roxie
      Signal:    11 Segmentation fault
      Fault IP:  00007F21D7152FAA
      Accessing: 0000000000000010
      Backtrace:
        /lib64/libpython3.6m.so.1.0(PySys_SetObject+0x1a) [0x7f21d7152faa]
        /lib64/libpython3.6m.so.1.0(PySys_SetArgvEx+0x79) [0x7f21d71532c9]
        /opt/HPCCSystems/versioned/python2/libpy2embed.so(+0xbed7) [0x7f2193ba7ed7]
        /opt/HPCCSystems/versioned/python2/libpy2embed.so(+0x5bf0) [0x7f2193ba1bf0]
        /lib64/ld-linux-x86-64.so.2(+0xf9b3) [0x7f22373399b3]
        /lib64/ld-linux-x86-64.so.2(+0x1458e) [0x7f223733e58e]
        /lib64/ld-linux-x86-64.so.2(+0xf7c4) [0x7f22373397c4]
        /lib64/ld-linux-x86-64.so.2(+0x13b7b) [0x7f223733db7b]
        /lib64/libdl.so.2(+0xfab) [0x7f2230b29fab]
        /lib64/ld-linux-x86-64.so.2(+0xf7c4) [0x7f22373397c4]
        /lib64/libdl.so.2(+0x15ad) [0x7f2230b2a5ad]
        /lib64/libdl.so.2(dlopen+0x31) [0x7f2230b2a041]
        /opt/HPCCSystems/lib/libjlib.so(_Z16LoadSharedObjectPKcbb+0x5e) [0x7f22310b3c3e]
        /opt/HPCCSystems/lib/libjlib.so(_ZN12SharedObject4loadEPKcbb+0x2a) [0x7f22310b422a]
        /opt/HPCCSystems/lib/libdllserver.so(_Z14createDllEntryPKcbPK7IFileIOb+0x49) [0x7f2235737739]
        /opt/HPCCSystems/lib/libccd.so(+0x149f7a) [0x7f2236f52f7a]
        /opt/HPCCSystems/lib/libccd.so(+0x21abaa) [0x7f2237023baa]
        /lib64/libpthread.so.0(+0x620b) [0x7f223633320b]
        /opt/HPCCSystems/lib/libccd.so(+0x21583b) [0x7f223701e83b]
        /opt/HPCCSystems/lib/libccd.so(+0x23ea6c) [0x7f2237047a6c]
        /opt/HPCCSystems/lib/libjlib.so(+0x157519) [0x7f22310a2519]
        /opt/HPCCSystems/lib/libjlib.so(_ZN6Thread5beginEv+0x28) [0x7f22310a4c88]
        /opt/HPCCSystems/lib/libjlib.so(_ZN6Thread11_threadmainEPv+0x1d) [0x7f22310a430d]
        /lib64/libpthread.so.0(+0x7ea5) [0x7f2236334ea5]
        /lib64/libc.so.6(clone+0x6d) [0x7f222f5268dd]
      Registers:
      EAX:00007F21D748CA18  EBX:00007F22373AFD88  ECX:0000000000000000  EDX:00007F22373AFD88  ESI:00007F21D71A8AE7  EDI:00007F21D71A8AE7
      R8 :FFFFFFFFFFFFFFFE  R9 :00007F21D743EF80  R10:00007F21D743EFA0  R11:00007F21D743EFA0
      R12:0000000000000000  R13:00007F21B1493A48  R14:00007F21D743D1A0  R15:0000000000000001
      CS:EIP:0033:00007F21D7152FAA
         ESP:00007F21B14939D0  EBP:00007F21D71A8AE7
      Stack[00007F21B14939D0]: 00007F21D743EF80 373AFD8800007F21 00007F22373AFD88 0000000100007F22 0000000000000001 D71532C900000000 00007F21D71532C9 93DB0AB000007F21
      Stack[00007F21B14939F0]: 00007F2193DB0AB0 B80E0B2000007F21 00000000B80E0B20 93FB6DB000000000 00007F2193FB6DB0 93DAF6E000007F21 00007F2193DAF6E0 B1493A5000007F21
      Stack[00007F21B1493A10]: 00007F21B1493A50 B1493A8000007F21 00007F21B1493A80 93DAE34000007F21 00007F2193DAE340 0000000200007F21 0000000000000002 93DAE33800000000
      Stack[00007F21B1493A30]: 00007F2193DAE338 93BA7ED700007F21 00007F2193BA7ED7 0000000400007F21 0000000000000004 0000000000000000 0000000000000000 0000003400000000
      Stack[00007F21B1493A50]: 0000005B00000034 B80E0B200000005B 00007F21B80E0B20 B80E155000007F21 00007F21B80E1550 0000001E00007F21 000000000000001E 0000002000000000
      Stack[00007F21B1493A70]: 0000000000000020 93FB716800000000 00007F2193FB7168 B1493BC000007F21 00007F21B1493BC0 373360CF00007F21 00007F22373360CF B80E25B000007F22
      Stack[00007F21B1493A90]: 00007F21B80E25B0 0000001F00007F21 000000000000001F 0000002000000000 0000000000000020 3753099000000000 00007F2237530990 0000000500007F22
      Stack[00007F21B1493AB0]: 0000000000000005 0000040400000000 0000000000000404 0000000100000000 0000000000000001 000021B600000000 00000000000021B6 0000000000000000
      

      Note that ROXIE loaded /opt/HPCCSystems/versioned/python2/libpy2embed.so, which his almost certainly the cause of the crash. Why did it pick up that library when environment.conf has the additionalPlugins=python3 setting?

        Attachments

          Activity

            People

            • Assignee:
              richardkchapman Richard Chapman
              Reporter:
              dcamper Dan S. Camper
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: