Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-27034

Elastic4hpcclogs seems to fail to deploy after initial deployment

    XMLWordPrintable

Details

    • Bug
    • Status: Resolved
    • Not specified
    • Resolution: Fixed
    • 8.4.20
    • 8.6.0, 8.4.26
    • cloud
    • None

    Description

      In current environment, noticed Elastic4hpcclogs pods tend to fail after initial successful deployment:

       

      ]) for Container "elasticsearch" in Pod "elasticsearch-master-0_default(f1620817-111d-4f5b-b34f-51698d5b7f4f)" failed - error: command 'bash -c PIPELINE_NAME=hpccpipeline
      ES_URL=http://localhost:9200
      PIPELINE_REQ_PATH=_ingest/pipeline
      [ -z ${WAIT_ES_READY_IN_SEC} ] && WAIT_ES_READY_IN_SEC=120
      END_TIME=$(expr $(date +%s) + ${WAIT_ES_READY_IN_SEC})
      START_FILE=/tmp/.es_start_file
      while [[ $(date +%s) -le ${END_TIME} ]]; do
      [ -f "${START_FILE}" ] && break
      sleep 1
      done
      if [ -f "${START_FILE}" ]; then
      echo 'Cluster is ready to add hpccpipeline'
      else
      echo 'Cluster health check timeout. Will try to add hpccpipeline anyway.'
      fi

      1. Need wait elasticsearch container ready to test the hostname with ordinal
      2. Only add pipeline in the first elasticsearch master
        if [ ${HOSTNAME##*-} -eq 0 ]; then
        curl -s -X PUT "$ES_URL/$PIPELINE_REQ_PATH/$PIPELINE_NAME/" -H 'Content-Type: application/json' \
        -d'{ "description": "Parses and formats HPCC Systems component log entries", "processors": [{ "grok":
        Unknown macro: { "field"}

        \\s+%{HPCC_LOG_CLASS:hpcc.log.class}\\s+%{TIMESTAMP_ISO8601:hpcc.log.timestamp}\\s+%{POSINT:hpcc.log.procid}\\s+%{POSINT:hpcc.log.threadid}\\s+%{HPCC_LOG_WUID:hpcc.log.jobid}
        s+%{QUOTEDSTRING:hpcc.log.message}"], "pattern_definitions": { "HPCC_LOG_WUID": "([A-Z][0-9]

        {8}

        -[0-9]{6})|(UNK)", "HPCC_LOG_CLASS": "DIS|ERR|WRN|INF|PRO|MET|UNK", "HPCC_LOG_AUDIENCE": "OPR|USR|PRG|AUD|UNK" } } }], "on_failure": [\{ "set": { "field": "error.message", "value": "{{ _ingest.on_failure_message }}" } }] }'
        rc=$?
        if [ ${rc} -eq 0 ]; then
        echo 'Successfully added hpccpipeline !'
        else
        echo 'Failed to add hpccpipeline.'
        exit $rc
        fi
        fi
        ' exited with 137: , message: ""
        Normal Killing 45s (x3 over 8m45s) kubelet FailedPostStartHook

      Attachments

        Activity

          People

            xwang2713 Xiaoming Wang
            rpastrana Rodrigo Pastrana
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: