Uploaded image for project: 'HPCC'
  1. HPCC
  2. HPCC-24577

Create an abstract interface for log retrieval

    XMLWordPrintable

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 8.6.0
    • ESP

    Description

      As we move away from physical local log files (especially in the cloud), and to a persistent non-local logging store, we need an abstract way to access those logs in a controlled manner.
      The implementation may vary, e.g. there may be an ELK or DataDog backend, each with a specific way to query the stashed logs.

      The 1st implementation may be a simple one based on physical files, that have been persisted to a known mounted volume.

      The interface should probably require a tight date range, to avoid expensive and unwarranted searches. It should also provide useful common types of lookups, for example:
      + fetch logging for all or some components, for this jobid.

      Attachments

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. HPCC-26849 WsLogAccess should provide log stream option

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HPCC-26876 ElasticStack log access lib should support compound queries

          • Not specified - Priority has not been specified
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. HPCC-24576 Add a global jlog job id variable and means to set it, for engines that run 1 job per process (hthor/thor)

          • Critical - Crashes, loss of data, severe memory leak.
          • Accepted

          Improvement - An improvement or enhancement to an existing feature or task. HPCC-24575 Introduce or change jlog's jobid field to a string field

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HPCC-26035 Zap reports do not collect component logs in cloud

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              rpastrana Rodrigo Pastrana
              jakesmith Jake Smith
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: