Details
-
Bug
-
Status: Resolved
-
Not specified
-
Resolution: Fixed
-
8.6.8
-
None
-
minikube local container
Description
I installed an 8.6.8-1 cluster with standard elasticstack install with
helm install myelk hpcc/elastic4hpcclogs
I submitted a bunch of jobs through ecl playground and it looks like myeclccserver logs are not appearing at all. When I check the logs through kubectl, I do get entries.
here are myeclccserver logs:
// 00000319 PRG INF 2022-03-10 14:49:45.024 1 1811 W20220310-144707-8 "Removing file W20220310-144707-8.res.s_WORKUNIT_1000.bin" 0000031A PRG INF 2022-03-10 14:49:45.024 1 1811 W20220310-144707-8 "Removing file W20220310-144707-8.res.s_MANIFEST_1000.bin" 0000031B PRG INF 2022-03-10 14:49:45.024 1 1811 W20220310-144707-8 "Removing file W20220310-144707-8.res.s_RESULT_XSD_1002.bin" 0000031C PRG INF 2022-03-10 14:49:45.024 1 1811 W20220310-144707-8 "Removing file W20220310-144707-8.res.s_RESULT_XSD_1001.bin" 0000031D PRG INF 2022-03-10 14:49:45.024 1 1811 W20220310-144707-8 "Removing file W20220310-144707-8.cpp.o" 0000031E PRG INF 2022-03-10 14:49:45.024 1 1811 W20220310-144707-8 "Removing file W20220310-144707-8_1.cpp.o" 0000031F PRG INF 2022-03-10 14:49:45.024 1 1811 W20220310-144707-8 "Removing file W20220310-144707-8.res.s.o" 00000320 PRG INF 2022-03-10 14:49:45.043 1 1811 W20220310-144707-8 "Workunit W20220310-144707-8 local compilation timed out, launching k8s job" 00000321 USR PRO 2022-03-10 14:49:45.043 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl replace --force -f -' - hasinput=1, hasoutput=1 stderrbufsize=1048576 []" 00000322 USR PRO 2022-03-10 14:49:45.214 1 1119 W20220310-144707-2 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-2 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000323 USR PRO 2022-03-10 14:49:45.318 1 1139 W20220310-144707-4 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-4 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000324 USR PRO 2022-03-10 14:49:45.615 1 1147 W20220310-144707-1 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-1 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000325 USR PRO 2022-03-10 14:49:46.920 1 1119 W20220310-144707-2 "compile: Pipe: process 5180 complete 0" 00000326 USR PRO 2022-03-10 14:49:47.215 1 1139 W20220310-144707-4 "compile: Pipe: process 5189 complete 0" 00000327 USR PRO 2022-03-10 14:49:47.517 1 1811 W20220310-144707-8 "compile: Pipe: process 5170 complete 0" 00000328 USR PRO 2022-03-10 14:49:47.517 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-8 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000329 USR PRO 2022-03-10 14:49:47.617 1 1147 W20220310-144707-1 "compile: Pipe: process 5199 complete 0" 0000032A USR PRO 2022-03-10 14:49:48.812 1 1811 W20220310-144707-8 "compile: Pipe: process 5239 complete 0" 0000032B USR PRO 2022-03-10 14:49:49.516 1 1119 W20220310-144707-2 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-2 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000032C USR PRO 2022-03-10 14:49:50.012 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-8 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000032D USR PRO 2022-03-10 14:49:50.111 1 1139 W20220310-144707-4 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-4 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000032E USR PRO 2022-03-10 14:49:50.316 1 1119 W20220310-144707-2 "compile: Pipe: process 5288 complete 0" 0000032F USR PRO 2022-03-10 14:49:51.211 1 1811 W20220310-144707-8 "compile: Pipe: process 5303 complete 0" 00000330 USR PRO 2022-03-10 14:49:51.615 1 1139 W20220310-144707-4 "compile: Pipe: process 5315 complete 0" 00000331 USR PRO 2022-03-10 14:49:52.415 1 1119 W20220310-144707-2 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-2 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000332 USR PRO 2022-03-10 14:49:52.515 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-8 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000333 USR PRO 2022-03-10 14:49:53.312 1 1119 W20220310-144707-2 "compile: Pipe: process 5379 complete 0" 00000334 USR PRO 2022-03-10 14:49:53.524 1 1811 W20220310-144707-8 "compile: Pipe: process 5389 complete 0" 00000335 USR PRO 2022-03-10 14:49:54.216 1 1139 W20220310-144707-4 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-4 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000336 USR PRO 2022-03-10 14:49:54.813 1 1139 W20220310-144707-4 "compile: Pipe: process 5431 complete 0" 00000337 PRG INF 2022-03-10 14:49:54.813 1 1139 W20220310-144707-4 "kubectl jobs output: " 00000338 USR PRO 2022-03-10 14:49:54.813 1 1139 W20220310-144707-4 "compile: Creating PIPE program process : 'kubectl get pods --selector=job-name=compile-w20220310-144707-4 --output=jsonpath={.items[*].status.containerStatuses[?(@.name=="compile-w20220310-144707-4")].state.terminated.exitCode}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000339 USR PRO 2022-03-10 14:49:55.017 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-8 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000033A USR PRO 2022-03-10 14:49:55.423 1 1139 W20220310-144707-4 "compile: Pipe: process 5446 complete 0" 0000033B USR PRO 2022-03-10 14:49:55.423 1 1139 W20220310-144707-4 "compile: Creating PIPE program process : 'kubectl delete job/compile-w20220310-144707-4' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000033C USR PRO 2022-03-10 14:49:55.721 1 1147 W20220310-144707-1 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-1 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000033D USR PRO 2022-03-10 14:49:55.921 1 1119 W20220310-144707-2 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-2 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000033E USR PRO 2022-03-10 14:49:56.013 1 1811 W20220310-144707-8 "compile: Pipe: process 5456 complete 0" 0000033F USR PRO 2022-03-10 14:49:56.612 1 1139 W20220310-144707-4 "compile: Pipe: process 5471 complete 0" 00000340 USR PRO 2022-03-10 14:49:57.213 1 1147 W20220310-144707-1 "compile: Pipe: process 5481 complete 0" 00000341 PRG INF 2022-03-10 14:49:57.213 1 1147 W20220310-144707-1 "kubectl jobs output: " 00000342 USR PRO 2022-03-10 14:49:57.213 1 1147 W20220310-144707-1 "compile: Creating PIPE program process : 'kubectl get pods --selector=job-name=compile-w20220310-144707-1 --output=jsonpath={.items[*].status.containerStatuses[?(@.name=="compile-w20220310-144707-1")].state.terminated.exitCode}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000343 USR PRO 2022-03-10 14:49:57.416 1 1119 W20220310-144707-2 "compile: Pipe: process 5490 complete 0" 00000344 USR PRO 2022-03-10 14:49:58.527 1 1147 W20220310-144707-1 "compile: Pipe: process 5523 complete 0" 00000345 USR PRO 2022-03-10 14:49:58.527 1 1147 W20220310-144707-1 "compile: Creating PIPE program process : 'kubectl delete job/compile-w20220310-144707-1' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000346 USR PRO 2022-03-10 14:49:58.624 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-8 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000347 USR PRO 2022-03-10 14:49:59.118 1 1147 W20220310-144707-1 "compile: Pipe: process 5555 complete 0" 00000348 USR PRO 2022-03-10 14:49:59.517 1 1811 W20220310-144707-8 "compile: Pipe: process 5564 complete 0" 00000349 USR PRO 2022-03-10 14:50:01.626 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-8 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000034A USR PRO 2022-03-10 14:50:01.810 1 1119 W20220310-144707-2 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-2 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000034B USR PRO 2022-03-10 14:50:02.215 1 1811 W20220310-144707-8 "compile: Pipe: process 5603 complete 0" 0000034C USR PRO 2022-03-10 14:50:02.726 1 1119 W20220310-144707-2 "compile: Pipe: process 5613 complete 0" 0000034D PRG INF 2022-03-10 14:50:02.726 1 1119 W20220310-144707-2 "kubectl jobs output: " 0000034E USR PRO 2022-03-10 14:50:02.726 1 1119 W20220310-144707-2 "compile: Creating PIPE program process : 'kubectl get pods --selector=job-name=compile-w20220310-144707-2 --output=jsonpath={.items[*].status.containerStatuses[?(@.name=="compile-w20220310-144707-2")].state.terminated.exitCode}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000034F USR PRO 2022-03-10 14:50:03.438 1 1119 W20220310-144707-2 "compile: Pipe: process 5641 complete 0" 00000350 USR PRO 2022-03-10 14:50:03.438 1 1119 W20220310-144707-2 "compile: Creating PIPE program process : 'kubectl delete job/compile-w20220310-144707-2' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000351 USR PRO 2022-03-10 14:50:03.916 1 1119 W20220310-144707-2 "compile: Pipe: process 5657 complete 0" 00000352 USR PRO 2022-03-10 14:50:06.421 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-8 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000353 USR PRO 2022-03-10 14:50:06.917 1 1811 W20220310-144707-8 "compile: Pipe: process 5669 complete 0" 00000354 USR PRO 2022-03-10 14:50:13.730 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get jobs compile-w20220310-144707-8 -o jsonpath={.status.active}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000355 USR PRO 2022-03-10 14:50:14.211 1 1811 W20220310-144707-8 "compile: Pipe: process 5702 complete 0" 00000356 PRG INF 2022-03-10 14:50:14.211 1 1811 W20220310-144707-8 "kubectl jobs output: " 00000357 USR PRO 2022-03-10 14:50:14.211 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl get pods --selector=job-name=compile-w20220310-144707-8 --output=jsonpath={.items[*].status.containerStatuses[?(@.name=="compile-w20220310-144707-8")].state.terminated.exitCode}' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 00000358 USR PRO 2022-03-10 14:50:14.627 1 1811 W20220310-144707-8 "compile: Pipe: process 5715 complete 0" 00000359 USR PRO 2022-03-10 14:50:14.627 1 1811 W20220310-144707-8 "compile: Creating PIPE program process : 'kubectl delete job/compile-w20220310-144707-8' - hasinput=0, hasoutput=1 stderrbufsize=1048576 []" 0000035A USR PRO 2022-03-10 14:50:15.113 1 1811 W20220310-144707-8 "compile: Pipe: process 5728 complete 0"
