Skip to content

Investigate Mettle timeout on premerge and postmerge tests#340

Open
olha-ctrl wants to merge 11 commits intothought-machine:masterfrom
olha-ctrl:INFRA-130229_debug_process_tree_logs
Open

Investigate Mettle timeout on premerge and postmerge tests#340
olha-ctrl wants to merge 11 commits intothought-machine:masterfrom
olha-ctrl:INFRA-130229_debug_process_tree_logs

Conversation

@olha-ctrl
Copy link
Contributor

Added logProcChain() to print child processes that keep worker in a waiting state:

Logs from kibana indicates that some pipes are still open pipe:[850045] 2 -> pipe:[850046], so want to find out what they are.

time="18:57:33.007" level=debug msg="Deadline exceeded: /proc snapshot" cmdline="/usr/local/bin/tm_sandbox bash --noprofile --norc -u -o pipefail -c export TMP_DIR=\"pwd\" TEST_DIR=\"pwd\" && export TEST=\"$TEST_DIR/notifications_service_sat\" && $TEST -kafka_provider=redpanda -db_provider=psql 2>&1 | tee $TMP_DIR/test.results && $TOOLS_GO tool covdata textfmt -i=. -o=$COVERAGE_FILE" fds="[0 -> /dev/null 1 -> pipe:[850045] 2 -> pipe:[850046]]" hash=9bbb0b015a5b9fcdbb53256e49444e65408bdac19921c68995c8f0d8a6d48314 pid=24877 wchan=do_wait

@olha-ctrl olha-ctrl changed the title Infra 130229 debug process tree logs Investigate Mettle timeout on premerge and postmerge tests Mar 6, 2026
@olha-ctrl olha-ctrl requested a review from scyyx5 March 6, 2026 10:35
@olha-ctrl olha-ctrl requested a review from toastwaffle March 6, 2026 15:22
)
}
childrenSummary = strings.Join(items, " | ")
break
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Doesn't this mean we now stop exploring deeply if we find multiple children? that also seems impractical; shouldn't we be outputting the whole tree?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants