Skip to content

Increase SWT-Bench image build timeout to 10 hours#521

Merged
simonrosenberg merged 3 commits intomainfrom
fix/swtbench-build-timeout-10h
Mar 16, 2026
Merged

Increase SWT-Bench image build timeout to 10 hours#521
simonrosenberg merged 3 commits intomainfrom
fix/swtbench-build-timeout-10h

Conversation

@simonrosenberg
Copy link
Collaborator

Summary

Validation

Rationale

This remains a stopgap for long-running SWT-Bench image builds while the underlying regressions tracked in #510 and #504 are still open.

The previous timeout rationale was based on run 23043936501, but that run was not a full cold build: it skipped many prebuilt images and understated the true cold-build duration. The current evidence collected in #510 points to roughly 8 to 8.5 hours for a full cold SWT-Bench build on the degraded path, so 10 hours is a safer operational timeout.

Increase the SWT-Bench image build workflow timeout to 9 hours as a temporary workaround for long-running image builds.\n\nTODO comments point back to the open tracking issues so this can be removed once the underlying regressions are fixed.\n\nCo-authored-by: openhands <openhands@all-hands.dev>
Record the observed full SWT-Bench image-build duration next to the temporary 9 hour timeout so the workaround is grounded in a measured run.\n\nCo-authored-by: openhands <openhands@all-hands.dev>
Copy link
Collaborator

@all-hands-bot all-hands-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Good taste - This is pragmatic operational engineering.

Linus-Style Verdict:
This solves a real problem (builds timing out) with the simplest possible fix (config change) while the root cause is being addressed in #510 and #504. The comment is longer than typical but justified - it explains why previous evidence understated the problem and documents the corrective action.

No data structures to bikeshed, no complexity to complain about, zero breaking change risk. This is exactly what a stopgap should look like.

Verdict:Merge it. Don't let perfect be the enemy of operational.

@simonrosenberg simonrosenberg merged commit ed838cd into main Mar 16, 2026
7 of 9 checks passed
@simonrosenberg simonrosenberg deleted the fix/swtbench-build-timeout-10h branch March 16, 2026 15:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants