Migrate PR review plugin to extensions repository by juanmichelini · Pull Request #2324 · OpenHands/software-agent-sdk

juanmichelini · 2026-03-05T14:03:15Z

This PR migrates the PR review plugin scripts from the SDK repository to the extensions repository, addressing issue #2282.

Changes

Deleted Files

examples/03_github_workflows/02_pr_review/agent_script.py - Now lives in extensions repo
examples/03_github_workflows/02_pr_review/prompt.py - Now lives in extensions repo
examples/03_github_workflows/02_pr_review/evaluate_review.py - Now lives in extensions repo
.github/actions/pr-review/action.yml - Now lives in extensions repo
examples/03_github_workflows/02_pr_review/action.yml - Removed symlink

Updated Files

.github/workflows/pr-review-by-openhands.yml: Updated to use the OpenHands/extensions/plugins/pr-review composite action, aligning with the OpenHands/benchmarks repository structure.
.github/workflows/pr-review-evaluation.yml: Updated to use the evaluation script from the extensions repository, aligning with the OpenHands/benchmarks repository structure.
examples/03_github_workflows/02_pr_review/workflow.yml: Updated to use the composite action, simplifying usage for users.
examples/03_github_workflows/02_pr_review/README.md:
- Updated documentation to reflect usage of the composite action.
- Replaced environment variable configuration with action inputs configuration.

Benefits

✅ Eliminates duplicate maintenance of PR review scripts across two repositories
✅ Simplifies workflow configuration by using a shared composite action
✅ Aligns workflow structure with OpenHands/benchmarks best practices
✅ Cleaner separation of concerns - SDK for framework, extensions for plugins

Related Issues

Closes #2282

Testing

The updated workflows now:

Use OpenHands/extensions/plugins/pr-review@main to perform reviews
Use extensions/plugins/pr-review/scripts/evaluate_review.py for evaluation

Users can continue using the workflow by referencing the composite action as shown in the updated example.

Agent Server images for this PR

• GHCR package: https://github.com/OpenHands/agent-sdk/pkgs/container/agent-server

Variants & Base Images

Variant	Architectures	Base Image	Docs / Tags
java	amd64, arm64	`eclipse-temurin:17-jdk`	Link
python	amd64, arm64	`nikolaik/python-nodejs:python3.13-nodejs22`	Link
golang	amd64, arm64	`golang:1.21-bookworm`	Link

Pull (multi-arch manifest)

# Each variant is a multi-arch manifest supporting both amd64 and arm64
docker pull ghcr.io/openhands/agent-server:abfc43f-python

Run

docker run -it --rm \
  -p 8000:8000 \
  --name agent-server-abfc43f-python \
  ghcr.io/openhands/agent-server:abfc43f-python

All tags pushed for this build

ghcr.io/openhands/agent-server:abfc43f-golang-amd64
ghcr.io/openhands/agent-server:abfc43f-golang_tag_1.21-bookworm-amd64
ghcr.io/openhands/agent-server:abfc43f-golang-arm64
ghcr.io/openhands/agent-server:abfc43f-golang_tag_1.21-bookworm-arm64
ghcr.io/openhands/agent-server:abfc43f-java-amd64
ghcr.io/openhands/agent-server:abfc43f-eclipse-temurin_tag_17-jdk-amd64
ghcr.io/openhands/agent-server:abfc43f-java-arm64
ghcr.io/openhands/agent-server:abfc43f-eclipse-temurin_tag_17-jdk-arm64
ghcr.io/openhands/agent-server:abfc43f-python-amd64
ghcr.io/openhands/agent-server:abfc43f-nikolaik_s_python-nodejs_tag_python3.13-nodejs22-amd64
ghcr.io/openhands/agent-server:abfc43f-python-arm64
ghcr.io/openhands/agent-server:abfc43f-nikolaik_s_python-nodejs_tag_python3.13-nodejs22-arm64
ghcr.io/openhands/agent-server:abfc43f-golang
ghcr.io/openhands/agent-server:abfc43f-java
ghcr.io/openhands/agent-server:abfc43f-python

About Multi-Architecture Support

Each variant tag (e.g., abfc43f-python) is a multi-arch manifest supporting both amd64 and arm64
Docker automatically pulls the correct architecture for your platform
Individual architecture tags (e.g., abfc43f-python-amd64) are also available if needed

- Delete agent_script.py and prompt.py (now in extensions repo) - Update action.yml to load scripts from OpenHands/extensions - Change sdk-repo/sdk-version inputs to extensions-repo/extensions-version - Update README and workflow.yml to reflect new structure - Install openhands-sdk and openhands-tools from PyPI Related to #2282 Co-authored-by: openhands <openhands@all-hands.dev>

github-actions · 2026-03-05T14:03:50Z

Python API breakage checks — ✅ PASSED

Result: ✅ PASSED

Action log

github-actions · 2026-03-05T14:03:56Z

REST API breakage checks (OpenAPI) — ❌ FAILED

Result: ❌ FAILED

⚠️ Breaking REST API changes or policy violations detected.

Log excerpt (first 1000 characters)

::error title=openhands-agent-server REST API::Breaking REST API change detected without MINOR version bump (1.14.0 -> 1.14.0).

Breaking REST API changes detected compared to baseline release:
- added '#/components/schemas/ACPAgent-Output, #/components/schemas/Agent-Output' to the '/items/anyOf[subschema #1: ConversationInfo]/agent' response property 'oneOf' list for the response status '200'
- the '/items/anyOf[subschema #1: ConversationInfo]/agent' response's property type/format changed from 'object'/'' to ''/'' for status '200'
- removed the required property '/items/anyOf[subschema #1: ConversationInfo]/agent/kind' from the response with the '200' status
- removed the required property '/items/anyOf[subschema #1: ConversationInfo]/agent/llm' from the response with the '200' status
- the 'agent' request property type/format changed from 'object'/'' to ''/''
- added '#/components/schemas/ACPAgent-Output, #/components/schemas/Agent-Output' to the 'agent' response property 'oneOf' li

Action log

juanmichelini · 2026-03-09T23:09:42Z

@OpenHands actually we already have https://github.com/OpenHands/software-agent-sdk/blob/main/.github/workflows/pr-review-by-openhands.yml so let's remove ‎.github/actions/pr-review/action.yml and instead make the example refer to .github/workflows/pr-review-by-openhands.yml

openhands-ai · 2026-03-09T23:10:06Z

I'm on it! juanmichelini can track my progress at all-hands.dev

openhands-ai · 2026-03-09T23:23:27Z

I have completed the migration of the PR review logic from a composite action to direct workflow steps, as requested.

Summary of Changes:

Removed Composite Action:
- Deleted .github/actions/pr-review/action.yml.
- Deleted the symlink at examples/03_github_workflows/02_pr_review/action.yml.
Updated Workflows:
- Modified .github/workflows/pr-review-by-openhands.yml to inline the necessary steps: checking out the extensions repository, installing dependencies (uv, gh, openhands-sdk), and running the agent_script.py directly.
- Updated examples/03_github_workflows/02_pr_review/workflow.yml to serve as a standalone example that users can copy, replacing the previous action usage with the inlined steps.
Updated Documentation:
- Updated examples/03_github_workflows/02_pr_review/README.md to reflect the new configuration method (environment variables instead of action inputs) and removed references to the composite action.

The changes have been pushed to the migrate-pr-review-to-extensions branch.

juanmichelini · 2026-03-09T23:31:22Z

@OpenHands that's better, but notice that ./03_github_workflows/02_pr_review/evaluate_review.py also lives in the extension repo now see https://github.com/OpenHands/extensions/tree/main/plugins/pr-review/workflows
also action.yml also lives there.
So we should reflect that in this change. Update the files in this PR, also update the description

openhands-ai · 2026-03-09T23:31:47Z

I'm on it! juanmichelini can track my progress at all-hands.dev

openhands-ai · 2026-03-09T23:48:12Z

I have completed the requested changes to migrate evaluate_review.py to the extensions repository and updated the PR description.

Changes Implemented:

Deleted File: Removed examples/03_github_workflows/02_pr_review/evaluate_review.py from the SDK repository as it now resides in the extensions repository.
Updated Workflow: Modified .github/workflows/pr-review-evaluation.yml to:
- Checkout the OpenHands/extensions repository.
- Execute the evaluation script from extensions/plugins/pr-review/workflows/evaluate_review.py.
Updated Documentation: Edited examples/03_github_workflows/02_pr_review/README.md to remove the reference to the local evaluate_review.py file.
Updated PR Description: Revised the PR description (body) to explicitly list evaluate_review.py and action.yml under "Deleted Files" and updated the "Updated Files" section to reflect the workflow changes.

The changes have been pushed to the migrate-pr-review-to-extensions branch.

juanmichelini · 2026-03-11T15:02:48Z

I have aligned the workflows with the repository structure as requested.

Updates:

.github/workflows/pr-review-by-openhands.yml: Now uses the composite action.
.github/workflows/pr-review-evaluation.yml: Now uses the evaluation script from the extensions repository.
examples/03_github_workflows/02_pr_review/workflow.yml: Updated to use the composite action for simplicity.
examples/03_github_workflows/02_pr_review/README.md: Updated documentation to reflect the new action inputs.

examples/03_github_workflows/02_pr_review/workflow.yml

.github/workflows/pr-review-by-openhands.yml

examples/03_github_workflows/02_pr_review/workflow.yml

.github/workflows/pr-review-by-openhands.yml

Co-authored-by: openhands <openhands@all-hands.dev>

Merge branch 'main' into migrate-pr-review-to-extensions

82e4708

Remove pr-review action and inline logic into workflows

8a8e28b

Remove evaluate_review.py and update workflows to use extensions repo

d17e67c

Update workflows to use composite action and align with benchmarks repo

154db53

juanmichelini requested a review from xingyaoww March 11, 2026 15:15

juanmichelini marked this pull request as ready for review March 11, 2026 15:15

juanmichelini removed the request for review from xingyaoww March 11, 2026 15:15

Merge branch 'main' into migrate-pr-review-to-extensions

991a827

xingyaoww reviewed Mar 11, 2026

View reviewed changes

examples/03_github_workflows/02_pr_review/workflow.yml Outdated Show resolved Hide resolved

enyst reviewed Mar 11, 2026

View reviewed changes

.github/workflows/pr-review-by-openhands.yml Show resolved Hide resolved

juanmichelini and others added 3 commits March 11, 2026 20:59

Update README.md

7130a2a

Update workflow.yml

0a72dab

Merge branch 'main' into migrate-pr-review-to-extensions

1f6342d

xingyaoww reviewed Mar 12, 2026

View reviewed changes

examples/03_github_workflows/02_pr_review/workflow.yml Outdated Show resolved Hide resolved

juanmichelini added 2 commits March 12, 2026 18:45

Update workflow.yml

868eb8e

Merge branch 'main' into migrate-pr-review-to-extensions

2e1b50e

juanmichelini enabled auto-merge (squash) March 12, 2026 21:49

juanmichelini requested a review from enyst March 12, 2026 21:49

Merge branch 'main' into migrate-pr-review-to-extensions

2feae2d

xingyaoww requested a review from all-hands-bot March 13, 2026 11:26

Merge branch 'main' into migrate-pr-review-to-extensions

8327fca

xingyaoww reviewed Mar 13, 2026

View reviewed changes

.github/workflows/pr-review-by-openhands.yml Outdated Show resolved Hide resolved

enyst and others added 2 commits March 13, 2026 17:13

Skip PR review workflow on forks

92eb38f

Co-authored-by: openhands <openhands@all-hands.dev>

Use same-repo check in PR review workflow

66d9e0d

Co-authored-by: openhands <openhands@all-hands.dev>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Migrate PR review plugin to extensions repository#2324

Migrate PR review plugin to extensions repository#2324
juanmichelini wants to merge 15 commits intomainfrom
migrate-pr-review-to-extensions

juanmichelini commented Mar 5, 2026 •

edited by github-actions bot

Loading

Uh oh!

github-actions bot commented Mar 5, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Mar 5, 2026 •

edited

Loading

Uh oh!

juanmichelini commented Mar 9, 2026

Uh oh!

openhands-ai bot commented Mar 9, 2026

Uh oh!

openhands-ai bot commented Mar 9, 2026

Uh oh!

juanmichelini commented Mar 9, 2026

Uh oh!

openhands-ai bot commented Mar 9, 2026

Uh oh!

openhands-ai bot commented Mar 9, 2026

Uh oh!

juanmichelini commented Mar 11, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

juanmichelini commented Mar 5, 2026 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Deleted Files

Updated Files

Benefits

Related Issues

Testing

Uh oh!

github-actions bot commented Mar 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Python API breakage checks — ✅ PASSED

Uh oh!

github-actions bot commented Mar 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

REST API breakage checks (OpenAPI) — ❌ FAILED

Uh oh!

juanmichelini commented Mar 9, 2026

Uh oh!

openhands-ai bot commented Mar 9, 2026

Uh oh!

openhands-ai bot commented Mar 9, 2026

Uh oh!

juanmichelini commented Mar 9, 2026

Uh oh!

openhands-ai bot commented Mar 9, 2026

Uh oh!

openhands-ai bot commented Mar 9, 2026

Uh oh!

juanmichelini commented Mar 11, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

juanmichelini commented Mar 5, 2026 •

edited by github-actions bot

Loading

github-actions bot commented Mar 5, 2026 •

edited

Loading

github-actions bot commented Mar 5, 2026 •

edited

Loading