Skip to content

Comments

Implement gateway pipeline#3599

Open
r4victor wants to merge 14 commits intomasterfrom
issue_3551_gateway_pipeline
Open

Implement gateway pipeline#3599
r4victor wants to merge 14 commits intomasterfrom
issue_3551_gateway_pipeline

Conversation

@r4victor
Copy link
Collaborator

Part of #3551
Closes #3576

This PR:

  • Refactor pipelines classes to make them generic and support pipeline-specific attributes with typing info.
  • Implements a gateway pipeline.
  • Makes gateway API async and moves termination to the gateway pipeline. Old sync API still works unless DSTACK_FF_PIPELINE_PROCESSING_ENABLED is set. The async deletion is done via a new GatewayModel.to_be_deleted field. Gateway status does not change for a) backward compatibility b) avoiding overriding statuses like FAILED.
  • Updates API gateway/service code to avoid running services on to_be_deleted gateways.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make gateway delete API async

1 participant