Skip to content

feat(ray): run tasks on an existing RayCluster - #1

Open
chjdev wants to merge 1 commit into
mainfrom
existing-cluster
Open

chjdev wants to merge 1 commit into
mainfrom
existing-cluster

Conversation

@chjdev

@chjdev chjdev commented Oct 8, 2026

Copy link
Copy Markdown

RayJobConfig(existing_cluster=) runs the task as a Ray job on an existing KubeRay RayCluster in the execution namespace instead of creating one. The name is sent in the task config key ray.existing_cluster, custom omits ray_cluster, and ray.init() connects to the cluster the job driver runs on.

Cluster settings that only apply to a cluster the task creates are rejected together with existing_cluster: worker and head config, autoscaling, shutdown and TTL, address and reuse policies. address is documented as deprecated in favour of existing_cluster.

RayJobConfig(existing_cluster=<name>) runs the task as a Ray job on an existing KubeRay RayCluster in the execution namespace instead of creating one. The name is sent in the task config key ray.existing_cluster, custom omits ray_cluster, and ray.init() connects to the cluster the job driver runs on.

Cluster settings that only apply to a cluster the task creates are rejected together with existing_cluster: worker and head config, autoscaling, shutdown and TTL, address and reuse policies. address is documented as deprecated in favour of existing_cluster.
@chjdev
chjdev requested review from antholzer and msperk October 8, 2026 08:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant