Repository navigation
Extend to remote job systems #519
Description
I've written some extensions to PSI/J to connect to Slurm REST and NERSC's Superfacility API. It converts Job types into the appropriate REST calls.
In addition, I've wrapped PSI/J into a web service itself. This way one can write a general script that calls this web service and directs calls into different backends (e.g. psij/nersc/perlmutter/job/submit).
Right now the code is a bit of a hack because it side-steps some assumptions PSI/J makes about being a local library. If there's interest we can discuss further here, and I can clean up my code and submit a PR.
Activity
hategan commentedon May 9, 2025
Hi Pinku,
There is definitely interest. All of the things you mention have been on our wish list.
We'd be happy to discuss details and work on getting one or more PRs merged.
suranap commentedon May 12, 2025
Thanks, I'll prepare a PR and connect to this issue.
hategan commentedon May 12, 2025
Thank you!
Might perhaps be useful to separate the two executors from a potential remote service, since I suspect some back and forth might be in order for the latter.