New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ephemeral runners allocation is very flaky #5689

Open

malfet opened this issue Sep 23, 2024 · 0 comments

Contributor

malfet commented Sep 23, 2024

See https://github.com/pytorch/pytorch/actions/runs/10989676932/job/30508354017 that has been sitting in the queue for almost 14 hours at this point:

Two questions:

Is there a CLI tool to force runner creation (@seemethere I remember you've showed scale-up lambda tool to me in the past, not sure if it's still relevant though)
Can we create a periodic job that looks for long queues with no runners and try to artificially allocate one?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment