Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restart instance automatically #67

Open
alexbussan opened this issue May 2, 2020 · 1 comment
Open

Restart instance automatically #67

alexbussan opened this issue May 2, 2020 · 1 comment

Comments

@alexbussan
Copy link

alexbussan commented May 2, 2020

Super basic question - I intend to use this to start spot instances and if they are terminated, automatically restart them.

It seems like that's one thing this tool can help with, but it doesn't explicitly say in the docs, so that's why I asking here. Can this tool do this?

@apls777
Copy link
Collaborator

apls777 commented May 6, 2020

@alexbussan Unfortunately, it's not supported at the moment.

It would a quite sophisticated functionality:

  1. It would require deploying some kind of a lambda function that keeps track of a running instance and restarts it when necessary.
  2. It should automatically resume all the previously running commands like model training, otherwise just restarting the instance is pointless.

Or Spotty could somehow reuse the SageMaker functionality: as far as I know, they support spot instances for their training jobs.

@apls777 apls777 changed the title Calrification Restart instance automatically Oct 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants