Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add aioboto3 as dependencies required for async support #529

Open
GanAlps opened this issue Dec 18, 2024 · 1 comment
Open

Add aioboto3 as dependencies required for async support #529

GanAlps opened this issue Dec 18, 2024 · 1 comment

Comments

@GanAlps
Copy link

GanAlps commented Dec 18, 2024

🚀 The feature, motivation and pitch

We are planning to use SMD for running inference workflows. For inference workflows, it is important to run them multi-threaded in async manner to get best performance out of it. aioboto3 will enable simple replace of boto for true async calls to aws resources.

Out plan is to run a tornado server, and provide aioboto client to users, so that they can create & run async inference workflows by deploying SMD on SM Endpoint.

Use case description

No response

Alternatives

No response

Additional context

No response

@aws-tianquaw
Copy link
Contributor

We'll add the dependencies to SMD v2.3 and v3 image releases

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants