You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We are planning to use SMD for running inference workflows. For inference workflows, it is important to run them multi-threaded in async manner to get best performance out of it. aioboto3 will enable simple replace of boto for true async calls to aws resources.
Out plan is to run a tornado server, and provide aioboto client to users, so that they can create & run async inference workflows by deploying SMD on SM Endpoint.
Use case description
No response
Alternatives
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
🚀 The feature, motivation and pitch
We are planning to use SMD for running inference workflows. For inference workflows, it is important to run them multi-threaded in async manner to get best performance out of it. aioboto3 will enable simple replace of boto for true async calls to aws resources.
Out plan is to run a tornado server, and provide aioboto client to users, so that they can create & run async inference workflows by deploying SMD on SM Endpoint.
Use case description
No response
Alternatives
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: