Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhance UX for inference #64

Open
ehsanmok opened this issue Aug 6, 2020 · 0 comments
Open

Enhance UX for inference #64

ehsanmok opened this issue Aug 6, 2020 · 0 comments

Comments

@ehsanmok
Copy link

ehsanmok commented Aug 6, 2020

The current SageMaker module wrapping process makes debugging very hard for both training and deployment. Now for inference, decorator is the simplest kind of solutions. For example, instead of requiring users to provide model_fn (which currently takes only one argument model_dir and basically if a model needs more argument to initialize it'd make the users frustrated), we can have a decorator like

@sagemaker.model_fn
def foo(*args, **kwargs): # one arg should be named model_dir for example
    ...

(Same goes for transform_fn, input_fn, output_fn). Then the decorator while expansion, looks for model_dir and everything else follows.

@ehsanmok ehsanmok changed the title SageMaker needs a lot more decorators for better UX Enhance UX for inference Aug 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants