You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
We operate two SageMaker pipelines: training and batch inference. In the training pipeline, we create a model using the CreateModelStep API, where we explicitly specify the image_uri for inference. The process completes successfully, creating a new model package version which is then registered with the Model Registry. Upon reviewing the inference specification of the generated model package, the image_uri correctly reflects the specified Docker image for inference.
In the inference pipeline, we import the model package version following the guidelines in the documentation [1] and a sample project [2]. However, the image_uri is not preserved and defaults back to the training image.
As a result, we are unable to run the Batch Transform step because the job incorrectly uses the training image instead of the specified inference image.
maslick
changed the title
Inference image_uri is lost when importing creating a Model from model_package_arn
Inference Pipeline Defaults to Training Image Instead of Using Specified Inference Image
Oct 10, 2024
maslick
changed the title
Inference Pipeline Defaults to Training Image Instead of Using Specified Inference Image
Inference Pipeline defaults to Training image instead of using specified Inference image
Oct 10, 2024
Describe the bug
We operate two SageMaker pipelines: training and batch inference. In the training pipeline, we create a model using the
CreateModelStep
API, where we explicitly specify theimage_uri
for inference. The process completes successfully, creating a new model package version which is then registered with the Model Registry. Upon reviewing the inference specification of the generated model package, theimage_uri
correctly reflects the specified Docker image for inference.In the inference pipeline, we import the model package version following the guidelines in the documentation [1] and a sample project [2]. However, the
image_uri
is not preserved and defaults back to the training image.As a result, we are unable to run the Batch Transform step because the job incorrectly uses the training image instead of the specified inference image.
[1] https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-mkt-model-pkg-model.html#sagemaker-mkt-model-pkg-model-sdk
[2] https://github.com/aws-samples/aws-enterprise-mlops-framework/blob/b6eea322b44b6d90a110ae91298308ba060f96d1/mlops-multi-account-cdk/mlops-sm-project-template/mlops_sm_project_template/templates/train_deploy_batch_inference_product/seed_code/build_app/ml_pipelines/inference/pipeline.py#L221
To reproduce
Expected behavior
The image uri in the Inference specification is retained.
System information
The text was updated successfully, but these errors were encountered: