v1.9-djl-0.28.0-inf-trt-0.9.0
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.28.0-tensorrtllm0.9.0-cu122-v1.9
sha256:a0f8f0701f5b2582952fb4fe983719a5b1ca8c5c594dd08ef414edda5c1129c0
All tags:
0.28.0-tensorrtllm0.9.0-cu122
0.28.0-tensorrtllm0.9.0-cu122-v1.9-2024-12-17-19-47-53
0.28.0-tensorrtllm0.9.0-cu122-v1.9
0.28-tensorrtllm0.9.0-cu122-v1
Important Packages:
| pip packages | apt|deb packages |
|---|---|
| PyYAML==6.0.2 | cuda-command-line-tools-12-3 |
| absl-py==2.1.0 | libcublas-12-3 & libcublas-dev-12-3 |
| awscli==1.36.18 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| botocore==1.35.77 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| Cython==3.0.11 | libnccl-dev & libnccl2 |
| datasets==2.19.1 | libnccl-dev |
| filelock==3.16.1 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
| h5py==3.12.1 | |
| mpi4py==4.0.1 | |
| ninja==1.11.1.2 | |
| numpy==1.26.4 | |
| packaging==24.2 | |
| pandas==2.2.3 | |
| pillow==11.0.0 | |
| protobuf==5.29.1 | |
| regex==2024.11.6 | |
| requests==2.32.3 | |
| s3transfer==0.10.4 | |
| scipy==1.14.1 | |
| sentencepiece==0.2.0 | |
| setuptools==75.6.0 | |
| tokenizers==0.19.1 | |
| torch==2.2.1 | |
| torchvision==0.17.1 | |
| transformers==4.40.0 |