v1.7-djl-0.27.0-inf-trt-0.8.0
For details on the complete list of DLCs, please visit the AWS documentation page: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
Images Published:
763104351884.dkr.ecr.us-west-2.amazonaws.com/djl-inference:0.27.0-tensorrtllm0.8.0-cu122-v1.7
sha256:b8e0d106e28535db93a8d884d661754e4dc0e4be4930f123d87fe96744554bad
All tags:
0.27-tensorrtllm0.8.0-cu122-v1
0.27.0-tensorrtllm0.8.0-cu122
0.27.0-tensorrtllm0.8.0-cu122-v1.7
0.27.0-tensorrtllm0.8.0-cu122-v1.7-2024-12-17-19-35-31
Important Packages:
| pip packages | apt|deb packages |
|---|---|
| PyYAML==6.0.2 | cuda-command-line-tools-12-2 |
| awscli==1.36.18 | libcublas-12-2 & libcublas-dev-12-2 |
| botocore==1.35.77 | libcudnn8 & libcudnn8-dev |
| Cython==3.0.11 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| datasets==2.17.1 | libgcc-11-dev:amd64 & libgcc-s1:amd64 |
| filelock==3.16.1 | libnccl-dev & libnccl2 |
| mpi4py==4.0.1 | libnccl-dev |
| ninja==1.11.1.2 | libstdc++-11-dev:amd64 & libstdc++6:amd64 |
| numpy==1.26.4 | |
| packaging==24.2 | |
| pandas==2.2.3 | |
| pillow==11.0.0 | |
| protobuf==5.29.1 | |
| regex==2024.11.6 | |
| requests==2.32.3 | |
| s3transfer==0.10.4 | |
| scipy==1.14.1 | |
| sentencepiece==0.2.0 | |
| setuptools==75.6.0 | |
| tokenizers==0.15.2 | |
| torch==2.1.2 | |
| torchvision==0.16.2 | |
| transformers==4.38.1 |