Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

release: v0.14.0 #474

Closed
wants to merge 9 commits into from
Closed

release: v0.14.0 #474

wants to merge 9 commits into from

Conversation

github-actions[bot]
Copy link
Contributor

This pull request was created by GitHub Actions/AWS CodeBuild! Before merging, please do the following:

  • Review changelog/staleness report.
  • (Only for Minor/Major version releases) Review python package dependency and size report.
  • Review build/test results by clicking Build Logs in CI Report (be patient, tests take ~4hr).
  • Review ECR Scan results.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

@sagemaker-distribution-bot

This comment was marked as outdated.

SageMaker Distribution Bot and others added 4 commits September 14, 2024 04:38
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Clayton Parnell <[email protected]>
Co-authored-by: SageMaker Distribution Bot <sm-distribution-github-bot[bot]@amazon.com>
Co-authored-by: Ruinong Tian <[email protected]>
Co-authored-by: Clayton Parnell <[email protected]>
@sagemaker-distribution-bot
Copy link
Collaborator

Staleness Report: 0.14.0(gpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
ipython 8.27.0 8.27.0
jinja2 3.1.4 3.1.4
ipywidgets 7.8.4 7.8.4
jupyterlab 3.6.8 3.6.8
numpy 1.26.4 1.26.4
pandas 2.2.2 2.2.2
boto3 1.35.21 1.35.21
aws-glue-sessions 1.0.7 1.0.7
conda 23.11.0 23.11.0
${\color{red}keras}$ 2.14.0 2.15.0
matplotlib 3.9.2 3.9.2
pip 23.3.2 23.3.2
scipy 1.14.1 1.14.1
scikit-learn 1.5.2 1.5.2
py-xgboost-gpu 1.7.6 1.7.6
thrift_sasl 0.4.3 0.4.3
pyhive 0.7.0 0.7.0
python-gssapi 1.8.3 1.8.3
${\color{red}pytorch-gpu}$ 2.0.0 2.4.0
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-python-sdk 2.227.0 2.227.0
sagemaker-studio-analytics-extension 0.1.2 0.1.2
${\color{red}tensorflow}$ 2.14.0 2.17.0
${\color{red}torchvision}$ 0.15.2 0.19.0

Staleness Report: 0.14.0(cpu)

Package Current Version in the Distribution image Latest Relevant Version in Upstream
ipython 8.27.0 8.27.0
jinja2 3.1.4 3.1.4
ipywidgets 7.8.4 7.8.4
jupyterlab 3.6.8 3.6.8
numpy 1.26.4 1.26.4
pandas 2.2.2 2.2.2
boto3 1.35.21 1.35.21
aws-glue-sessions 1.0.7 1.0.7
conda 23.11.0 23.11.0
keras 2.15.0 2.15.0
matplotlib 3.9.2 3.9.2
pip 23.3.2 23.3.2
scipy 1.14.1 1.14.1
scikit-learn 1.5.2 1.5.2
py-xgboost-cpu 1.7.6 1.7.6
thrift_sasl 0.4.3 0.4.3
pyhive 0.7.0 0.7.0
python-gssapi 1.8.3 1.8.3
${\color{red}pytorch}$ 2.1.2 2.4.0
sagemaker-headless-execution-driver 0.0.13 0.0.13
sagemaker-kernel-wrapper 0.0.4 0.0.4
sagemaker-python-sdk 2.227.0 2.227.0
sagemaker-studio-analytics-extension 0.1.2 0.1.2
${\color{red}tensorflow}$ 2.15.0 2.17.0
${\color{red}torchvision}$ 0.16.1 0.19.0

@sagemaker-distribution-bot
Copy link
Collaborator

Python Package Size Report (GPU)

Target Image Version: 0.14.0 | Base Image Version: 0.13.0

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
3.12GB 3.17GB -51.77MB -1.6

Top-20 Largest Python Packages

Package Version in the Target Image Size
cudatoolkit 11.8.0 682.45MB
tensorflow-base 2.14.0 517.65MB
cudnn 8.9.7.29 443.90MB
pytorch 2.0.0 399.35MB
mkl 2022.2.1 201.46MB
libmagma 2.7.1 201.22MB
nccl 2.22.3.1 124.94MB
libxgboost 1.7.6 99.28MB
llvm-openmp 18.1.8 55.77MB
qt6-main 6.7.2 44.84MB
pillow 10.4.0 40.35MB
libllvm18 18.1.8 36.46MB
python 3.11.10 29.19MB
pandoc 3.4 20.03MB
libclang-cpp18.1 18.1.8 18.29MB
scipy 1.14.1 16.90MB
pandas 2.2.2 14.96MB
icu 73.2 11.53MB
torchvision 0.15.2 11.09MB
libclang13 18.1.8 10.51MB

Python Package Size Delta

The total size of newly introduced Python packages is 78.76MB, accounts for 2.47% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
qt6-main 6.7.2 - 44.84MB -
libclang-cpp18.1 18.1.8 - 18.29MB -
pyside6 6.7.2 - 10.10MB -
libstdcxx 14.1.0 - 3.71MB -
sleef 3.7 3.6.1 900.87KB 92.42
libgcc 14.1.0 - 826.54KB -
plotly 5.24.1 5.23.0 557.38KB 8.9
wayland 1.23.1 - 314.02KB -
libdrm 2.4.123 - 296.00KB -
libxslt 1.1.39 - 248.34KB -
jupyterlab 3.6.8 3.6.7 227.35KB 4.08
matplotlib-base 3.9.2 3.9.1 141.97KB 1.84
pandoc 3.4 3.3 111.13KB 0.54
double-conversion 3.3.0 - 76.80KB -
sqlalchemy 2.0.35 2.0.31 54.37KB 1.59
libgfortran 14.1.0 - 50.92KB -
scikit-learn 1.5.2 1.5.1 46.79KB 0.45
libmamba 1.5.9 1.5.8 34.28KB 2.1
yarl 1.11.1 1.9.4 30.06KB 25.16
libpciaccess 0.18 - 27.70KB -
libglib 2.80.2 2.80.3 25.85KB 0.68
xcb-util-cursor 0.1.5 - 19.82KB -
contourpy 1.3.0 1.2.1 15.84KB 6.26
scipy 1.14.1 1.14.0 14.03KB 0.08
libmambapy 1.5.9 1.5.8 13.13KB 4.32
pyyaml 6.0.2 6.0.1 11.74KB 5.99
libpq 16.4 16.3 9.99KB 0.41
libcurl 8.10.1 8.9.1 8.64KB 2.13
sympy 1.13.2 1.13.0 7.64KB 0.17
debugpy 1.8.5 1.8.2 5.79KB 0.26
certifi 2024.8.30 2024.7.4 4.34KB 2.79
ca-certificates 2024.8.30 2024.7.4 4.05KB 2.68
menuinst 2.1.2 2.1.1 3.35KB 2.05
c-ares 1.33.1 1.32.3 2.99KB 1.7
libpng 1.6.44 1.6.43 2.38KB 0.85
cffi 1.17.1 1.16.0 1.86KB 0.64
google-auth 2.34.0 2.32.0 1.42KB 1.31
rpds-py 0.20.0 0.19.1 1.02KB 0.31
sagemaker-kernel-wrapper 0.0.4 0.0.2 1015.00B 6.61
rich 13.8.1 13.7.1 1011.00B 0.55
greenlet 3.1.0 3.0.3 810.00B 0.34
pyparsing 3.1.4 3.1.2 674.00B 0.75
multidict 6.1.0 6.0.5 662.00B 1.07
executing 2.1.0 2.0.1 648.00B 2.34
wheel 0.44.0 0.43.0 622.00B 1.07
boto3 1.35.21 1.34.151 538.00B 0.67
zipp 3.20.2 3.19.2 492.00B 2.35
truststore 0.9.2 0.8.0 419.00B 2.03
aws-glue-sessions 1.0.7 1.0.6 392.00B 0.57
expat 2.6.3 2.6.2 264.00B 0.19
pyasn1-modules 0.4.1 0.4.0 203.00B 0.21
matplotlib 3.9.2 3.9.1 151.00B 1.75
jupyter 1.1.1 1.0.0 108.00B 1.25
webcolors 24.8.0 24.6.0 87.00B 0.48
tqdm 4.66.5 4.66.4 67.00B 0.07
platformdirs 4.3.6 4.2.2 53.00B 0.26
ipywidgets 7.8.4 7.8.3 28.00B 0.03
types-python-dateutil 2.9.0.20240906 2.9.0.20240316 20.00B 0.09
widgetsnbextension 3.6.9 3.6.8 16.00B 0.0
cachetools 5.5.0 5.4.0 5.00B 0.03
libexpat 2.6.3 2.6.2 -114.00B -0.15
libsqlite 3.46.1 3.46.0 -132.00B -0.02
filelock 3.16.1 3.15.4 -235.00B -1.34
paramiko 3.4.1 3.4.0 -293.00B -0.18
jupyterlab_widgets 1.1.10 1.1.9 -325.00B -0.29
importlib_resources 6.4.5 6.4.0 -331.00B -1.0
libdeflate 1.21 1.20 -337.00B -0.47
ipython 8.27.0 8.26.0 -401.00B -0.07
pyjwt 2.9.0 2.8.0 -560.00B -2.25
werkzeug 3.0.4 3.0.3 -651.00B -0.27
kiwisolver 1.4.7 1.4.5 -880.00B -1.2
pytz 2024.2 2024.1 -1.51KB -0.82
pyasn1 0.6.1 0.6.0 -1.89KB -3.02
setuptools 73.0.1 71.0.4 -2.73KB -0.19
idna 3.10 3.7 -2.81KB -5.46
openssl 3.3.2 3.3.1 -3.34KB -0.12
pcre2 10.43 10.44 -4.82KB -0.52
botocore 1.35.21 1.34.151 -11.95KB -0.17
tbb 2021.13.0 2021.12.0 -17.19KB -9.1
pyzmq 26.2.0 26.0.3 -85.58KB -18.44
libsodium 1.0.20 1.0.18 -165.06KB -45.07
python 3.11.10 3.11.9 -270.54KB -0.9
cryptography 43.0.1 42.0.8 -480.90KB -24.69

Python Package Size Report (CPU)

Target Image Version: 0.14.0 | Base Image Version: 0.13.0

Python Packages Total Size Summary

Target Version Total Size Base Version Total Size Size Change (abs) Size Change (%)
886.97MB 938.74MB -51.77MB -5.51

Top-20 Largest Python Packages

Package Version in the Target Image Size
mkl 2023.2.0 156.82MB
tensorflow-base 2.15.0 140.09MB
llvm-openmp 18.1.8 55.77MB
libtorch 2.1.2 45.25MB
qt6-main 6.7.2 44.84MB
pillow 10.4.0 40.35MB
libllvm18 18.1.8 36.46MB
python 3.11.10 29.19MB
pytorch 2.1.2 27.88MB
pandoc 3.4 20.03MB
libclang-cpp18.1 18.1.8 18.29MB
scipy 1.14.1 16.90MB
pandas 2.2.2 14.96MB
icu 73.2 11.53MB
libclang13 18.1.8 10.51MB
scikit-learn 1.5.2 10.11MB
pyside6 6.7.2 10.10MB
torchvision 0.16.1 9.97MB
numpy 1.26.4 7.69MB
matplotlib-base 3.9.2 7.65MB

Python Package Size Delta

The total size of newly introduced Python packages is 78.76MB, accounts for ${\color{red}8.88}$% of the total package size.

Package Version in the Target Image Version in the Base Image Size Change (abs) Size Change (%)
qt6-main 6.7.2 - 44.84MB -
libclang-cpp18.1 18.1.8 - 18.29MB -
pyside6 6.7.2 - 10.10MB -
libstdcxx 14.1.0 - 3.71MB -
sleef 3.7 3.6.1 900.87KB 92.42
libgcc 14.1.0 - 826.54KB -
plotly 5.24.1 5.23.0 557.38KB 8.9
wayland 1.23.1 - 314.02KB -
libdrm 2.4.123 - 296.00KB -
libxslt 1.1.39 - 248.34KB -
jupyterlab 3.6.8 3.6.7 227.35KB 4.08
matplotlib-base 3.9.2 3.9.1 141.97KB 1.84
pandoc 3.4 3.3 111.13KB 0.54
double-conversion 3.3.0 - 76.80KB -
sqlalchemy 2.0.35 2.0.31 54.37KB 1.59
libgfortran 14.1.0 - 50.92KB -
scikit-learn 1.5.2 1.5.1 46.79KB 0.45
libmamba 1.5.9 1.5.8 34.28KB 2.1
yarl 1.11.1 1.9.4 30.06KB 25.16
libpciaccess 0.18 - 27.70KB -
libglib 2.80.2 2.80.3 25.85KB 0.68
xcb-util-cursor 0.1.5 - 19.82KB -
contourpy 1.3.0 1.2.1 15.84KB 6.26
scipy 1.14.1 1.14.0 14.03KB 0.08
libmambapy 1.5.9 1.5.8 13.13KB 4.32
pyyaml 6.0.2 6.0.1 11.74KB 5.99
libpq 16.4 16.3 9.99KB 0.41
libcurl 8.10.1 8.9.1 8.64KB 2.13
sympy 1.13.2 1.13.0 7.64KB 0.17
debugpy 1.8.5 1.8.2 5.79KB 0.26
certifi 2024.8.30 2024.7.4 4.34KB 2.79
ca-certificates 2024.8.30 2024.7.4 4.05KB 2.68
menuinst 2.1.2 2.1.1 3.35KB 2.05
c-ares 1.33.1 1.32.3 2.99KB 1.7
libpng 1.6.44 1.6.43 2.38KB 0.85
cffi 1.17.1 1.16.0 1.86KB 0.64
google-auth 2.34.0 2.32.0 1.42KB 1.31
fsspec 2024.9.0 2024.6.1 1.21KB 0.93
rpds-py 0.20.0 0.19.1 1.02KB 0.31
sagemaker-kernel-wrapper 0.0.4 0.0.2 1015.00B 6.61
rich 13.8.1 13.7.1 1011.00B 0.55
greenlet 3.1.0 3.0.3 810.00B 0.34
pyparsing 3.1.4 3.1.2 674.00B 0.75
multidict 6.1.0 6.0.5 662.00B 1.07
executing 2.1.0 2.0.1 648.00B 2.34
wheel 0.44.0 0.43.0 622.00B 1.07
boto3 1.35.21 1.34.151 538.00B 0.67
zipp 3.20.2 3.19.2 492.00B 2.35
truststore 0.9.2 0.8.0 419.00B 2.03
aws-glue-sessions 1.0.7 1.0.6 392.00B 0.57
expat 2.6.3 2.6.2 264.00B 0.19
pyasn1-modules 0.4.1 0.4.0 203.00B 0.21
matplotlib 3.9.2 3.9.1 151.00B 1.75
jupyter 1.1.1 1.0.0 108.00B 1.25
webcolors 24.8.0 24.6.0 87.00B 0.48
tqdm 4.66.5 4.66.4 67.00B 0.07
platformdirs 4.3.6 4.2.2 53.00B 0.26
ipywidgets 7.8.4 7.8.3 28.00B 0.03
types-python-dateutil 2.9.0.20240906 2.9.0.20240316 20.00B 0.09
widgetsnbextension 3.6.9 3.6.8 16.00B 0.0
cachetools 5.5.0 5.4.0 5.00B 0.03
libexpat 2.6.3 2.6.2 -114.00B -0.15
libsqlite 3.46.1 3.46.0 -132.00B -0.02
filelock 3.16.1 3.15.4 -235.00B -1.34
paramiko 3.4.1 3.4.0 -293.00B -0.18
jupyterlab_widgets 1.1.10 1.1.9 -325.00B -0.29
importlib_resources 6.4.5 6.4.0 -331.00B -1.0
libdeflate 1.21 1.20 -337.00B -0.47
ipython 8.27.0 8.26.0 -401.00B -0.07
pyjwt 2.9.0 2.8.0 -560.00B -2.25
werkzeug 3.0.4 3.0.3 -651.00B -0.27
kiwisolver 1.4.7 1.4.5 -880.00B -1.2
pytz 2024.2 2024.1 -1.51KB -0.82
pyasn1 0.6.1 0.6.0 -1.89KB -3.02
setuptools 73.0.1 71.0.4 -2.73KB -0.19
idna 3.10 3.7 -2.81KB -5.46
openssl 3.3.2 3.3.1 -3.34KB -0.12
pcre2 10.43 10.44 -4.82KB -0.52
botocore 1.35.21 1.34.151 -11.95KB -0.17
tbb 2021.13.0 2021.12.0 -17.19KB -9.1
pyzmq 26.2.0 26.0.3 -85.58KB -18.44
libsodium 1.0.20 1.0.18 -165.06KB -45.07
python 3.11.10 3.11.9 -270.54KB -0.9
cryptography 43.0.1 42.0.8 -480.90KB -24.69

@sagemaker-distribution-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: CosmosImageBuildersagemaker-U5omrjiHQCoa
  • Commit ID: 9a718d4
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@TRNWWZ
Copy link
Contributor

TRNWWZ commented Oct 1, 2024

FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[keras.test.Dockerfile-required_packages0]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pandas.test.Dockerfile-required_packages8]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sagemaker-studio-analytics-extension.test.Dockerfile-required_packages21]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[gpu-dependencies.test.Dockerfile-required_packages31]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[sm-python-sdk.test.Dockerfile-required_packages9]
FAILED test/test_dockerfile_based_harness.py::test_dockerfiles_for_gpu[pytorch.examples.Dockerfile-required_packages10]

(Rerun locally)

  • keras - Single test fails with AttributeError: 'CustomLayer' object has no attribute '_build_input_shape'. Issue with test, not installation
  • pandas - single test faied with E matplotlib._api.deprecation.MatplotlibDeprecationWarning: The plot_date function was deprecated in Matplotlib 3.9 and will be removed in 3.11. Use plot instead. - should be warning, test is using deprecated function
  • sagemaker-studio-analytics-extension - test passed locally, see NoCredentialsError: Unable to locate credentials in CodeBuild execution.
  • gpu-dependencies - Unit tests were executed in CPU environment so it failed, test pass when execute test script in container running on GPU instance
  • sm-python-sdk - sm-python-sdk test failures #316
  • pytorch - passed when running tests in local container directly, failure was caused by dependencies conflict when installing some , but not impacting functionality.

@TRNWWZ TRNWWZ closed this Oct 26, 2024
@TRNWWZ TRNWWZ deleted the release-0.14.0 branch October 26, 2024 17:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants