Skip to content

Commit

Permalink
Add JupyterLab extensions, jupyter-server-proxy and SageMaker scheduler
Browse files Browse the repository at this point in the history
  • Loading branch information
Zuoyuan Huang committed Nov 2, 2023
1 parent 5143a27 commit f922b13
Show file tree
Hide file tree
Showing 10 changed files with 1,327 additions and 19 deletions.
24 changes: 24 additions & 0 deletions build_artifacts/v1/v1.1/v1.1.0/CHANGELOG-cpu.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
# Change log: 1.1.0(cpu)

## Upgrades:

Package | Previous Version | Current Version
---|---|---
python|3.10.12|3.10.13
pandas|2.1.1|2.1.2
jupyter-scheduler|2.2.0|2.3.0
ipython|8.16.1|8.17.2
boto3|1.28.68|1.28.64
scikit-learn|1.3.1|1.3.2
jupyter-ai|2.3.0|2.4.0
matplotlib|3.8.0|3.8.1
sagemaker-python-sdk|2.194.0|2.196.0

## What's new:

Package | Version
---|---
amazon-sagemaker-jupyter-scheduler|3.0.2
jupyter-server-proxy|4.1.0
sagemaker-jupyterlab-emr-extension|0.1.7
sagemaker-jupyterlab-extension|0.1.7
24 changes: 24 additions & 0 deletions build_artifacts/v1/v1.1/v1.1.0/CHANGELOG-gpu.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
# Change log: 1.1.0(gpu)

## Upgrades:

Package | Previous Version | Current Version
---|---|---
python|3.10.12|3.10.13
pandas|2.1.1|2.1.2
jupyter-scheduler|2.2.0|2.3.0
ipython|8.16.1|8.17.2
boto3|1.28.68|1.28.64
scikit-learn|1.3.1|1.3.2
jupyter-ai|2.3.0|2.4.0
matplotlib|3.8.0|3.8.1
sagemaker-python-sdk|2.194.0|2.196.0

## What's new:

Package | Version
---|---
amazon-sagemaker-jupyter-scheduler|3.0.2
jupyter-server-proxy|4.1.0
sagemaker-jupyterlab-emr-extension|0.1.7
sagemaker-jupyterlab-extension|0.1.7
3 changes: 2 additions & 1 deletion build_artifacts/v1/v1.1/v1.1.0/Dockerfile
View file
Original file line number Diff line number Diff line change
Expand Up @@ -108,6 +108,7 @@ RUN SYSTEM_PYTHON_PATH=$(python3 -c "from __future__ import print_function;impor
# Patch Sparkmagic lib to support Custom Certificates \
# https://github.com/jupyter-incubator/sparkmagic/pull/435/files \
cp -a ${SYSTEM_PYTHON_PATH}/sagemaker_studio_analytics_extension/patches/configuration.py ${SYSTEM_PYTHON_PATH}/sparkmagic/utils/ && \
cp -a ${SYSTEM_PYTHON_PATH}/sagemaker_studio_analytics_extension/patches/reliablehttpclient.py ${SYSTEM_PYTHON_PATH}/sparkmagic/livyclientlib/reliablehttpclient.py
cp -a ${SYSTEM_PYTHON_PATH}/sagemaker_studio_analytics_extension/patches/reliablehttpclient.py ${SYSTEM_PYTHON_PATH}/sparkmagic/livyclientlib/reliablehttpclient.py && \
sed -i 's= "python"= "/opt/conda/bin/python"=g' /opt/conda/share/jupyter/kernels/pysparkkernel/kernel.json /opt/conda/share/jupyter/kernels/sparkkernel/kernel.json

ENV SHELL=/bin/bash
42 changes: 42 additions & 0 deletions build_artifacts/v1/v1.1/v1.1.0/RELEASE.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
# Release notes: 1.1.0

Package | gpu| cpu
---|---|---
python|3.10.13|3.10.13
numpy|1.26.0|1.26.0
jinja2|3.1.2|3.1.2
pandas|2.1.2|2.1.2
altair|5.1.2|5.1.2
jupyter-scheduler|2.3.0|2.3.0
ipython|8.17.2|8.17.2
jupyter-lsp|2.2.0|2.2.0
jupyterlab|4.0.7|4.0.7
amazon-sagemaker-jupyter-scheduler|3.0.2|3.0.2
boto3|1.28.64|1.28.64
scipy|1.11.3|1.11.3
scikit-learn|1.3.2|1.3.2
pip|23.3.1|23.3.1
torchvision|0.15.2|0.15.2
autogluon|0.8.2|0.8.2
ipywidgets|8.1.1|8.1.1
notebook|7.0.6|7.0.6
aws-glue-sessions|1.0.2|1.0.2
conda|23.9.0|23.9.0
jupyter-ai|2.4.0|2.4.0
jupyter-dash|0.4.2|0.4.2
jupyter-server-proxy|4.1.0|4.1.0
keras|2.12.0|2.12.0
matplotlib|3.8.1|3.8.1
py-xgboost-gpu|1.7.6|
python-lsp-server|1.8.2|1.8.2
pytorch-gpu|2.0.0|
sagemaker-headless-execution-driver|0.0.9|0.0.9
sagemaker-jupyterlab-emr-extension|0.1.7|0.1.7
sagemaker-jupyterlab-extension|0.1.7|0.1.7
sagemaker-kernel-wrapper|0.0.2|0.0.2
sagemaker-python-sdk|2.196.0|2.196.0
sagemaker-studio-analytics-extension|0.0.21|0.0.21
supervisor|4.2.5|4.2.5
tensorflow|2.12.1|2.12.1
pytorch| |2.0.0
py-xgboost-cpu| |1.7.6
6 changes: 5 additions & 1 deletion build_artifacts/v1/v1.1/v1.1.0/cpu.env.in
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ conda-forge::py-xgboost-cpu[version='>=1.7.6,<2.0.0']
conda-forge::jupyterlab[version='>=4.0.7,<5.0.0']
conda-forge::ipywidgets[version='>=8.1.1,<9.0.0']
conda-forge::conda[version='>=23.9.0,<24.0.0']
conda-forge::boto3[version='>=1.28.68,<2.0.0']
conda-forge::boto3[version='>=1.28.64,<2.0.0']
conda-forge::sagemaker-python-sdk[version='>=2.194.0,<3.0.0']
conda-forge::supervisor[version='>=4.2.5,<5.0.0']
conda-forge::autogluon[version='>=0.8.2,<1.0.0']
Expand All @@ -31,3 +31,7 @@ conda-forge::notebook[version='>=7.0.6,<8.0.0']
conda-forge::altair[version='>=5.1.2,<6.0.0']
conda-forge::sagemaker-studio-analytics-extension[version='>=0.0.21,<1.0.0']
conda-forge::jupyter-dash[version='>=0.4.2,<1.0.0']
conda-forge::sagemaker-jupyterlab-extension[version='>=0.1.7,<1.0.0']
conda-forge::sagemaker-jupyterlab-emr-extension[version='>=0.1.7,<1.0.0']
conda-forge::amazon-sagemaker-jupyter-scheduler[version='>=3.0.2,<4.0.0']
conda-forge::jupyter-server-proxy[version='>=4.1.0,<5.0.0']
609 changes: 609 additions & 0 deletions build_artifacts/v1/v1.1/v1.1.0/cpu.env.out
View file

Large diffs are not rendered by default.

8 changes: 0 additions & 8 deletions build_artifacts/v1/v1.1/v1.1.0/dirs/etc/jupyter/jupyter_server_config.py
View file
Original file line number Diff line number Diff line change
@@ -1,8 +1,6 @@
# Default Jupyter server config
# Note: those config can be overridden by user-level configs.

from nb_conda_kernels import CondaKernelSpecManager

c.ServerApp.terminado_settings = { 'shell_command': ['/bin/bash'] }
c.ServerApp.tornado_settings = { 'compress_response': True }

Expand All @@ -16,9 +14,3 @@
# Enable `allow_hidden` by default, so hidden files are accessible via Jupyter server
# Related documentation: https://jupyterlab.readthedocs.io/en/stable/user/files.html#displaying-hidden-files
c.ContentsManager.allow_hidden = True

# Kernel manager configurations
# Use Conda kernelspec managers, so that kernels installed in different conda
# environments can be detected and used in Jupyter
c.ServerApp.kernel_spec_manager_class=CondaKernelSpecManager
c.CondaKernelSpecManager.conda_only = True
6 changes: 5 additions & 1 deletion build_artifacts/v1/v1.1/v1.1.0/gpu.env.in
View file
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ conda-forge::py-xgboost-gpu[version='>=1.7.6,<2.0.0']
conda-forge::jupyterlab[version='>=4.0.7,<5.0.0']
conda-forge::ipywidgets[version='>=8.1.1,<9.0.0']
conda-forge::conda[version='>=23.9.0,<24.0.0']
conda-forge::boto3[version='>=1.28.68,<2.0.0']
conda-forge::boto3[version='>=1.28.64,<2.0.0']
conda-forge::sagemaker-python-sdk[version='>=2.194.0,<3.0.0']
conda-forge::supervisor[version='>=4.2.5,<5.0.0']
conda-forge::autogluon[version='>=0.8.2,<1.0.0']
Expand All @@ -31,3 +31,7 @@ conda-forge::notebook[version='>=7.0.6,<8.0.0']
conda-forge::altair[version='>=5.1.2,<6.0.0']
conda-forge::sagemaker-studio-analytics-extension[version='>=0.0.21,<1.0.0']
conda-forge::jupyter-dash[version='>=0.4.2,<1.0.0']
conda-forge::sagemaker-jupyterlab-extension[version='>=0.1.7,<1.0.0']
conda-forge::sagemaker-jupyterlab-emr-extension[version='>=0.1.7,<1.0.0']
conda-forge::amazon-sagemaker-jupyter-scheduler[version='>=3.0.2,<4.0.0']
conda-forge::jupyter-server-proxy[version='>=4.1.0,<5.0.0']
Loading

0 comments on commit f922b13

Please sign in to comment.