Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(deps): bump the python-packages group across 1 directory with 3 updates #239

Closed
wants to merge 9 commits into from
Closed
2 changes: 2 additions & 0 deletions .github/workflows/maintests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,8 @@ jobs:
uses: actions/setup-python@v4
with:
python-version: ${{ matrix.python }}
- name: Find and delete '+cu124' from requirements.txt (github runner doesn't support cuda)
run: sed -i 's/+cu124//g' requirements.txt
- name: Install tox and any other packages
run: |
python -m pip install --upgrade pip
Expand Down
2 changes: 2 additions & 0 deletions .github/workflows/prtests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,8 @@ jobs:
uses: actions/setup-python@v4
with:
python-version: ${{ matrix.python }}
- name: Find and delete '+cu124' from requirements.txt (github runner doesn't support cuda)
run: sed -i 's/+cu124//g' requirements.txt
- name: Install tox and any other packages
run: |
python -m pip install --upgrade pip
Expand Down
2 changes: 1 addition & 1 deletion README_advanced.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@
### Get worker files and install dependencies
- `git clone https://github.com/Haidra-Org/horde-worker-reGen.git`
- `cd .\horde-worker-reGen\`
- `pip install -r requirements.txt --extra-index-url https://download.pytorch.org/whl/cu121`
- `pip install -r requirements.txt --extra-index-url https://download.pytorch.org/whl/cu124`

### Run worker
- Set your config now, copying `bridgeData_template.yaml` to `bridgeData.yaml`, being sure to set an API key and worker name at a minimum
Expand Down
2 changes: 1 addition & 1 deletion environment.yaml → environment.linux.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,4 +8,4 @@ dependencies:
- nvidia::cuda-toolkit
- git
- pip
- python==3.10.12
- python==3.11.6
14 changes: 14 additions & 0 deletions environment.windows.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
name: ldm
channels:
- nvidia
- conda-forge
- peterjc123
- defaults
# These should only contain the minimal essentials to get the binaries going, everything else is managed in requirements.txt to keep it universal.
dependencies:
- nvidia::cuda-toolkit
- git
- pip
- python==3.11.6
- vc
- vs2017_runtime
2 changes: 1 addition & 1 deletion requirements.dev.txt
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
pytest==8.3.1
pytest==8.3.2
mypy==1.11.0
black==24.4.2
ruff==0.5.4
Expand Down
4 changes: 2 additions & 2 deletions requirements.rocm.txt
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
numpy==1.26.4
torch==2.3.1+rocm6.0
numpy==2.0.1
torch==2.4.0

horde_sdk~=0.14.0
horde_safety~=0.2.3
Expand Down
12 changes: 7 additions & 5 deletions requirements.txt
Original file line number Diff line number Diff line change
@@ -1,10 +1,12 @@
numpy==1.26.4
torch>=2.3.1

horde_sdk~=0.14.0
horde_safety~=0.2.3
horde_engine~=2.13.3
horde_sdk>=0.14.0
horde_model_reference>=0.8.1
horde_safety~=0.2.3

numpy==2.0.1
torch==2.4.0

mkl_fft

python-dotenv
ruamel.yaml
Expand Down
4 changes: 3 additions & 1 deletion tox.ini
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,8 @@ deps =
pytest-sugar
pytest-cov
requests
-r requirements.txt --extra-index-url https://download.pytorch.org/whl/cu121
numpy==1.26.4
-r requirements.txt --extra-index-url https://download.pytorch.org/whl/cu124
commands =
pytest tests {posargs} --cov

Expand All @@ -41,6 +42,7 @@ deps =
pytest-sugar
pytest-cov
requests
numpy==1.26.4
-r requirements.txt
commands =
pytest tests {posargs} --ignore-glob=*api_calls.py --cov
8 changes: 5 additions & 3 deletions update-runtime.cmd
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ if defined scribe (
SET CONDA_ENVIRONMENT_FILE=environment_scribe.yaml

) else (
SET CONDA_ENVIRONMENT_FILE=environment.yaml
SET CONDA_ENVIRONMENT_FILE=environment.windows.yaml
)

Reg add "HKLM\SYSTEM\CurrentControlSet\Control\FileSystem" /v "LongPathsEnabled" /t REG_DWORD /d "1" /f 2>nul
Expand All @@ -49,14 +49,16 @@ micromamba.exe shell hook -s cmd.exe -p %MAMBA_ROOT_PREFIX% -v
call "%MAMBA_ROOT_PREFIX%\condabin\mamba_hook.bat"
call "%MAMBA_ROOT_PREFIX%\condabin\micromamba.bat" activate windows

python -s -m pip install torch torchvision --index-url https://download.pytorch.org/whl/cu124 -U

if defined hordelib (
python -s -m pip uninstall -y hordelib horde_engine horde_model_reference
python -s -m pip install horde_engine horde_model_reference --extra-index-url https://download.pytorch.org/whl/cu121
python -s -m pip install horde_engine horde_model_reference --extra-index-url https://download.pytorch.org/whl/cu124
) else (
if defined scribe (
python -s -m pip install -r requirements-scribe.txt
) else (
python -s -m pip install -r requirements.txt -U --extra-index-url https://download.pytorch.org/whl/cu121
python -s -m pip install -r requirements.txt --extra-index-url https://download.pytorch.org/whl/cu124 -U
)
)
call deactivate
Expand Down
6 changes: 3 additions & 3 deletions update-runtime.sh
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ esac
shift # past argument or value
done

CONDA_ENVIRONMENT_FILE=environment.yaml
CONDA_ENVIRONMENT_FILE=environment.linux.yaml

wget -qO- https://github.com/mamba-org/micromamba-releases/releases/latest/download/micromamba-linux-64.tar.bz2 | tar -xvj bin/micromamba
if [ ! -f "conda/envs/linux/bin/python" ]; then
Expand All @@ -34,7 +34,7 @@ bin/micromamba create --no-shortcuts -r conda -n linux -f ${CONDA_ENVIRONMENT_FI

if [ "$hordelib" = true ]; then
bin/micromamba run -r conda -n linux python -s -m pip uninstall -y hordelib horde_engine horde_sdk horde_model_reference
bin/micromamba run -r conda -n linux python -s -m pip install horde_engine horde_model_reference --extra-index-url https://download.pytorch.org/whl/cu121
bin/micromamba run -r conda -n linux python -s -m pip install horde_engine horde_model_reference --extra-index-url https://download.pytorch.org/whl/cu124
else
bin/micromamba run -r conda -n linux python -s -m pip install -r requirements.txt -U --extra-index-url https://download.pytorch.org/whl/cu121
bin/micromamba run -r conda -n linux python -s -m pip install -r requirements.txt -U --extra-index-url https://download.pytorch.org/whl/cu124 -U
fi
Loading