Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] {2023.06}[foss/2023a] PyTorch v2.1.2 with CUDA/12.1.1 #586

Draft
wants to merge 26 commits into
base: 2023.06-software.eessi.io
Choose a base branch
from
Draft

[WIP] {2023.06}[foss/2023a] PyTorch v2.1.2 with CUDA/12.1.1 #586

wants to merge 26 commits into from

Commits on May 17, 2024

  1. {2023.06}[system] cuDNN/8.9.2.26-CUDA-12.1.1

    @truib
    truib committed May 17, 2024
    Configuration menu
    Copy the full SHA
    6664591 View commit details
    Browse the repository at this point in the history

  2. add x permissions to install script

    @truib
    truib committed May 17, 2024
    Configuration menu
    Copy the full SHA
    0d744e7 View commit details
    Browse the repository at this point in the history

  3. fix arguments to cuDNN install script

    @truib
    truib committed May 17, 2024
    Configuration menu
    Copy the full SHA
    0d8a896 View commit details
    Browse the repository at this point in the history

  4. handle multiple dependencies to CUDA and related packages

    @truib
    truib committed May 17, 2024
    Configuration menu
    Copy the full SHA
    bd3469e View commit details
    Browse the repository at this point in the history

  5. fix syntax

    @truib
    truib committed May 17, 2024
    Configuration menu
    Copy the full SHA
    db85e23 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2024

  1. generalized CUDA/libraries installation script and easystack file

    @truib
    truib committed May 18, 2024
    Configuration menu
    Copy the full SHA
    3aad5d9 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. small improvements after testing script

    @truib
    truib committed May 21, 2024
    Configuration menu
    Copy the full SHA
    e191905 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2024

  1. Merge branch '2023.06-software.eessi.io' of github-trz:EESSI/software… 

    …-layer into 2023.06-software.eessi.io-cuDNN-8.9.2.26-system
    @truib
    truib committed May 22, 2024
    Configuration menu
    Copy the full SHA
    12fcec5 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. various updates to take suggestions into account 

    - `EESSI-install-software.sh`
  - use `scripts/gpu_support/nvidia/install_cuda_and_libraries.sh` with
    `scripts/gpu_support/nvidia/eessi-2023.06-cuda-and-libraries.yml`
- `create_lmodsitepackage.py`
  - consolidate `eessi_{cuda,cudnn}_enabled_load_hook` functions in a single one
    (`eessi_cuda_and_libraries_enabled_load_hook`)
  - the remaining hook is prepared to easily add new modules, e.g., cuTENSOR
- `eb_hooks.py`
  - put code that iterates over all files replacing non-distributable ones with
    symlinks into `host_injections` with a common function
    (`replace_non_distributable_files_with_symlinks`)
- `install_scripts.sh`
  - add files to copy to CVMFS (see `nvidia_files`)
- `scripts/gpu_support/nvidia/install_cuda_and_libraries.sh`
  - improved creation of tmp directory
    @truib
    truib committed May 23, 2024
    Configuration menu
    Copy the full SHA
    74a9a55 View commit details
    Browse the repository at this point in the history

  2. don't copy removed file

    @truib
    truib committed May 23, 2024
    Configuration menu
    Copy the full SHA
    7cd0d00 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. {2023.06}[foss/2023a] PyTorch v2.1.2 with CUDA/12.1.1

    @truib
    truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    2008870 View commit details
    Browse the repository at this point in the history

  2. add changes from EESSI#579

    @truib
    truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    68aa119 View commit details
    Browse the repository at this point in the history

  3. make sure envvar is set in prefix environment

    @truib
    truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    58120d2 View commit details
    Browse the repository at this point in the history

  4. Only install NVIDIA drivers if nvidia-smi command exists

    @ocaisa @truib
    ocaisa authored and truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    970d74b View commit details
    Browse the repository at this point in the history

  5. run build step with '--nvidia install' only (arg was 'all')

    @truib
    truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    2900e28 View commit details
    Browse the repository at this point in the history

  6. revert back some of the changes and be more close to NESSI

    @truib
    truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    5c04f16 View commit details
    Browse the repository at this point in the history

  7. make sure SitePackage.lua exists AND is updated if needed

    @truib
    truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    f8a2266 View commit details
    Browse the repository at this point in the history

  8. avoid using unset variables

    @truib
    truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    2213329 View commit details
    Browse the repository at this point in the history

  9. need pr_diff defined

    @truib
    truib committed May 24, 2024
    Configuration menu
    Copy the full SHA
    1ff6158 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. disable override GPU check in EESSI-install-software.sh

    @truib
    truib committed May 25, 2024
    Configuration menu
    Copy the full SHA
    5e827f5 View commit details
    Browse the repository at this point in the history

  2. redo code to create/update Lmod rc/SitePackage files

    @truib
    truib committed May 25, 2024
    Configuration menu
    Copy the full SHA
    ba8cc7d View commit details
    Browse the repository at this point in the history

  3. move setting EESSI_OVERRIDE_GPU_CHECK to bot/build.sh

    @truib
    truib committed May 25, 2024
    Configuration menu
    Copy the full SHA
    c1a7590 View commit details
    Browse the repository at this point in the history

  4. comment code for 'tricks' to override GPU checks

    @truib
    truib committed May 25, 2024
    Configuration menu
    Copy the full SHA
    e020246 View commit details
    Browse the repository at this point in the history

  5. add pre_configure hook that adds CUPTI lib dir

    @truib
    truib committed May 25, 2024
    Configuration menu
    Copy the full SHA
    2e78b71 View commit details
    Browse the repository at this point in the history

  6. fix indention error

    @truib
    truib committed May 25, 2024
    Configuration menu
    Copy the full SHA
    2af6b1a View commit details
    Browse the repository at this point in the history

  7. support multiple compute capabilities

    @truib
    truib committed May 25, 2024
    Configuration menu
    Copy the full SHA
    e05eafb View commit details
    Browse the repository at this point in the history