• Test bed
  • In service
  • Discipline-specific system for Astronomy and Cosmology
  • Funded by STFC, DiRAC, ExCALIBUR
  • 1 nodes, with 6 NVIDIA V100 32GB accelerators per node
  • Benchmarks (1) ▾
    • Memory bandwidth (BabelStream): 823 GB/s
      • array_size: 134217728
      • iterations: 100
      • precision: FP64
  • Manufactured by NVIDIA
  • Scheduler: Direct SSH
  • Interconnects:

COSMA V100

COSMA (The Compute Optimised System for Modelling and Analysis) is a High Performance Computing facility hosted at Durham University, operated by the Institute for Computational Cosmology on behalf of DiRAC.

The V100 node is a GPU testbed within COSMA, with 6x NVIDIA V100s.

Node RAM CPU Access
gn001 768GB 2x Intel Xeon Gold 5218 Direct SSH

Documentation

Gaining access

Access requires a COSMA account, obtained via the DiRAC SAFE portal.

  1. Create a SAFE account with an institutional email.
  2. Upload an SSH public key on SAFE. If you do not have one, generate with ssh-keygen -t ed25519.
  3. Request a login account. This requires selecting a project, either:
    • Project do016 for NVIDIA GPU testbed access.
    • A DiRAC project code for a given allocation (provided by a supervisor).
  4. Wait for the account to be approved by the project manager. Keep an eye on your email!
  5. Connect to COSMA via SSH: ssh username@login8.cosma.dur.ac.uk (Note: On first login you will be asked to change the password provided in your email)

Visit https://cosma.readthedocs.io/en/latest/account.html for more details. Contact cosma-support@durham.ac.uk for any questions.

Usage

Connect directly via SSH from a login node:

ssh gn001
nvidia-smi
./gpu_program_to_run

To use a single GPU, set CUDA_VISIBLE_DEVICES:

CUDA_VISIBLE_DEVICES=0 ./gpu_program_to_run

Restrictions

  • Nodes are non-exclusive by default (shared with other users). Use --exclusive if you require the entire node
  • V100 (sm_70) requires older CUDA: module load nvhpc/24.5