Job Types on Betzy

Betzy is designed to run highly parallelized jobs. If you need to run medium-sized jobs, than Fram is a better choice, while for serial jobs you shall use Saga.

For a preprocessing or postprocessing job which only needs one or a few CPU cores, use a preproc job.

For development or testing use the devel queue which is limited to small and short jobs.

Here is a more detailed description of the different job types on Betzy:

Normal

  • Allocation units: whole nodes

  • Job Limits:

    • minimum 8 nodes

    • maximum 256 nodes

  • Maximum walltime: 4 days

  • Priority: normal

  • Available resources: 1340 nodes with 128 CPU cores and 250 GiB RAM

  • Parameter for sbatch/srun:

    • None, normal is the default

This is the default job type. In normal jobs, the queue system hands out complete nodes.

Preproc

  • Allocation units: cpus and memory

  • Job Limits:

    • maximum 8 billing units (CPU cores plus memory) per job

    • maximum 2 running jobs per user

  • Maximum walltime: 1 day

  • Priority: normal

  • Available resources: 128 CPU cores and 250 GiB RAM on one node

  • Parameter for sbatch/srun:

    • --qos=preproc

preproc jobs are meant for small preprocessing or postprocessing tasks. Typically, such jobs don’t use many CPUs, so requiring them to use 8 whole nodes would waste resources.

The details about how the billing units are calculated can be found in job_accounting.

Devel

  • Allocation units: whole nodes

  • Job Limits:

    • minimum 1 node, maximum 4 nodes per job

    • maximum 1 running job per user

  • Maximum walltime: 30 minutes

  • Priority: high

  • Available resources: 4 nodes with 128 CPU cores and 250 GiB RAM

  • Parameter for sbatch/srun:

    • --qos=devel

This is meant for small, short development or test jobs. Devel jobs have access to a set of dedicated nodes.

If you have temporary development needs that cannot be fulfilled by the devel job type, please contact us at support@metacenter.no.