NIRD - National e-Infrastructure for Research Data

The new data infrastructure, named NIRD (National Infrastructure for Research Data), will provide storage resources with yearly capacity upgrades, data security through geo-replication (data stored on two physical locations) and adaptable application services, multiple storage protocol support, migration to third-party cloud providers and much more. Alongside the national high-performance computing resources, NIRD forms the backbone of the national e-infrastructure for research and education in Norway, connecting data and computing resources for efficient provisioning of services.

The NIRD storage system consists of SFA14K controllers, 10TB NL-SAS drives with a total capacity of 12PiB in addition to a centralized file system (IBM GridScaler) supporting multiple file, block and object protocols. Sigma2 will provide the storage infrastructure with resources for the next 4 – 5 years through multiple upgrades and is expected to triple in capacity during its life-time.

The NIRD infrastructure offers Storage services, Archiving services and processing capacity for computing on the stored data.
More info here

Research Data

Project data storage

Getting Access

To gain access to the storage services, a formal application is needed. The process is explained at the User Access page.

Logging In

Access to the Project data storage area is through front-end (login) node:

login.nird.sigma2.no

Note that this hostname is actually a DNS alias for:
login0.nird.sigma2.no, login1.nird.sigma2.no, login2.nird.sigma2.no, login3.nird.sigma2.no
those are containers each one running the image of a login node.
A login container offers resources for a maximum of 16 cpus and 128GB of memory.

Users must be registered and authorized by the project responsible before obtaining access.

To access or transfer data use the following tools: ssh, scp or stfp. Visit the Transferring files page for details.

Home directories

Home directories are located in /nird/home/<username>. Default quota for home is 20GB and 100000 files. To check the disk usage type

 dusage

Home directories do also contain a backup of FRAM home directories (when relevant) in /nird/home/<username>/backup/fram.
To account for this default quota is doubled when relevant.

Project area

NIRD project areas are located in /nird/projects/<project_ID>.

The project area is quota controlled and current usage is obtained by running the command:

dusage -p <project_ID>

FRAM projects are only available from FRAM login nodes.
For more information, visit the Storage Systems on Fram page.

File transfering

Access to NIRD is permitted only through SSH. One can use scp and sftp to upload or download data from NIRD.

  • scp - secure copy files between hosts on a network
# copy single file to home folder on NIRD
# note that folder is ommitted, home folder being default
scp my_file.tar.gz <username>@login.nird.sigma2.no:

# copy a directory to project area
scp -r my_dir/ <username>@login.nird.sigma2.no:/projects/<projectname>/
  • sftp - interactive secure file transfer program (Secure FTP)
# copy all logs named starting with "out" from project1 folder
# to /projects/project1
sftp <username>@login.nird.sigma2.no
sftp> cd /projects/project1
sftp> lcd project1
sftp> put out*.log

Backup

  • Geo-replication is set up between Tromsø and Trondheim.
  • For backup, snapshots are taken with the following frequency:
    • daily snapshots of the last 7 days
    • weekly snapshots of the last 5 weeks.
  • See Backup.

results matching ""

    No results matching ""