AC UserManual

From Public PIC Wiki
Revision as of 14:33, 18 May 2016 by Jcarrete (talk | contribs) (Created page with "== Storage == === Massive storage === Each project has a massive storage space accessible at the following path: /pnfs/pic.es/data/astro/{project} (see projects_url for more...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Storage

Massive storage

Each project has a massive storage space accessible at the following path:

/pnfs/pic.es/data/astro/{project} (see projects_url for more details)

which has only read permissions for the project's users.

Inside the directory there are two different paths corresponding to two different back-ends:

Tape

/pnfs/pic.es/data/astro/{project}/tape

As its name suggests, the data in the tape path is stored in magnetic tapes, and is critical, such as raw data or very difficult data to obtain or to get. The size of each file is usually large, from 1-2GB to 100-200GB, due to technical reasons (they are usually iso or tar.bz2 files). Data in tapes is not very often accessed. It is necessary a previous step when accessing data in tapes, which is the pre-stage. This step is the action of reading the magnetic tape and put the data into a buffer. Once the data is in the buffer one can access the data as it was in a disk. After some time, the data is removed from the buffer. In case the data in tape has to be available for long time get in touch with the contant person of the project.

Disk

/pnfs/pic.es/data/astro/{project}/disk

Disk data is usually the data being currently used by the project, and it is being very often accessed. The size of the files is not important here.

Scratch

Each user has a scratch space at the following path:

/nfs/astro/{user}

This space is thought as a sandbox. When the project decides some data from any scratch space is important enough for the whole collaboration, the contact person for each project will move the data into the /pnfs storage.

Take note that all data older than 6 months may be erased at any time without prior notice.

Software

Each user has a software space (for editable source code) at the following path.

/software/astro/src/{user}

This space is limited so please be careful with the size of the code (e.g. people downloading all branches/tags in svn repositories).

Each user has an environment space (for python virtual environments, see python_env_url for more details) at the following path:

/software/astro/env/{user}

Any location not included in the former paths is not allowed and its contents erased on sight.