Les deux révisions précédentesRévision précédenteProchaine révision | Révision précédenteProchaine révisionLes deux révisions suivantes |
en:documentation:tutorials:scratch [2020/02/10 16:09] – [cluster X5] ltaulell | en:documentation:tutorials:scratch [2020/08/25 15:58] – modification externe 127.0.0.1 |
---|
Two types of ''/scratch'' are available: | Two types of ''/scratch'' are available: |
| |
<note warning> | |
**Incomplete informations, because of new cluster (Lake)** | |
</note> | |
===== Global scratch of a cluster ===== | ===== Global scratch of a cluster ===== |
| |
| |
<note tip> | <note tip> |
**Chimie et Bio scratches are already available** | **-At last-, ''/scratch/Lake'' is available** |
</note> | </note> |
| |
<code> | <code> |
/scratch/ | /scratch/ |
├── Lake/ (yet to come, common to Lake cluster) | ├── Lake/ (common to Lake cluster) |
├── disk/ (local to some servers) | ├── disk/ (local to some servers) |
├── Chimie/ (reserved to chimie usage) | ├── Chimie/ (reserved to chimie usage) |
</code> | </code> |
| |
==== cluster E5 ==== | ==== Cluster E5 ==== |
| |
The ''/scratch/E5/'', common to ** E5-* ** queues is available for all [[documentation:clusters:hardware&#cluster_e5|cluster E5 nodes]]. | The ''/scratch/E5N/'', common to ** E5-* ** queues is available for all [[documentation:clusters:hardware&#cluster_e5|cluster E5 nodes]]. |
| |
It contains ''/scratch/E5/e5-2670-gfs-scratch'', as a empty check file. | It contains ''/scratch/E5N/E5N-gfs-scratch'', as a empty check file. |
| |
It is accessible from **[[documentation:clusters:services|cluster E5 front machines]]** | It is accessible from **[[documentation:clusters:services|cluster E5 front machines]]** |
<code> | <code> |
/scratch/ | /scratch/ |
├── E5/ (E5 scratch, common to E5 cluster) | ├── E5N/ (E5 scratch, common to E5 cluster) |
├── nvme/ (local to some servers) | ├── nvme/ (local to some servers) |
├── ssd/ (local to some servers) | ├── ssd/ (local to some servers) |
| |
</code> | </code> |
==== cluster X5 ==== | ==== Cluster X5 ==== |
| |
The ''/scratch/X5/'', common to ** X5-* ** queues is available for all [[documentation:clusters:hardware&#cluster_x55_x56|cluster x55/x56 nodes]]. | The ''/scratch/X5/'', common to ** X5-* ** queues is available for all [[documentation:clusters:hardware&#cluster_x55_x56|cluster x55/x56 nodes]]. |
| |
| |
==== scratch local to some nodes ==== | ==== Scratch local to some nodes ==== |
| |
Some local ''/scratch'' are available only on some nodes. [[documentation:clusters:hardware|See detailled description]] or ask staff. | Some local ''/scratch'' are available only on some nodes. [[documentation:clusters:hardware|See detailled description]] or ask staff. |
===== Using the /scratch: manual copy ===== | ===== Using the /scratch: manual copy ===== |
| |
For the global ''/scratch'', before submitting your job, copy your inputs into a folder on the ''/scratch'' (//ie// ''/scratch/login/whatever/''). | For global ''/scratch'', before submitting your job, copy your inputs into a folder on the ''/scratch/'' (//ie// ''/scratch/<cluster>/<login>/whatever/''). |
The simplest is to reproduce the same hierarchy of folders and files by changing '' /home'' by ''/scratch'' (copy with '' cp -r ''). | |
| The simplest is to reproduce the same hierarchy of folders and files by changing '' /home'' by ''/scratch/<cluster>''. |
| |
Do not forget to modify your submitting files consequently. | Do not forget to modify your submitting files consequently. |
===== Using the /scratch : automatic copy ===== | ===== Using the /scratch : automatic copy ===== |
| |
For local ''/scratch'' you don't know which node will be assigned to your job, it is also valid for the global scratch, but less annoying). Thus, You cannot copy your data to a particular node in advance. You must integrate the copy ''/scratch'' <-> ''/home'' in the submitted script. | For local ''/scratch'' you don't know which node will be assigned to your job (it is also valid for the global scratch, but less annoying). Thus, You cannot copy your data to a particular node in advance. You must integrate the copy ''/scratch'' <-> ''/home'' in the submitted script. |
| |
| |