Ci-dessous, les différences entre deux révisions de la page.
Les deux révisions précédentesRévision précédenteProchaine révision | Révision précédente | ||
en:documentation:tutorials:scratch [2020/02/10 16:15] – [cluster X5] ltaulell | en:documentation:tutorials:scratch [2023/12/12 12:57] (Version actuelle) – supprimée ltaulell | ||
---|---|---|---|
Ligne 1: | Ligne 1: | ||
- | ====== What is /scratch volume? ====== | ||
- | |||
- | |||
- | The ''/ | ||
- | The pros of working in the ''/ | ||
- | * offers a bigger volume than the volume available in your ''/ | ||
- | * increase processing speed of reads/ | ||
- | * increase the simultaneous I/O. | ||
- | \\ | ||
- | |||
- | Scratches are **shared and common storages**, their performances depends on your proper use. Hence, they must not contain: | ||
- | |||
- | * documentation (lots of useless small files) '' | ||
- | * symbolic links (tiny files), | ||
- | * programs or exe (useless I/O) '' | ||
- | |||
- | <note tip> | ||
- | |||
- | |||
- | Two types of ''/ | ||
- | |||
- | <note warning> | ||
- | **Incomplete informations, | ||
- | </ | ||
- | ===== Global scratch of a cluster ===== | ||
- | |||
- | As we have various clusters of different generations of processors (Lake, the newest, E5 and X5, the former), we have several global scratches. | ||
- | |||
- | ==== Cluster Lake ==== | ||
- | |||
- | The ''/ | ||
- | |||
- | It contains ''/ | ||
- | |||
- | It is accessible from **[[documentation: | ||
- | |||
- | <note tip> | ||
- | **Chimie et Bio scratches are already available** | ||
- | </ | ||
- | |||
- | < | ||
- | /scratch/ | ||
- | | ||
- | | ||
- | | ||
- | | ||
- | ... | ||
- | | ||
- | with dedicated hardware) | ||
- | |||
- | </ | ||
- | |||
- | ==== Cluster E5 ==== | ||
- | |||
- | The ''/ | ||
- | |||
- | It contains ''/ | ||
- | |||
- | It is accessible from **[[documentation: | ||
- | |||
- | |||
- | < | ||
- | /scratch/ | ||
- | | ||
- | | ||
- | | ||
- | ... | ||
- | | ||
- | with dedicated hardware) | ||
- | |||
- | </ | ||
- | ==== Cluster X5 ==== | ||
- | |||
- | The ''/ | ||
- | |||
- | It contains ''/ | ||
- | |||
- | It is accessible from **[[documentation: | ||
- | |||
- | < | ||
- | /scratch/ | ||
- | | ||
- | </ | ||
- | |||
- | |||
- | ==== scratch local to some nodes ==== | ||
- | |||
- | Some local ''/ | ||
- | |||
- | |||
- | ==== Network topology of PSMN ==== | ||
- | |||
- | |||
- | \\ | ||
- | The diagram below (<wrap warning> | ||
- | \\ | ||
- | |||
- | {{ : | ||
- | |||
- | < | ||
- | {{ : | ||
- | </ | ||
- | \\ | ||
- | |||
- | |||
- | ==== • Locals /scratch: ==== | ||
- | |||
- | These locals ''/ | ||
- | |||
- | |||
- | ====== How to use the scratch ====== | ||
- | ===== Using the /scratch: manual copy ===== | ||
- | |||
- | For global ''/ | ||
- | |||
- | The simplest is to reproduce the same hierarchy of folders and files by changing '' | ||
- | |||
- | Do not forget to modify your submitting files consequently. | ||
- | |||
- | At the end of the run, retrieve your results manually, in the ''/ | ||
- | |||
- | ===== Using the /scratch : automatic copy ===== | ||
- | |||
- | For local ''/ | ||
- | |||
- | |||
- | |||
- | **Examples are available | ||
- | |||
- | |||
- | We don't have a sample script that cleans up automatically. Similarly, if you don't feel comfortable with these scripts, do not hesitate to come and talk about during a Tuesday coffee session. | ||
- | |||
- | |||
- | ===== Technological transfer ===== | ||
- | |||
- | <WRAP info> The global /scratch (glusterfs) were deployed thanks to the upstream work, recipes and integrations made on the CBP experimental platform.</ | ||