====== 20250826 / Cooling system ====== **Cooling system is down**, and it is worst than the last time. Idle nodes have been drain and poweroff. Working nodes might follow, if the situation doesn't evolve well. **EDIT 16h30:** all partitions **DOWN**, 230+ nodes powered **OFF**. All running jobs continue, at minimal frequencies. No **starting** jobs. **EDIT 21h30:** T°C back to normal with current reduced load. PSMN stay in **DRAIN** mode until further notice. **EDIT morning:** I forgot -> half login nodes and visu nodes powered **OFF** (no need for residual heat). {{tag> cooling hardware }}