Clusters¶
Work in Progress
HoreKa 2 is not yet fully commissioned. Until the official launch of HoreKa 2 (Phase 2) in December, partitions and services will be brought online gradually. In particular, the ARM (A64) partition is not yet available and will be commissioned in Phase 2.
Functionality may be incomplete or subject to change. Thank you for your patience!
Scheduled Downtime: Shutdown of all HPC Clusters: 20.11.2026 – 04.12.2026
From 23 November 2026 until 4 December 2026 (expected), the computing center building (449.3) at KIT Campus North will be completely disconnected from the power grid due to mandatory inspections and maintenance work on the electrical infrastructure. This will affect all HPC systems operated at KIT. Jobs will only be running until noon on Friday, November 20, 2026. The following clusters will be unavailable during this period:
- bwUniCluster 3.0
- HoreKa 2
- HoreKa
- HAICORE@KIT
- Future Technologies Partition
During this period, access to your data will not be possible. Compute jobs will not run while the systems are offline. Workspace expiration and automatic deletion will be suspended for the duration of the downtime; therefore, no ws_extend request is required.
To avoid additional service interruptions in the near future, we will combine this building-related outage with our own maintenance activities, including operating system updates, software upgrades, file system maintenance, completion of the final phase of the power busbar upgrade, and preparations of the rack infrastructure for the planned GPU-based expansion of the HPC systems in 2027. Most importantly, this will include the final phase of bringing the Jade partition of HoreKa 2 into operation.
Once the maintenance work has been completed, the HPC systems will be brought back into operation one cluster at a time. The restart of all systems is planned to be completed by 4 December 2026.
Please be aware that, following the downtime and commissioning of the Jade partition, the second mandatory migration phase is active. This means that HoreKa (legacy) will only be accessible for logging in and accessing the file systems.
NHR@KIT operates two compute platforms: the production system HoreKa 2 / HAICORE 3.0 and the Future Technologies Partition (FTP) for experimental hardware.
HoreKa 2 / HAICORE 3.0¶
HoreKa 2 is the main Tier-2 production system at KIT. HAICORE 3.0 shares the same physical infrastructure; resource allocation is governed by the respective funding framework. The system consists of five partitions covering CPU-only and GPU-accelerated workloads.
| Partition | CPU | Nodes | Accelerators | Status |
|---|---|---|---|---|
| Onyx | AMD EPYC 9655 | 164 | — | operational |
| Blue | Intel Xeon Platinum 8368 | 8 | — | operational |
| Jade | NVIDIA Grace | 75 | 4× NVIDIA B200 | |
| Teal | AMD EPYC 9354 / Intel Xeon 8568Y+ | 23 | 4× H100 / 8× H200 | operational |
| Ruby | AMD EPYC 9454 | 13 | 4× NVIDIA H200 | operational |
Future Technologies Partition¶
The FTP provides access to emerging processor architectures for porting, performance evaluation, and research. New hardware is added continuously. The partition is split into an x86 cluster (ftp-x86-login.scc.kit.edu) and an ARM cluster (ftp-a64-login.scc.kit.edu).
| Manufacturer | Hardware |
|---|---|
| NVIDIA | Grace-Grace, Grace-Hopper |
| AMD | EPYC + MI100, MI210, MI250, Instinct MI300A |
| Intel | Sapphire Rapids (CPU, HBM, PVC), Gaudi 2 & 3 |
| Ampere | Altra Max |
| NextSilicon | Maverick-2 |