System Overview
Comprehensive overview of REPACSS HPC infrastructure, components, and specifications.
Overview
The REPACSS is a high-performance computing (HPC) infrastructure designed to support intensive computational and data-driven research, powered by renewable energy. The system consists of compute, GPU, and storage nodes, interconnected with high-speed networking to ensure efficient data transfer and processing. The facility supports diverse workloads, including large-scale simulations, AI training, and data analytics.
Prerequisites
- Valid TTU eRaider account (for current users)
- GlobalProtect VPN access
- Basic knowledge of HPC concepts
- Familiarity with Linux command line
System Components
Compute Resources
Compute Nodes: 110 AMD-based nodes
- Dual AMD EPYC 9754 processors
- 256 cores per node
- 1.5TB DDR5 memory per node
- 1.92TB NVMe storage
GPU Nodes: 8 nodes
- Dual Intel Xeon Gold 6448Y processors
- 64 cores per node
- 512GB memory
- 4 NVIDIA H100 NVL GPUs (94GB HBM per GPU)
- 1.92TB SSD storage
Login Nodes: 3 nodes
- Dual AMD EPYC 9254 processors
- 48 cores per node
- 256GB memory
- 1.92TB NVMe storage
Storage Resources
Storage Nodes: 9 nodes
- Intel Xeon Gold CPUs
- 32/24/8 cores
- 1024GB/512GB memory
- 25.6TB–583.68TB storage per node
- Total ~2.94PB capacity
- High-speed NVMe and large-capacity HDDs
Networking
- Dell PowerSwitch S5248-ON and S5232-ON
- High-speed internal and external connectivity
- InfiniBand for storage
System Specifications
| Node Type | Total Nodes | CPU Model | CPUs/Node | Cores/Node | Memory/Node | Storage/Node | GPUs/Node | GPU Model |
|---|---|---|---|---|---|---|---|---|
| CPU Nodes | 110 | AMD EPYC 9754 | 2 | 256 | 1.5TB | 1.92TB NVMe | - | - |
| GPU Nodes | 8 | Intel Xeon Gold 6448Y | 2 | 64 | 512GB | 1.92TB SSD | 4 | NVIDIA H100 NVL (94GB) |
| Login Nodes | 3 | AMD EPYC 9254 | 2 | 48 | 256GB | 1.92TB NVMe | - | - |
| Storage Nodes | 9 | Intel Xeon Gold (varied) | 2 | 32/24/8 | 1024/512GB | 25.6–583.68TB | - | - |
Storage Systems
- Multi-tiered storage, ~2.94PB total
- High-speed NVMe and large-capacity HDDs
- Home, scratch, and archive spaces