Server configuration for hosting and GPU inference | ||||
2 1× AMD Threadripper PRO 5955WX (16 cores, 4.0 GHz) 2× NVIDIA RTX 3090 24GB 64 GB DDR4 ECC 2× 1TB NVMe SSD (RAID 1) 2× 10GbE RJ-45 + 1× 1GbE for management 2× 1000W PSU (Redundant or rack-level redundant power supply) Air-cooled, with additional fan units Tower/2U server compatible with RTX cards Astra Linux Special Edition Commissioning | 2 1× AMD Ryzen Threadripper PRO 7965WX (24 cores, 48 threads) 2× NVIDIA RTX 5090 32GB 128 GB DDR5 ECC (4×32 GB) 2× 1.92 TB NVMe SSD (RAID 1) 2× 25GbE SFP28 + 1× 1GbE for IPMI (management) 2× 1600W Redundant PSU Air-cooled with enhanced GPU airflow 4U Tower/Workstation server (supports 2 double-slot GPUs) Astra Linux Special Edition Commissioning | 2 2× AMD EPYC 9354P (32 cores, 3.25 GHz) 2× NVIDIA H100 80GB PCIe 256 GB DDR5 ECC 2× 1.92TB NVMe U.2 SSD (RAID1) 2× 25GbE SFP28 + 1× 1GbE IPMI 2× 1600W Redundant PSU Air-mounted, hardened/passive GPU 2U GPU server (up to 2 double-slot GPUs) Astra Linux Special Edition Commissioning | 4 2× Intel Xeon Gold 6426Y (2.5 GHz, 16 cores each, 32 cores total per server) 4× NVIDIA H100 80GB PCIe (all independent, without NVLink) 512 GB DDR5 ECC (16×32 GB) 2× 1.92 TB NVMe U.2 SSDs (RAID1, for system and data) 2× 25GbE SFP28 (primary) + 1× 1GbE (Out-of-Band / IPMI management) 2× 2000W Redundant PSU Hybrid (air-liquid, optimal for H100) 4U GPU server (up to 4 double-slot GPUs) Astra Linux Special Edition Commissioning | 4 2× Intel Xeon Gold 6426Y (2.5 GHz, 16 cores each, 32 cores total per server) 4× NVIDIA H100 80GB PCIe (all independent, without NVLink) 512 GB DDR5 ECC (16×32 GB) 2× 1.92 TB NVMe U.2 SSDs (RAID1, for system and data) 2× 25GbE SFP28 (primary) + 1× 1GbE (Out-of-Band / IPMI management) 2× 2000W Redundant PSU Hybrid (air-liquid, optimal for H100) 4U GPU server (up to 4 double-slot GPUs) Astra Linux Special Edition Commissioning |