New / Sealeddatacenter
SUPERCOMPUTERS
TF-8L40S Inference Node
MPN SYS-8XL40S · SKU T-1F394IC · Released 2024
SUPERCOMPUTERSSystemNo photograph on file
Why this part
- 384GB of GDDR6 ECC across eight cards
- Air-cooled in 4U, no facility water needed
- The sensible first production inference box
New / Sealed
Factory sealed, full manufacturer warranty where the vendor honours it in Pakistan.
Covered by a 36 month warranty from the manufacturer where honoured locally, and by us where not.
Specification
Compute
- Processors
- 2x AMD EPYC 9354
- Sockets
- 2
- Total cores
- 64
- Accelerators
- 8 x NVIDIA L40S 48GB
- BF16 aggregate
- 2896 TFLOPS
Memory & storage
- Memory
- 1 TB DDR5
- Storage
- 10x 3.84TB U.2 NVMe
- Fabric
- 2x ConnectX-6 HDR200 + 2x 25GbE
Physical & power
- Nodes
- 1
- Rack space
- 4U
- Peak power
- 4.80 kW
- Heat rejected
- 16,378 BTU/hr
Delivered with
- Software
- Ubuntu 22.04 LTS, CUDA 12, vLLM, Triton Inference Server, Prometheus + Grafana
- Burn-in
- 48 hours under synthetic load
Same part, other grades and partners
1 other SKU built on the same processor. The price difference comes from condition grade, board partner and cooler design, not from the chip itself.
Also considered
SUPERCOMPUTERSSystemNo photograph on file
New / Sealed
SUPERCOMPUTERS
TF-L8 Edge Inference
Request a quote
36mo warranty
SUPERCOMPUTERSSystemNo photograph on file
Refurbished Grade A
SUPERCOMPUTERS
TF-V2 VDI Node
Request a quote
12mo warranty
SUPERCOMPUTERSSystemNo photograph on file
New / Sealed
SUPERCOMPUTERS
TF-V2 VDI Node
Request a quote
36mo warranty