TF-L8 Edge Inference
- Processors
- AMD EPYC 9124
- Accelerators
- 8 x NVIDIA L4 24GB
- Cores
- 16 total
- Memory
- 256GB DDR5
- Storage
- 4x 1.92TB U.2 NVMe
- Fabric
- 2x 25GbE
- Rack space
- 1U
- Peak power
- 0.9kW · 4A at 230V
- Heat rejected
- 3,071 BTU/hr
- Eight L4s in 1U on 900W total
- No auxiliary GPU power cables anywhere in the box
- Fits a colocation cabinet with a normal power allocation
Ships with Ubuntu 22.04 LTS · Triton Inference Server · TensorRT · Prometheus
30 working days