Contact Us (02) 9388 1741
MemoryAI KV Cache Server

MemoryAI™ KV Cache Server

Ethernet-based memory appliance for faster training and low-latency, enterprise-scale production inference.

HPCGuard Products
Products
MemoryAI KV Cache Server
#MemoryAI+KV+Cache+Server
Our Price: Request a Quote

Built to Perform

Penguin Solutions MemoryAI KV Cache Server is an Altus-based 4U rackmount server designed specifically for use as a KV cache server during AI inference. It features dual AMD EPYC CPUs and enables up to 11 TB of CXL-based memory (SMART CXA-8F2W).

The server provides 3TB main DDR5 memory and up to 8 1TB CXL Add-In-Cards (AICs) and uses dual 400Gb/s Ethernet NICs for network connectivity.



Key Features

Pooled Memory for KV Cache Storage

Up to 11 TB of DDR5 to create pooled memory for KV cache storage.

Expanded Memory Tiering

CXL Add-In-Cards to provide significantly expanded memory capacity critical for KV cache tiering.

High-Speed ECC Memory

Up to 24 DDR5-6400 MT/s ECC memory modules to deliver speed and efficiency for data-intensive workloads.

Dual AMD EPYC Processors

Dual AMD EPYC™ 9005 processors.

Technical Specifications

Full specifications for MemoryAI KV Cache Server.

Specification Details
Form Factor 4U Rackmount
Processors
  • Processor Number: 2
  • Processor Type: AMD EPYC™ 9005 series
  • Maximum TDP: 500W
Motherboard Chipset: SoC
Board Management
  • BMC Chipset: ASpeed AST2600
  • Dedicated BMC Interface: RJ45
  • IPMI 2.0: Yes
  • Virtual Media Over LAN: Yes
  • KVM Over LAN: Yes
  • RedFish: Yes
Memory
  • Memory Type: DDR5-6400 MT/s
  • Memory Capacity: Up to 3TB DDR5
  • CXL Memory Capacity: Up to 8TB (CXL based memory DIMMs)
Storage System
  • SATA/U.2 NVMe (2.5"): N/A
  • M.2 (2280/22110): 2 PCIe Gen3
Networking
  • Ethernet Controller: Intel® I350-AM2
  • On-Board LAN: 2x 400 GbE/RJ45
PCI Expansion Slots 8x PCIe Gen5 x16 FHFL, 2x PCIe Gen5 x16 LP
GPU
  • GPU Capable: No
  • GPU Supported: N/A
External I/O Interfaces
  • USB Ports: 2x USB 3.2 Gen1
  • Video Output: 1x VGA Port
Supported Operating System RHEL, Rocky
Power System Power Supply Size: 4x 3000W 80Plus Titanium
Regulatory Compliance CE, FCC
Mounting Hardware Standard Rails included
Operating Environment
  • Operating Temperature: 10°C to 35°C (50°F to 95°F)
  • Non-operating Temperature: 0°C to 60°C (32°F to 140°F)
  • Operating Relative Humidity: 8% to 80% (non-condensing)
  • Non-operating Relative Humidity: 20% to 95% (non-condensing)
System Dimensions
  • Height: 6.93 inches
  • Width: 17.64 inches
  • Depth: 34.65 inches
Warranty 3 Years Standard

Call a Specialist
Today!

Our team of experts is ready to help you find the perfect solution for your business needs. Get personalized advice and competitive quotes.

Monday - Friday: 9:00 AM - 6:00 PM AEST
Sydney, Australia

Speak to an Expert

We're here to help with any questions

Call us now
(02) 9388 1741