AMD EPYC 9754 socket: SP5

What the EPYC 9754 is

The EPYC 9754 leads Bergamo with 128 Zen 4c small cores and 256 threads for SP5 servers in June 2023. Cores run at 2.25 GHz base and up to 3.1 GHz boost with matching all-core boost, backed by 128 MB of L2 and 256 MB of L3. Eight 16-core CCDs plus the IOD form the package on TSMC 5 nm with about 71 billion transistors. Default power is 360 W for single and dual socket operation.

Maximum threads per socket suit cloud-native fleets that pack virtual machines, containers and web tiers by the hundreds. Small cores halve area against standard Zen 4 while keeping the same ISA, so density rises without new software. Twelve DDR5-4800 ECC channels feed 6 TB per socket, while 128 Gen5 lanes per socket feed fabric and NVMe. Efficiency per core leads Genoa flagships for scale-out rather than for single-thread leadership.

Buyers compare the 9754 against 96-core Genoa parts where cache and clocks matter more than threads. Bergamo wins where vCPU counts drive cost, while Genoa wins where per-core licences dominate. Boards that run Genoa accept Bergamo with a BIOS update on the same SP5 socket. The CPU cooler compatibility by socket guide covers why 360 W dense cooling decides sustained frequency.

Socket and motherboard compatibility

The 9754 fits SP5 on single or dual socket server boards with LGA 6096 frames. Board lists must name Bergamo 97x4 for Zen 4c support. Power delivery for 360 W continuous suits dense racks with strong front-to-back airflow.

SP5 boards wire 12 DDR5 channels per socket with two DIMMs per channel for full 6 TB. BMC firmware covers fleet telemetry. Confirm heatsink class for eight-CCD thermals before consolidating hundreds of VMs per node.

Memory, PCIe and cooling

DDR5-4800 ECC RDIMM in 12 channels per socket to 6 TB feeds 128 small cores for VM density. Interleaving tunes throughput for many small guests. ECC stays enabled for fleet uptime. Validated kits at rated speed are required.

PCIe Gen5 gives 128 lanes per socket and up to 160 in dual socket for fabric and NVMe. Scale-out nodes wire high-radix networking with fast scratch. Cooling needs SP5 server sinks for 360 W with data-centre flow. All-core frequency follows cooling more than the 3.1 GHz boost.

Upgrade paths

The 9754 already tops Bergamo threads, so upgrades mean memory, fabric and NVMe rather than more cores. Filling 12 channels and adding networking bring the largest gains. The sibling 9754S with 128 threads suits single-thread-per-core policies without a board change.

Outside Bergamo, Genoa adds cache and clocks on SP5, while Genoa-X adds stacked cache for HPC. Most 9754 owners optimise VM sizing first, since 256 threads already saturate many hosts.