Local AI Hardware / Multi-GPU build parts

64GB DDR4 ECC RDIMM for local AI

There are not yet enough recent completed sales of a used 64GB DDR4 ECC RDIMM to publish a price (we need at least 6 in the last 60 days).

Single 64 GB registered ECC modules, the building block for 256–512 GB CPU-inference rigs.

Type
Memory (single module)
Fits / supports
EPYC, Threadripper Pro, Xeon servers

Before you buy used server and workstation parts

  1. Used EPYC CPUs can be vendor-locked to Dell or Lenovo boards. Ask the seller to confirm it is unlocked.
  2. Check the board's slot layout: physical x16 slots are not all wired x16, and triple-slot GPUs block their neighbors.
  3. Buy memory in the type the board needs (RDIMM vs LRDIMM) and in matched sets for all channels.
  4. Workstations often come with proprietary power cabling that limits which GPUs they can feed.