Local AI Hardware / Macs for local AI

Mac Studio M2 Ultra 192GB for local AI

There are not yet enough recent completed sales of a used Mac Studio M2 Ultra 192GB to publish a price (we need at least 6 in the last 60 days).

192 GB of unified memory that the GPU can use: large models at low power, slower prompt processing than NVIDIA.

Type
Mac
Fits / supports
Up to 192 GB unified memory

What matters for AI

Apple Silicon runs very large models that would need several GPUs, at a fraction of the power. Prompt processing is much slower than on a 3090 or 4090, so long-context work feels slow even when generation speed is fine.

Before you buy a used Mac Studio for AI

  1. The memory configuration is fixed at purchase and is the whole point. Confirm it in About This Mac, not just the listing title.
  2. Make sure Activation Lock is off and the Mac is not enrolled in a company's device management.
  3. Apple Silicon is slower than NVIDIA at prompt processing; long-context work feels slower even when generation speed is fine.