Usable local AI is a lot of fun, but how much would you pay for it?

This spring, Apple made it official: The Mac Pro is dead.
When Apple was using Intel processors and AMD GPUs, the idea of an expandable and upgradeable tower made sense. But Apple Silicon chips bring the CPU, GPU, and memory interface all under one roof in a way that makes that sort of upgradeability not just superfluous but impossible. At least not without breaking some of the chips’ key benefits.
And as it happens, Apple Silicon’s combination of a fast CPU, solid GPU, and unified memory architecture has made it a good fit for a modern “pro” workload that really pushes high-end hardware: running language models and agents locally.Read full article
Comments

Source: Ars Technica