How much memory does a Mac need for local AI
A Mac can give its GPU only part of its memory, so the number on the box is not the number a model gets. By the rule macOS uses, a 16GB Mac offers the GPU about 10.7GB, a 32GB Mac about 21.3GB, and a 64GB Mac 48GB. That, plus a safety margin of 1 to 2GB, decides which open models run at full speed. For an 8B model, 16GB is enough. For a 32B model, you want 36GB. For a 70B model at 4-bit, 64GB is the least that works.
Read more: How much memory does a Mac need for local AI ›














