How to run a local LLM on your Mac: a step by step guide for designers, Claude prompt included I wrote a tutorial for designers who want an AI model (local LLM) running on their own machine A local model runs on your own computer 💻 You download a file once and from then on the intelligence sits on your machine It works without an account and without internet nothing is billed per token and nobody can switch it off or quietly swap it for a worse version The tutorial takes you from nothing to a model you can actually use: - What to install - Which model fits your Mac - What to actually use it for - Claude prompt to set everything up 🔗🔗🔗 Link in comments Have you run a local model on your own machine yet? Tell me in the comments which one you tried and how it went #ai #design #claude #localllm
I’m currently thinking about upgrading my machine, and one of the key considerations is being able to run local models so I can use them for both development and design tasks directly on a MacBook Pro. From what I understand, 64 GB of unified memory seems to be the sweet spot, but you only start getting into the really capable territory with 128 GB. Anyone running local models on a MacBook Pro? What has your experience been?
Good timing. Meta put out Muse Glimmer three days ago, 30B under Apache 2.0, quantized to fit a 24GB card with no network call. For me the unlock is not cost. It is reviewing client screens that are not allowed to leave the machine. Did you find it good enough for real work, or still mostly drafts?
Well this is amazing 🤩
I run this: https://huggingface.co/Jundot/Qwen3.6-35B-A3B-oQ6-fp16-mtp On a 64GB M4 Max Mac Studio using oMLX with MTP enabled.
Here is the full tutorial, let me know if you need any help: https://intodesignsystems.substack.com/p/how-to-run-a-local-llm-on-your-mac