Apple Silicon
Metal execution on Apple Silicon. Runs on supported Apple Silicon generations: M1, M2, M4 (M3 untested here).

Apple Silicon — what runs on it
Supported generations: M1, M2, M4 (M3 untested here).
Image rendered by Veizik for NVIDIA, development build (linux x86_64) · SD3.5-medium · NVIDIA RTX 3090 · Powered by Stability AI
What runs on this target
| Model | Task | Device memory | Context | Status |
|---|---|---|---|---|
| Qwen2.5-0.5B | Language | 328 MiB | 32,768 | Available |
| Qwen2.5-1.5B | Language | 884 MiB | 32,768 | Available |
| Qwen3-1.7B | Language | 923 MiB | 32,768 | Available |
| Qwen2.5-7B | Language | 3,923 MiB | 32,768 | Available |
Device memory measured on Apple M1 Max, Apple M2 Pro.