Apple Silicon
Metal execution on Apple Silicon. Runs on supported Apple Silicon generations: M1, M2, M3, M4.
What runs on this target
| Model | Task | Device memory | Context | Status |
|---|---|---|---|---|
| Qwen2.5-0.5B | Language | 327 MiB | 32,768 | Preview |
| Qwen2.5-1.5B | Language | 883 MiB | 32,768 | Preview |
| Qwen3-1.7B | Language | 923 MiB | 32,768 | Preview |
| Qwen2.5-7B | Language | 3,923 MiB | 32,768 | Preview |
Measured on Apple M1 Max, Apple M1 Ultra, Apple M2 Pro, Apple M4 Pro.