VeizikNVIDIA and Apple Silicon builds are available now.Release notes →
Hardware

Apple Silicon

Metal execution on Apple Silicon. Runs on supported Apple Silicon generations: M1, M2, M4 (M3 untested here).

Overlapping sheets of dark graphite metal, each fold catching a thin warm light seam.

Apple Silicon — what runs on it

Supported generations: M1, M2, M4 (M3 untested here).

Image rendered by Veizik for NVIDIA, development build (linux x86_64) · SD3.5-medium · NVIDIA RTX 3090 · Powered by Stability AI

Supported combinations

What runs on this target

ModelTaskDevice memoryContextStatus
Qwen2.5-0.5BLanguage328 MiB32,768Available
Qwen2.5-1.5BLanguage884 MiB32,768Available
Qwen3-1.7BLanguage923 MiB32,768Available
Qwen2.5-7BLanguage3,923 MiB32,768Available

Device memory measured on Apple M1 Max, Apple M2 Pro.