VeizikNVIDIA and Apple Silicon builds are available now.Release notes →
Architectures

Qwen2

Grouped-query attention with qkv bias. The architecture behind the Qwen2 and Qwen2.5 families.

Language 3 supported combinations Apple Silicon
Stacked slabs of dark slate, two of the gaps between them lit from within.

Qwen2 on this site

3 supported combinations across Apple Silicon.

Image rendered by Veizik for NVIDIA, development build (linux x86_64) · SD3.5-medium · NVIDIA RTX 3090 · Powered by Stability AI

Families

Model families on this architecture

A family names one architecture. Support is declared per model and per target, so the same architecture can be open on one backend and absent from another.

Variants

Every supported combination

ModelModel identifierShort nameCheckpoint on diskVeizik device memoryContextHardware
Qwen2.5-0.5Bqwen2.5-0.5b0.5b942 MiB328 MiB32,768Apple Silicon
Qwen2.5-1.5Bqwen2.5-1.5b1.5b2,944 MiB884 MiB32,768Apple Silicon
Qwen2.5-7Bqwen2.5-7b7b14,525 MiB3,923 MiB32,768Apple Silicon

Veizik prepares supported weights in memory; no converted checkpoint is written to disk.

Elsewhere

Related