VeizikNVIDIA and Apple Silicon builds are available now.Release notes →
veiziknative inference engine
Sign inDownload
Product
OverviewWhat the engine isHow it worksWeights in, native execution outPlatformsNVIDIA · Apple SiliconSecurity & licensingDevice-bound, local by designReleasesEvery build, dated
Engineering
How it worksOne researched page per capabilityVideo memory720p that stays under a 24 GB cardA 35B model on one card21 GiB resident on a 24 GB GPUIts own stackNo Python, no framework, no cuBLASResume a renderCrash, resume, same result
Models
NVIDIALanguage and video — available nowApple SiliconQwen2.5 · Qwen3 — availableFull catalogueEvery model and its status
Hardware
All hardwareEvery device × every modelPick your deviceWhat runs on yoursNVIDIAAmpere → Blackwell · CUDAApple SiliconM1 – M4 · Metal
Benchmarks
All resultsMatrix or pick, by buildBuilds & downloadsEvery build, JSON / CSVMethod & notationHow every figure is taken
Docs
QuickstartInstall to first runCommand referenceEvery documented commandActivate a machineDevices and licenceWhat leaves the machineOffline and networkTroubleshootingWhen something fails
ReleasesSign inDownloadGitHub
Releases

veizik Qwen (CUDA) v1.1.3 — Qwen3.5 / Qwen3.6, single-file .vzpack — cuda-qwen-1.1.3

Qwen3.6-35B-A3B and Qwen3.5 (0.8B, 2B, 4B, 9B) on your own NVIDIA GPU — text generation, serving, and image and video understanding — through veizik's own native CUDA engine: no Python runtime, no CUDA toolkit, no cloud at inference time. Activate once per device; all included models run. You supply the weights; nothing leaves the machine.

This page records the state as of 2026-10-28 and is not updated as the catalogue moves. For what runs now, see models.

Highlights

What this build does

  • Image and video input in the package's Qwen3.6-35B-A3B engine: it reads one image (PNG or JPEG) or one video (2 to 256 frames as PNG or JPEG files, in file-name order) together with a text prompt. Pass --image FILE or --video DIR to veizik run qwen36_35b_a3b.
  • veizik serve <model>: a resident, batched, OpenAI-compatible HTTP server on 127.0.0.1 with server-sent-event streaming (/v1/chat/completions, /v1/completions, /v1/models, plus health and metrics endpoints).
  • API-key authentication for the server: --require-auth with --keyfile or --api-key; a request without the key answers HTTP 401.
  • veizik run for the five models with five modes (quality, balanced, fast, ultrafast, low-memory); the prompt can come from text or a file.
  • Native GPU code for sm_80 through sm_120a, with the integrity of the bundle checked at every start.
  • Device-bound activation, per device rather than per model: browser approval, or browser-free activation with an account key and CLI password.
Support

Models in this release

ModelTaskContextStatus
Qwen3.5-0.8BLanguage4,096Available
Qwen3.5-2BLanguage4,096Available
Qwen3.5-4BLanguage4,096Available
Qwen3.5-9BLanguage4,096Available
Qwen3.6-35B-A3BLanguage4,096Available
Platform
Linux on x86-64
Verification
`veizik install` checks the download against SHA-256 0fcee30fc61a27c1a84b600b2a26521d8ffe0eed76b531320c16414232f367e5 and refuses any other file. The release is reproducible: SHA256SUMS on the release, a single-file .vzpack with a signed .vzindex. To check veizik-qwen-cuda-1.1.3-linux-x86_64.vzpack by hand, compare it with sha256sum.
File
veizik-qwen-cuda-1.1.3-linux-x86_64.vzpack
Size
56,552,565 bytes
SHA-256
0fcee30fc61a27c1a84b600b2a26521d8ffe0eed76b531320c16414232f367e5
GPU architectures
sm_80, sm_86, sm_89, sm_90a, sm_100a, sm_120a
Same GPU code run end to end on
NVIDIA GeForce RTX 4090 (sm_89); GeForce RTX 3090 (sm_86); NVIDIA GeForce RTX 5090 (sm_120a), as cuda-qwen-1.0.0
Release
v1.1.3
Installation

Get, install, activate

bash
# the veizik command for Linux x86-64
$ curl -fsSL https://veizik.com/install.sh | sh
# if the installer asks you to put ~/.local/bin on your PATH
$ export PATH="$HOME/.local/bin:$PATH"
# accepted names: qwen, qwen35, qwen36 or a full model key (qwen35_0p8b, qwen35_2b, qwen35_4b, qwen35_9b, qwen36_35b_a3b); any case; '.' and '-' work too (qwen3.6)
$ veizik install qwen36
# have the Qwen3.5-0.8B checkpoint on this machine first: activation ends with a short check generation that uses it
$ export VZ_WEIGHTS=/data/models
$ veizik activate
# without a browser (SSH, servers): create a key and a CLI password on your account page, then
$ veizik activate --key KEY --password-stdin < pwfile

veizik install refuses a download whose SHA-256 differs from this release. The other packages are on the download page.

Fixed

Fixed issues

  • Single-file install: veizik install qwen now fetches one signed .vzpack (plus a small shared-core .vzroot the first time) and verifies it against the release SHA-256; the separate per-model .tar download is retired. Same five models, same compute — the engine and GPU code are byte-identical to 1.1.2.
Known issues

Known issues in cuda-qwen-1.1.3

  • Image and video input is a capability of the Qwen3.6-35B-A3B engine only, one image or one video per run, and its GPU code ships for RTX 30-series (sm_86), RTX 40-series (sm_89) and RTX 50-series (sm_120a) class GPUs only. The text models keep all six GPU architectures.
  • The server is loopback-only; to serve other machines put a TLS reverse proxy in front of it. Without --require-auth any local process can use it.
  • No usage ledger or quotas in the server; --usage-log, --quota-* and --max-tokens are accepted but not applied.
  • veizik stop does not see the server; stop a detached server by signalling the engine process.
  • veizik chat gives an interactive text session; veizik serve (/v1/chat/completions) is the validated path. Generation needs the model weights present and the device activated with veizik activate.
  • Qwen3.6-35B-A3B in quality mode needs about 26 GB or more and did not complete on a 32 GB RTX 5090 in validation; use balanced or fast.
  • Sampling options on run (--seed, --temperature, --top-p, --top-k) are opt-in and experimental; greedy decoding is the default and the verified path.
  • The server context window is 4,096 tokens per request (prompt plus generated) in the validated configuration.
  • GPU code for sm_80, sm_90a and sm_100a is included but was not run in validation.
  • WSL is not supported; the package installs on Linux x86-64 only.
  • Not in this release: LoRA adapters, image or video input on models other than Qwen3.6-35B-A3B, tool or function calling, logprobs and embeddings over HTTP, a weight converter.