Qwen3.6
Run the Qwen3.6-35B-A3B mixture-of-experts checkpoint in veizik's native runtime; on NVIDIA it also takes an image or a short video with the prompt. Weights are user-supplied, not shipped.
- Status
- Available
- Platform
- NVIDIA · CUDA
- Class
- Language
- Publisher
- Alibaba (Qwen)
- Architecture
- Qwen3.6
- Weights
- Supplied by you
What this package does
From the documents of veizik-qwen-cuda-1.1.3-linux-x86_64.vzpack (release v1.1.3).
- Five language models in one package: Qwen3.5-0.8B, Qwen3.5-2B, Qwen3.5-4B, Qwen3.5-9B and Qwen3.6-35B-A3B (mixture of experts, about 3B active per token). Every model does completion and chat.
veizik run <model> "prompt"generates once and writes the text to gen.txt in the folder you pass with--out. Greedy decoding is the default and gives the same output every time.--tokens N(or--max-tokens N) sets the length, and--ignore-eosemits exactly N tokens. Sampling is opt-in with--seed,--temperature,--top-pand--top-k, and is experimental.- Run options are one vocabulary across engines, and the command passes on only the ones an engine accepts. For Qwen:
--seed,--steps,--mode,--temperature,--top-p,--top-k,--tokens,--max-tokens, and on Qwen3.6-35B-A3B also--image,--video,--image-max-pixels,--video-max-pixelsand--video-fps. Any other option is refused with<flag> does not apply to this model.Every run also takes--out,--name,--prompt-file,--resume,--resume-fromand--checkpoint-every. veizik chat <model>holds an interactive conversation, using the package's signed model catalogue. It needsveizik activateonce per device and the model's weights (--weights DIRorVZ_WEIGHTS).veizik serve <model>is a local OpenAI-compatible HTTP server on 127.0.0.1 only:POST /v1/chat/completions(with streaming),POST /v1/completions,GET /v1/models, and health endpoints. Turn on an API key with--require-auth --keyfile FILE. Each request may use up to 4,096 tokens, prompt plus output. It needsveizik activateonce per device and the model's weights (--weights DIRorVZ_WEIGHTS).veizik doctorchecks the install root, the activation service and the CLI binary;veizik statusshows the device's activation and plan;veizik versionshows the version and backend.- Five modes: quality (most memory, slowest), balanced (the default), fast, ultrafast (the fastest) and low-memory (smallest footprint, lowest quality).
- Image input on Qwen3.6-35B-A3B: one PNG or JPEG image per run, with a text prompt:
veizik run qwen36_35b_a3b "…" --image FILE --out DIR.--image-max-pixelslimits the image size.veizik chatandveizik servetake text only. - Video input on Qwen3.6-35B-A3B: one folder of 2 to 256 PNG or JPEG frames, all the same size, in file-name order:
veizik run qwen36_35b_a3b "…" --video DIR --out DIR.--video-fpssets the frame rate (default 2) and--video-max-pixelslimits the frame size. The command forwards these options to the engine. - The image and video GPU code ships for sm_86, sm_89 and sm_120a (RTX 30, 40 and 50 series class GPUs) only. On any other GPU the run is refused with status 50 before any image or video work. No run record of image or video input is published.
- GPU code for text on sm_80, sm_86, sm_89, sm_90a, sm_100a and sm_120a. One GPU runs one model.
- Activation is once per device, and one approval covers every model:
veizik activatein a browser, orveizik activate --key KEY --password-stdinwithout one.veizik deviceslists the devices on your licence and switches them on or off, andveizik device-idprints this machine's id. veizik installdownloads the package from its public GitHub release and refuses it unless its SHA-256 matches the published release; the engine checks its own files at every start, and a changed, added or missing file stops the run with exit code 4.
How to run it
- Get the veizik command
Get the
veizikcommand for Linux x86-64:veizik$ curl -fsSL https://veizik.com/install.sh | sh # if the installer asks you to put ~/.local/bin on your PATH $ export PATH="$HOME/.local/bin:$PATH"
- Install the model engine
This model is in
veizik-qwen-cuda-1.1.3-linux-x86_64.vzpack.veizik installdownloads it from its GitHub release and refuses it unless its SHA-256 matches the one on the download page.install# accepted names: qwen, qwen35, qwen36 or a full model key (qwen35_0p8b, qwen35_2b, qwen35_4b, qwen35_9b, qwen36_35b_a3b); any case; '.' and '-' work too (qwen3.6) $ veizik install qwen36
- Activate this device
Approve the machine once; it receives a licence bound to it.
activate# have the Qwen3.5-0.8B checkpoint on this machine first: activation ends with a short check generation that uses it $ export VZ_WEIGHTS=/data/models $ veizik activate # without a browser (SSH, servers): create a key and a CLI password on your account page, then $ veizik activate --key KEY --password-stdin < pwfile
- Run it
The first commands for this model, as the package’s own documents give them.
run$ veizik run qwen36_35b_a3b "The capital of France is" --tokens 32 $ veizik chat qwen36_35b_a3b # image or video input, on Qwen3.6-35B-A3B only $ veizik run qwen36_35b_a3b "What is in this picture?" --image photo.png --out ./out $ veizik run qwen36_35b_a3b "What happens in this clip?" --video ./frames --video-fps 2 --out ./out
Where it runs.
Evidence and availability are separate: a verified device is not a download, and an available model is not verified on every device.
| Family | RTX 3080 Ti | RTX 3090 | RTX 4090 | RTX 5090 | RTX A5000 | A40 | A100 80GB PCIe | A100-SXM4-80GB | H100 80GB HBM3 | RTX PRO 4500 Blackwell | M4 Pro | M1 Ultra | M1 Max | M2 Pro |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3.6 all variants | ◐Architecture-supported | ●Verified | ●Verified | ●Verified | ◐Architecture-supported | ◐Architecture-supported | ○Expected, untested | ○Expected, untested | ○Expected, untested | ◐Architecture-supported | —Not offered | —Not offered | —Not offered | —Not offered |
Availability by variant
| Model id | Availability | Platform | Context | Weights in memory |
|---|---|---|---|---|
qwen36-35b-a3b | Available | NVIDIA | 4,096 | — |
Verified on
- GeForce RTX 3090 · build
cuda-qwen-1.1.3· 2026-10-22 · published measurement - NVIDIA GeForce RTX 4090 · build
cuda-qwen-1.1.3· 2026-10-28 · render-verified on the shipped package - NVIDIA GeForce RTX 5090 · build
cuda-qwen-1.1.3· 2026-10-21 · published measurement
“Verified” means this family ran end to end on that exact device, on a published build. Architecture membership never upgrades a device to verified.
1 checkpoint
| Model id | Size | Checkpoint | On disk | Context | Weights in memory |
|---|---|---|---|---|---|
qwen36-35b-a3b | 35B (A3B active) | Qwen/Qwen3.6-35B-A3B | — | — | — |
Our figures for this build
Each table shows the GPUs a model was measured on and one figure per measure: the default mode and the most common workload. Hover a figure for its build, date, runs and range; open All figures for every mode and workload. A figure marked earlier build is our own measurement of an earlier build of the engine, shown because the computation it exercises did not change in substance; it is replaced when the package you download is measured on that GPU. A figure whose build reads carried, measured on another build was measured on that earlier build of the same package and stands for the package named, because the change between the two did not alter the computation. Qwen3.6-35B-A3B can produce several tokens per step with output identical to one token at a time: "Decode" for the package includes that, "one token per step" does not, so the two columns are different measures.
Qwen3.6-35B-A3B
| GPU | Decode tok/s | Decode, one token per step tok/s | Decode, several tokens per step tok/s | Prompt pass ms | GPU memory in use GiB | Throughput, many at once tok/s |
|---|---|---|---|---|---|---|
| RTX 3090 | 194.3balanced · 22-token prompt | 197.922-token prompt | 251.7114-token promptearlier build | 107.2balanced · 22-token prompt | 21.44balanced | 230.68 concurrent requests |
| RTX 4090 | — | 272.5512-token promptearlier build | 373.9114-token promptearlier build | — | — | 625.58 sequences at onceearlier build |
| RTX 5090 | 449.9balanced · 21-token prompt | 390.8earlier build | — | 61.3balanced · 21-token prompt | 21.67balanced | — |
| A100-SXM4-80GB | — | 192.1512-token promptearlier build | 228.1114-token promptearlier build | — | — | — |
| H100 80GB HBM3 | — | 268.8512-token promptearlier build | 357.2114-token promptearlier build | — | — | — |
All 60 figures for Qwen3.6-35B-A3B
| GPU | Measure | Mode | Workload | Value | Runs | Build | Date |
|---|---|---|---|---|---|---|---|
| RTX 3090 | Decode | balanced | 22 / 128 | 194.3 tok/s | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Decode | balanced | 22 / 1024 | 209.7 tok/s | 1 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Decode | fast | 22 / 128 | 172.7 tok/s | 2 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Decode | multi-token steps (lossless) | 114 / 256 | 251.7 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g13 (2026-10-14) | 2026-10-14 |
| RTX 3090 | Decode | single-token decoding | 8 / 512 | 224.4 tok/s | 3 | earlier build Qwen3.6-35B-A3B earlier build g13 (2026-10-06) | 2026-10-06 |
| RTX 3090 | Decode | single-token decoding | 22 / 128 | 197.9 tok/s | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Decode | single-token decoding | 114 / 256 | 213.4 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g13 (2026-10-14) | 2026-10-14 |
| RTX 3090 | Decode | single-token decoding | 4000 / 129 | 211.8 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier build g4 (2026-10-06) | 2026-10-06 |
| RTX 3090 | Prefill | single-token decoding | 8000 / — | 9,065 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier build g10 (2026-10-06) | 2026-10-06 |
| RTX 3090 | Prompt pass | balanced | 22 / 128 | 107.2 ms | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Prompt pass | fast | 22 / 128 | 107.6 ms | 2 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Prompt pass | single-token decoding | 8000 / 1 | 949.5 ms | 1 | earlier build Qwen3.6-35B-A3B earlier build g10 (2026-10-06) | 2026-10-06 |
| RTX 3090 | GPU memory in use | balanced | — / — | 21.44 GiB | 1 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | GPU memory in use | fast | — / — | 21.51 GiB | 1 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | GPU memory in use | single-token decoding | — / — | 21.85 GiB | 1 | earlier build Qwen3.6-35B-A3B earlier build g11 (2026-10-06) | 2026-10-06 |
| RTX 3090 | Throughput | 1 request at a time | veizik serve, 1 concurrent request, 128 tokens each | 160.9 tok/s | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Throughput | 12 sequences at once | 12 sequences batched in one process, 64-token prompts | 411.7 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier build g11 (2026-10-06) | 2026-10-06 |
| RTX 3090 | Throughput | 16 sequences at once | 16 sequences batched in one process, 64-token prompts | 416.8 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier build g11 (2026-10-06) | 2026-10-06 |
| RTX 3090 | Throughput | 24 sequences at once | 24 sequences batched in one process, 64-token prompts | 424.8 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier build g11 (2026-10-06) | 2026-10-06 |
| RTX 3090 | Throughput | 4 concurrent requests | veizik serve, 4 concurrent requests, 128 tokens each | 222.4 tok/s | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Throughput | 4 sequences at once | 4 sequences batched in one process, 64-token prompts | 372.8 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier build g11 (2026-10-06) | 2026-10-06 |
| RTX 3090 | Throughput | 8 concurrent requests | veizik serve, 8 concurrent requests, 128 tokens each | 230.6 tok/s | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | Throughput | 8 sequences at once | 8 sequences batched in one process, 64-token prompts | 408.2 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier build g11 (2026-10-06) | 2026-10-06 |
| RTX 3090 | First token | 1 request at a time | veizik serve, 1 concurrent request, 128 tokens each | 182.7 ms | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | First token | 4 concurrent requests | veizik serve, 4 concurrent requests, 128 tokens each | 625.5 ms | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 3090 | First token | 8 concurrent requests | veizik serve, 8 concurrent requests, 128 tokens each | 1,001.0 ms | 3 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-1.0.0 | 2026-10-22 |
| RTX 4090 | Decode | multi-token steps (lossless) | 114 / 256 | 373.9 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g13 (2026-10-14) | 2026-10-14 |
| RTX 4090 | Decode | single-token decoding | 114 / 256 | 276.6 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g13 (2026-10-14) | 2026-10-14 |
| RTX 4090 | Decode | single-token decoding | 512 / 64 | 272.5 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| RTX 4090 | Decode | single-token decoding | 7680 / 64 | 251.4 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| RTX 4090 | Decode | single-token decoding | 16384 / 64 | 226.7 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| RTX 4090 | Throughput | 1 request at a time | veizik serve, 1 concurrent requests, 128 tokens each | 210.9 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier serve build (2026-10-14) | 2026-10-14 |
| RTX 4090 | Throughput | 1 sequence | 1 sequence batched in one process | 255.8 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g11 (2026-10-14) | 2026-10-14 |
| RTX 4090 | Throughput | 2 sequences at once | 2 sequences batched in one process | 391.3 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g11 (2026-10-14) | 2026-10-14 |
| RTX 4090 | Throughput | 4 concurrent requests | veizik serve, 4 concurrent requests, 128 tokens each | 377.6 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier serve build (2026-10-14) | 2026-10-14 |
| RTX 4090 | Throughput | 4 sequences at once | 4 sequences batched in one process | 557.7 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g11 (2026-10-14) | 2026-10-14 |
| RTX 4090 | Throughput | 8 concurrent requests | veizik serve, 8 concurrent requests, 128 tokens each | 417.5 tok/s | 1 | earlier build Qwen3.6-35B-A3B earlier serve build (2026-10-14) | 2026-10-14 |
| RTX 4090 | Throughput | 8 sequences at once | 8 sequences batched in one process | 625.5 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g11 (2026-10-14) | 2026-10-14 |
| RTX 5090 | Decode | balanced | 21 / 128 | 449.9 tok/s | 2 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-llm-1.0.0-be389a65 | 2026-10-21 |
| RTX 5090 | Decode | balanced | 21 / 1024 | 449.6 tok/s | 1 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-llm-1.0.0-be389a65 | 2026-10-21 |
| RTX 5090 | Decode | fast | 21 / 128 | 544.7 tok/s | 2 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-llm-1.0.0-be389a65 | 2026-10-21 |
| RTX 5090 | Decode | single-token decoding | short prompt | 390.8 tok/s | 3 | earlier build Qwen3.6-35B-A3B previous build with the router change (2026-10-14) | 2026-10-14 |
| RTX 5090 | Prompt pass | balanced | 21 / 128 | 61.3 ms | 2 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-llm-1.0.0-be389a65 | 2026-10-21 |
| RTX 5090 | Prompt pass | balanced | 21 / 1024 | 61.5 ms | 1 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-llm-1.0.0-be389a65 | 2026-10-21 |
| RTX 5090 | Prompt pass | fast | 21 / 128 | 61.3 ms | 2 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-llm-1.0.0-be389a65 | 2026-10-21 |
| RTX 5090 | GPU memory in use | balanced | — / — | 21.67 GiB | 2 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-llm-1.0.0-be389a65 | 2026-10-21 |
| RTX 5090 | GPU memory in use | fast | — / — | 21.74 GiB | 2 | cuda-qwen-1.1.3 · carried, measured on cuda-qwen-llm-1.0.0-be389a65 | 2026-10-21 |
| A100-SXM4-80GB | Decode | multi-token steps (lossless) | 114 / 256 | 228.1 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g13 (2026-10-14) | 2026-10-14 |
| A100-SXM4-80GB | Decode | single-token decoding | 114 / 256 | 184.0 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g13 (2026-10-14) | 2026-10-14 |
| A100-SXM4-80GB | Decode | single-token decoding | 512 / 64 | 192.1 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| A100-SXM4-80GB | Decode | single-token decoding | 7680 / 64 | 179.2 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| A100-SXM4-80GB | Decode | single-token decoding | 16384 / 64 | 169.8 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| H100 80GB HBM3 | Decode | multi-token steps (lossless) | 114 / 256 | 357.2 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g13 (2026-10-14) | 2026-10-14 |
| H100 80GB HBM3 | Decode | single-token decoding | 114 / 256 | 284.1 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g13 (2026-10-14) | 2026-10-14 |
| H100 80GB HBM3 | Decode | single-token decoding | 512 / 64 | 268.8 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| H100 80GB HBM3 | Decode | single-token decoding | 7680 / 64 | 259.1 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| H100 80GB HBM3 | Decode | single-token decoding | 16384 / 64 | 251.2 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9 (2026-10-14; decode kernels source-identical to the shipped package, recompiled) | 2026-10-14 |
| H100 80GB HBM3 | Decode | single-token decoding | 49152 / 64 | 218.9 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9, long-context variant (2026-10-14) | 2026-10-14 |
| H100 80GB HBM3 | Decode | single-token decoding | 64512 / 64 | 206.3 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9, long-context variant (2026-10-14) | 2026-10-14 |
| H100 80GB HBM3 | Decode | single-token decoding | 131072 / 64 | 172.4 tok/s | 1 | earlier build Qwen3.6-35B-A3B previous build g9, long-context variant (2026-10-14) | 2026-10-14 |
Measurement conditions
Default board power (limit not recorded); no quiet gate; dedicated single-GPU cloud host, native Linux; driver 595.91.07. NVIDIA A100 80GB; board power not recorded; driver not recorded; dedicated single-GPU cloud host; no quiet gate; one run; a measurement of the shipped package on this card will replace it. NVIDIA A100 80GB; dedicated single-GPU cloud host; board power not recorded; no quiet gate. NVIDIA GeForce RTX 3090 (24 GB) in the owner's workstation at a 420 W limit, not a cloud host; other GPU activity not recorded. NVIDIA GeForce RTX 3090; dedicated single-GPU cloud host, native Linux; default board limit 370 W, never reached (no power throttle, GPU at or below 44 C); driver 580.95.05; quiet re-run. NVIDIA GeForce RTX 3090; dedicated single-GPU cloud host; board power not recorded; no quiet gate. NVIDIA GeForce RTX 4090, dedicated single-GPU cloud host; board power not recorded; one run per level. NVIDIA GeForce RTX 4090; board power not recorded; driver 580.159.04; dedicated single-GPU cloud host; no quiet gate; one run; a measurement of the shipped package on this card will replace it. NVIDIA GeForce RTX 4090; dedicated single-GPU cloud host; board power not recorded; no quiet gate. NVIDIA GeForce RTX 5090; dedicated single-GPU cloud host; board power not recorded; runs on separate pods; no quiet gate. NVIDIA H100 80GB HBM3 (SXM); board power not recorded; driver 580.126.09; dedicated single-GPU cloud host; no quiet gate; one run; a measurement of the shipped package on this card will replace it. NVIDIA H100 80GB HBM3 (SXM); dedicated single-GPU cloud host; board power not recorded; no quiet gate.
Weights and terms
Qwen3.6 weights are published by Alibaba under Apache-2.0 and are supplied by the user, not shipped. Veizik ships only the inference engine and neither redistributes nor relicenses the weights.
Other models linked in the sidebar:
Stable Diffusion 3.5: Powered by Stability AI HunyuanImage: Weights are not included. Model availability and use are governed by the model provider's license and regional restrictions.