Summary
Z.ai released GLM-5.3-Flash weights under MIT on Hugging Face: a 320B-total / 18B-active natively multimodal MoE, the first GLM-5-series model trained from a newly built base rather than GLM-5.2. It combines sparse and linear attention to cut long-context serving cost and adds Manifold-Constrained Hyper-Connections, pre-trained on a 30T-token multimodal corpus. Z.ai claims it beats GLM-5.2 across benchmarks at one-tenth the price and approaches Claude Opus 4.8 on coding and agentic tasks; Artificial Analysis independently scored it 57 on their Intelligence Index (added 2026-08-26). vLLM, SGLang, Transformers, KTransformers and vLLM-Ascend support shipped day-0.
Why it matters
For teams weighing self-hosted open weights, this is the most permissive license in the current Chinese frontier wave (plain MIT, no revenue caps or security-review clauses) paired with an architecture explicitly designed to lower long-context serving costs — the two biggest blockers to production self-hosting. The hybrid sparse-linear attention design is also the first mainstream open-weight test of whether linear attention materially changes long-context unit economics; watch serving-stack version requirements before committing.
Technical details
| Architecture | 320B total / 18B active MoE; hybrid sparse + linear attention; Manifold-Constrained Hyper-Connections (mHC) |
|---|---|
| Base Model | newly trained base (not GLM-5.2); first natively multimodal model in the GLM-5 series |
| Pretraining | 30T-token multimodal corpus |
| License | MIT (GLM-5.3 main model uses a custom glm-5.3 license instead) |
| Repos | zai-org/GLM-5.3-Flash + GLM-5.3-Flash-BF16, created 2026-08-25T06:45Z; ungated |
| Serving | day-0: vLLM, SGLang, Transformers, KTransformers, Unsloth, vLLM-Ascend (Ascend NPU) |
| Independent Eval | Artificial Analysis Intelligence Index 57 (added 2026-08-26); Baseten hosting noted |
| Positioning | one-tenth the price of GLM-5.2; approaches Claude Opus 4.8 on coding/agentic benchmarks (vendor claim) |
| Community | 1,454 HF likes within 3 days (2026-08-28 check) |
Updates
2026-08-29 Adoption check @2026-08-29T11:35Z: zai-org/GLM-5.3-Flash at 189,793 downloads (30d; repo listed 8/25, so effectively all-time) + 1,557 likes; GLM-5.3-Flash-BF16 (created 2026-08-25T06:45Z) at 4,006 downloads. vLLM recipe page live (recipes.vllm.ai/zai-org/GLM-5.3-Flash; multimodal MoE ~321B total / 18B active). Community: r/LocalLLaMA megathread; NVFP4 quantized-serving comparisons vs Qwen3.8-Flash-Next on NVIDIA developer forums; third-party head-to-heads (Akash). No independent long-context throughput benchmarks published yet — vLLM/SGLang real-world numbers remain the open verification item. Recommendation stays TRIAL.
2026-08-31 Adoption check @2026-08-31T00:00Z: 346,516 downloads (30d window = all-time; +83% vs the 189,793 @8/29 sample, ~6 days after listing) + 1,711 likes (+154). Independent long-context throughput numbers still absent — Baseten's engineering blog covers GLM-5.2 in depth with GLM-5.3-Flash only in the serving lineup; no dedicated vLLM/SGLang throughput benchmark found. Recommendation stays TRIAL.
2026-09-02 adoption check @2026-09-02T00:0xZ: 441,348 downloads (+27% vs 346,516 @8/31, ~8 days after listing) + 1,878 likes; unsloth GLM-5.3-Flash-GGUF derivative at 63,718 downloads (repo created 8/26). Deployment-friction threads on HF (vLLM crash 'pe_dim must be 64 for fp8_ds_mla' on RTX PRO 6000 Blackwell #19, missing Glm5NextTextLinearAttention module #26, single-MI300 serving #34) plus a community hands-on coding/agentic test (#32) show real deployment activity but also an immature serving path; independent long-context throughput numbers still absent. Stays TRIAL
2026-09-05 Adoption check @2026-09-05: 654,957 downloads (+48% vs 9/2) + 2,044 likes; unsloth GLM-5.3-Flash-GGUF at 85,158. Discussion #38 (9/2) is a genuine third-party deployment report: FP8 on 2x L40S (sm_89) + EPYC 9845 with setup notes, patches and throughput numbers — the first independent throughput data point for the Flash line (long-context-specific throughput still absent); #40 reports unsloth Q3 tokens/s roughly doubling with low VRAM + sufficient RAM. Stays TRIAL
2026-09-12 2026-09-12 third-pass backfill: security-relevant research on these weights — refusal-direction ablation (arXiv 2609.09793, ev-20260911-06) survives MoE + block-FP8: editing the attention, dense and routed-expert writers together removes ~0.7+ of refusal with only a few hundred contrastive prompts; open-weight deployments should place safety enforcement outside the weights. Adoption @2026-09-11: 1,173,520 downloads + 2,245 likes; discussions #39-#48 remain deployment threads (SGLang image, unsloth Q3 throughput), still no third-party TB/SWE reproduction.
2026-09-13 2026-09-13 run: (1) Engineering post (z.ai/blog/glm-5.3-flash, published 2026-09-12T02:17:01Z - deferred by the previous run's cutoff): the ox-alpha anonymous-testing phase (most popular model of the week on OpenCode/OpenRouter) was served entirely on a large-scale Chinese-AI-chip cluster with high-bandwidth interconnect; a dedicated SGLang-based inference engine (kernels iterated with a GLM-5.3 infrastructure agent diagnosing bottlenecks) combines intra-node tensor parallelism, ReplaySSM, W8A8 quantization, hybrid INT8/FP8/BF16 cache quantization and Layer Split, fronted by an Encode-Prefill-Decode (EPD) disaggregated architecture - 3x end-to-end serving improvement over the initial baseline on the same hardware, with hardware efficiency and per-token cost claimed comparable to mainstream NVIDIA GPUs (vendor figures). New architecture details: 45 layers and 18B activated vs GLM-4.5's 92/32B at similar total params; IndexPool pools the four indexer key vectors into one to cut indexer latency/memory at 1M context; attention compute 3.0x lower and KV cache 4.4x smaller than GLM-5.3 (vendor). (2) HF discussion #50 (2026-09-12T21:43:59Z) is the strongest weights-side independent reproduction yet: one ASUS Ascent GX10 (DGX Spark-class GB10, 128GB unified memory) runs the model via the vLLM-Moet fork with 2-bit routed experts (tensor-symmetric codes {-4,-1,1,4}, one scale per 32 weights, GPTQ-calibrated on real code) plus a 2GiB FP4 hot-expert pool - HumanEval 97.0% (159/164) vs 95.1% on the z.ai API under identical prompts and temperature 0, HumanEval+ 93.9% vs 89.6%; ~29 tok/s code decode (DFlash2 drafter, k=7), ~640 tok/s prefill, 200K context with zero preemptions at a 198K prompt, 99.6 GiB model footprint; reproduction artifacts public (github.com/lrozewicz/vLLM-Moet-GB10). Still HumanEval, not Terminal-Bench/SWE - the TB/SWE reproduction gate for trend #1 remains open. (3) Counters @2026-09-13T00:03Z: 1,333,574 downloads (+13.6% vs 9/11) + 2,276 likes. Stays TRIAL.
Tags
glmzaiopen-weightsmit-licensemultimodalmoelinear-attentionlong-context