摘要
Z.ai 在 Hugging Face 以 MIT 许可放出 GLM-5.3-Flash：320B 总参 / 18B 激活的原生多模态 MoE，也是 GLM-5 系列首个从全新底座训练的模型（不再沿用 GLM-5.2 基座）。模型混合稀疏注意力与线性注意力以压低长上下文服务成本，引入 Manifold-Constrained Hyper-Connections（mHC），预训练语料为 30T token 多模态数据。官方称其以 GLM-5.2 十分之一的价格全面超过 GLM-5.2，在 coding 与 agentic 基准上接近 Claude Opus 4.8；Artificial Analysis 独立评测给出 Intelligence Index 57（8/26 上架）。vLLM、SGLang、Transformers、KTransformers、vLLM-Ascend 均已 day-0 支持。
为什么重要
对考虑自托管开源权重的团队，这是本轮中国前沿开源潮里最宽松的许可证（纯 MIT，无营收门槛、无安全审查条款），叠加一个明确为压低长上下文服务成本设计的架构——这两点正是自托管落地的最大阻碍。混合稀疏-线性注意力也是主流开源权重模型对「线性注意力能否实质改变长上下文单位成本」的第一次检验；采用前先确认 serving 栈的版本要求。
技术细节
| 架构 | 320B 总参 / 18B 激活 MoE；稀疏 + 线性混合注意力；Manifold-Constrained Hyper-Connections（mHC） |
|---|---|
| 基座 | 全新训练底座（非 GLM-5.2）；GLM-5 系列首个原生多模态模型 |
| 预训练 | 30T token 多模态语料 |
| 许可证 | MIT（主模型 GLM-5.3 使用自定义 glm-5.3 许可证） |
| 仓库 | zai-org/GLM-5.3-Flash + GLM-5.3-Flash-BF16，2026-08-25T06:45Z 创建；无访问门禁 |
| 推理支持 | day-0：vLLM、SGLang、Transformers、KTransformers、Unsloth、vLLM-Ascend（昇腾 NPU） |
| 独立评测 | Artificial Analysis Intelligence Index 57（2026-08-26 上架）；Baseten 已托管 |
| 定位 | GLM-5.2 十分之一的价格；coding/agentic 基准接近 Claude Opus 4.8（厂商自报） |
| 社区 | 3 天内 1,454 HF likes（2026-08-28 核查） |
后续更新
2026-08-29 Adoption check @2026-08-29T11:35Z: zai-org/GLM-5.3-Flash at 189,793 downloads (30d; repo listed 8/25, so effectively all-time) + 1,557 likes; GLM-5.3-Flash-BF16 (created 2026-08-25T06:45Z) at 4,006 downloads. vLLM recipe page live (recipes.vllm.ai/zai-org/GLM-5.3-Flash; multimodal MoE ~321B total / 18B active). Community: r/LocalLLaMA megathread; NVFP4 quantized-serving comparisons vs Qwen3.8-Flash-Next on NVIDIA developer forums; third-party head-to-heads (Akash). No independent long-context throughput benchmarks published yet — vLLM/SGLang real-world numbers remain the open verification item. Recommendation stays TRIAL.
2026-08-31 Adoption check @2026-08-31T00:00Z: 346,516 downloads (30d window = all-time; +83% vs the 189,793 @8/29 sample, ~6 days after listing) + 1,711 likes (+154). Independent long-context throughput numbers still absent — Baseten's engineering blog covers GLM-5.2 in depth with GLM-5.3-Flash only in the serving lineup; no dedicated vLLM/SGLang throughput benchmark found. Recommendation stays TRIAL.
2026-09-02 adoption check @2026-09-02T00:0xZ: 441,348 downloads (+27% vs 346,516 @8/31, ~8 days after listing) + 1,878 likes; unsloth GLM-5.3-Flash-GGUF derivative at 63,718 downloads (repo created 8/26). Deployment-friction threads on HF (vLLM crash 'pe_dim must be 64 for fp8_ds_mla' on RTX PRO 6000 Blackwell #19, missing Glm5NextTextLinearAttention module #26, single-MI300 serving #34) plus a community hands-on coding/agentic test (#32) show real deployment activity but also an immature serving path; independent long-context throughput numbers still absent. Stays TRIAL
2026-09-05 Adoption check @2026-09-05: 654,957 downloads (+48% vs 9/2) + 2,044 likes; unsloth GLM-5.3-Flash-GGUF at 85,158. Discussion #38 (9/2) is a genuine third-party deployment report: FP8 on 2x L40S (sm_89) + EPYC 9845 with setup notes, patches and throughput numbers — the first independent throughput data point for the Flash line (long-context-specific throughput still absent); #40 reports unsloth Q3 tokens/s roughly doubling with low VRAM + sufficient RAM. Stays TRIAL
2026-09-12 2026-09-12 third-pass backfill: security-relevant research on these weights — refusal-direction ablation (arXiv 2609.09793, ev-20260911-06) survives MoE + block-FP8: editing the attention, dense and routed-expert writers together removes ~0.7+ of refusal with only a few hundred contrastive prompts; open-weight deployments should place safety enforcement outside the weights. Adoption @2026-09-11: 1,173,520 downloads + 2,245 likes; discussions #39-#48 remain deployment threads (SGLang image, unsloth Q3 throughput), still no third-party TB/SWE reproduction.
2026-09-13 2026-09-13 run: (1) Engineering post (z.ai/blog/glm-5.3-flash, published 2026-09-12T02:17:01Z - deferred by the previous run's cutoff): the ox-alpha anonymous-testing phase (most popular model of the week on OpenCode/OpenRouter) was served entirely on a large-scale Chinese-AI-chip cluster with high-bandwidth interconnect; a dedicated SGLang-based inference engine (kernels iterated with a GLM-5.3 infrastructure agent diagnosing bottlenecks) combines intra-node tensor parallelism, ReplaySSM, W8A8 quantization, hybrid INT8/FP8/BF16 cache quantization and Layer Split, fronted by an Encode-Prefill-Decode (EPD) disaggregated architecture - 3x end-to-end serving improvement over the initial baseline on the same hardware, with hardware efficiency and per-token cost claimed comparable to mainstream NVIDIA GPUs (vendor figures). New architecture details: 45 layers and 18B activated vs GLM-4.5's 92/32B at similar total params; IndexPool pools the four indexer key vectors into one to cut indexer latency/memory at 1M context; attention compute 3.0x lower and KV cache 4.4x smaller than GLM-5.3 (vendor). (2) HF discussion #50 (2026-09-12T21:43:59Z) is the strongest weights-side independent reproduction yet: one ASUS Ascent GX10 (DGX Spark-class GB10, 128GB unified memory) runs the model via the vLLM-Moet fork with 2-bit routed experts (tensor-symmetric codes {-4,-1,1,4}, one scale per 32 weights, GPTQ-calibrated on real code) plus a 2GiB FP4 hot-expert pool - HumanEval 97.0% (159/164) vs 95.1% on the z.ai API under identical prompts and temperature 0, HumanEval+ 93.9% vs 89.6%; ~29 tok/s code decode (DFlash2 drafter, k=7), ~640 tok/s prefill, 200K context with zero preemptions at a 198K prompt, 99.6 GiB model footprint; reproduction artifacts public (github.com/lrozewicz/vLLM-Moet-GB10). Still HumanEval, not Terminal-Bench/SWE - the TB/SWE reproduction gate for trend #1 remains open. (3) Counters @2026-09-13T00:03Z: 1,333,574 downloads (+13.6% vs 9/11) + 2,276 likes. Stays TRIAL.
标签
glmzaiopen-weightsmit-licensemultimodalmoelinear-attentionlong-context