GLM-5.1 MoE Beats GPT-5.4 in Open-Source Engineering Milestone
Zhipu AI releases GLM-5.1 under MIT license, a 744B parameter MoE model that outperforms GPT-5.4 on the SWE-Bench Pro software engineering benchmark.
Zhipu AI, now operating as Z.ai following a January 2026 IPO, released GLM-5.1 under the permissive MIT License. The 744-billion parameter Mixture-of-Experts (MoE) model is optimized specifically for long-horizon autonomous engineering tasks. This release changes the established timeline for open-weight models, matching and exceeding proprietary frontier models on key software engineering metrics.
Architecture and Infrastructure
GLM-5.1 builds upon the GLM-5 base model with a specialized MoE architecture. The network utilizes Multi-head Latent Attention (MLA) and Dynamic Sparse Attention (DSA) to manage context retrieval over long inference sessions. The model supports a 200,000-token context window, paired with a strict 128,000-token output limit.
| Specification | Value |
|---|---|
| Total Parameters | 744 billion |
| Active Parameters (Per Forward Pass) | 40 billion |
| Total Experts | 256 |
| Active Experts (Per Token) | 8 |
The pretraining infrastructure marks a complete departure from Nvidia hardware. Z.ai trained the model entirely on 100,000 Huawei Ascend 910B chips, proving the viability of large-scale domestic hardware clusters for frontier model training.
Engineering Benchmark Results
The model’s primary optimization target is “productive horizons,” referring to the sustained time-on-task capabilities required for autonomous software development. Z.ai tuned GLM-5.1 to maintain a continuous “plan-execute-test-fix” loop. The model can operate autonomously for up to 8 hours and execute approximately 1,700 steps without human intervention.
If you evaluate and test AI agents for production workflows, the performance data establishes a new baseline for open weights. GLM-5.1 currently leads the SWE-Bench Pro leaderboard for resolving real-world GitHub issues.
| Model | SWE-Bench Pro Score |
|---|---|
| GLM-5.1 | 58.4 |
| GPT-5.4 | 57.7 |
| Claude Opus 4.6 | 57.3 |
Performance on Terminal-Bench 2.0 showed significant improvement over the previous generation. GLM-5.1 scored 69.0, a marked jump from GLM-5’s 56.2, though it remains behind GPT-5.4’s score of 75.1. The model also achieved a 68.7 on the CyberGym benchmark, tested across 1,507 real-world security tasks.
These high scores are specialized. GLM-5.1 still trails models from Google and OpenAI in general-purpose reasoning and standard knowledge benchmarks like GPQA Diamond.
Deployment and Pricing
The unrestrictive MIT License allows teams to run the LLM locally with the open weights hosted on Hugging Face. Self-hosting eliminates recurring inference costs for continuous agent workflows.
Cloud-based API usage reflects a new pricing strategy. Z.ai increased its API pricing by 8 to 17 percent to align with Western competitors. Premium tier token pricing now approaches Claude Sonnet 4.6 levels at $25 per million input tokens. Because agentic loops consume high token volumes during eight-hour planning and testing phases, utilizing the managed API requires strict controls to reduce API costs.
If you deploy autonomous coding agents, you now have a localized alternative to GPT-5.4. Calculate the total token consumption of your iterative workflows to determine if the hardware investment required to host GLM-5.1 yields a better return than standard API usage.
Get Insanely Good at AI
The book for developers who want to understand how AI actually works. LLMs, prompt engineering, RAG, AI agents, and production systems.
Keep Reading
How to launch Hugging Face models in SageMaker Studio
You will learn how to use the new Hugging Face integration to automatically provision and deploy open-source models directly into Amazon SageMaker Studio.
MIT-Licensed GLM-5.2 MoE Reaches 74.4% on FrontierSWE
Zhipu AI has released GLM-5.2, a 744-billion parameter MoE model engineered for long-horizon agentic tasks with a stable one-million-token context window.
Cohere Ships 30B MoE North-Mini-Code for Local Coding Agents
Cohere Labs has released North-Mini-Code-1.0, an Apache 2.0 licensed 30 billion parameter mixture-of-experts model optimized for local coding workflows.
Native W4A4 Inference Arrives in Diffusers via Nunchaku
Hugging Face integrated the Nunchaku engine into diffusers, enabling native 4-bit W4A4 execution and reducing FLUX.1-dev VRAM requirements to 6.7 GB.
Isaac Sim 2026.1 Brings 100x Real-Time Training to LeRobot
NVIDIA and Hugging Face have integrated Isaac Sim 2026.1 natively with LeRobot, delivering a 100x simulation speedup and 500 open-source environments.