Skip to content
trending

Benchmarks

GLM-5.3 Test: Non-English Writing, Pricing & Providers

GLM-5.3 scored 63.6/100 in our non-English writing test - fast and cheap at $0.03 for 13 tasks, but with notable grammar errors. We tested it twice to check if fp4 quantization was the issue.

By 5 min read
GLM-5.3 Test: Non-English Writing, Pricing & Providers

👁 121 reads

GLM-5.3 is the fastest and, alongside MiMo-V2.6-Pro, the cheapest of the strong Chinese models we’ve tested, but it also makes the most grammar errors. In 13 writing tasks run in Polish (a heavily inflected language), it scored 63.6 out of 100, generating 9 texts in 27 seconds for $0.018. We also checked whether the weak result was due to cheap providers using fp4 quantization: a rerun using only Z.ai gave 61.8 points. Below are the results, response excerpts, and pricing in USD.

Summary

GLM-5.3 has 45 points in the Artificial Analysis index, but in our non-English writing test it ranked second-to-last: 63.6 points, compared to GPT-6 Luna’s 81.5 points in the same round. Judges gave it 6.78 out of 10 for correctness (6.70 at Z.ai), the lowest of the tested top-tier models; in both runs we saw “w ramach przeprosiny” (a grammatical error in Polish). Strong points are speed (27s for 9 texts) and price ($0.03 for 13 tasks). We don’t recommend it for non-English texts without editing, but we do for drafts and programming, where it performs well in the Artificial Analysis index. That’s our opinion.

63.6points in Polish writing (Z.ai: 61.8)
27 sfor 9 writing tasks
$0.03cost for 13 tasks
$1.40 / $4.40per million tokens at Z.ai

What is GLM-5.3

GLM-5.3 is a model from Z.ai (formerly Zhipu) released in August 2026. It has 753 billion parameters, of which 40 billion are active, with open weights on Hugging Face under its own GLM-5.3 license. The license is similar to MIT, but large AI service providers (over $10 billion in revenue) must undergo a security review with Z.ai. According to Z.ai documentation, the context is 1 million tokens, with responses up to 128,000 tokens.

Reasoning cannot be disabled. The reasoning_effort parameter accepts values low, high, and max, with max as the default. In the max variant, Artificial Analysis gives it 45 points (September 27, 2026), 84 tokens per second, and $2.01 per index task. I wrote about what GLM-5.3 really costs at different providers in the article GLM 5.3: we calculated what this cheap model really costs. Here we focus on Polish language performance.

Our Results: Two Test Runs

The test uses the same 13 prompts as in our writing AI ranking: effort=low, OpenRouter, blind evaluation by three judges from different companies. We tested GLM-5.3 twice, both times in Polish:

  • OpenRouter routing (September 26) - queries went to five different providers, including Mistral (nvfp4), Decart, and Crusoe (fp4),
  • Z.ai only (September 27) - with pinned provider, fp8 version at the producer, without switching to another provider.
Task GLM-5.3 (routing) GLM-5.3 (Z.ai) GPT-6 Luna
Article about electricity bills 6.78 4.33 6.67
Product description from spec sheet 7.22 5.67 4.83
Email to customer 6.44 6.22 9.00
LinkedIn post 7.67 6.00 8.83
Short story 4.89 3.67 8.33
10 SEO titles 6.89 5.67 7.67
Summary in 5 bullet points 6.56 7.89 8.67
Inflation explained for 12-year-old 7.78 7.56 9.33
Translation with idioms 3.00 8.78 8.83
Total score (0-100) 63.6 61.8 81.5
Rules from prompts 23/26 24/26 24/26
Easy / hard proofreading 21/22, 26/30 21/22, 26/30 22/22, 29/30

Average judge scores on a 1-10 scale. The first run was evaluated by the same judges in the same pool as the second, alongside anchors Claude Opus 5.5, GPT-6 Luna, and Qwen3.8 Max.

The difference between runs (1.8 points) is smaller than the variation in individual tasks. The translation in the routing version got 3.0, while at Z.ai it got 8.78; with the short story it was reversed (4.89 vs 3.67). From one sample per task, we can’t say that Z.ai is better or worse. We can say that fp4 quantization at cheaper providers doesn’t explain the weak result - at the producer it was similar.

Response Excerpts

The same error in both customer emails, from different providers:

“As an apology, we’ve prepared a discount code for you: SORRY10” (grammatically incorrect in the original Polish)

The Z.ai version additionally mixed “przepraszamy” (we apologize) with “Rozumiem” (I understand) and “I checked“ (I checked), and both switched between formal address forms.

Newsletter translation with OpenRouter routing (3.0 out of 10):

“Honestly, onboarding new clients isn’t rocket science - but we’ve been half-assing it for too long. Last quarter we lost three major accounts” (mangled Polish with English “rocket science” and nonsensical idiom, translated from the model’s Polish output)

The same translation at Z.ai (8.78 out of 10):

“Honestly, onboarding new clients is no rocket science, but we’ve been doing it sloppily for quite some time.” (correct Polish, translated)

In the Z.ai short story (3.67), judges identified multiple spelling and grammar errors. In the routing summary, we saw an error that also appeared with Qwen3.8 Max. In the inflation text for children, the first version suggested that more expensive candy bars weren’t “more expensive to produce,” which all three judges considered a factual error.

Speed and Reasoning

With effort=low, GLM-5.3 barely reasons: 211 reasoning tokens across 13 tasks (Qwen3.8 Max - 33,000). That’s why it’s the fastest in the entire pool: 27 seconds for 9 writing tasks in the first run and 83 seconds at Z.ai, compared to GPT-6 Luna’s 39 seconds. In the GLM-5.3 Prime variant with higher reasoning, it was the opposite: in our Chinese models test, it reasoned until the limit and didn’t return text.

Per 1000 words, GLM inserted 21-28 long pauses, compared to 5 for Claude Opus 5.5 and 8 for GPT-6 Luna. If you’re pasting its texts directly onto a page, replace them with regular dashes or commas.

Pricing and Test Costs

Item USD
Input at Z.ai, per million tokens (excl. VAT) $1.40
Output at Z.ai, per million tokens (excl. VAT) $4.40
Cache read at Z.ai $0.26
Cheapest input / output on OpenRouter (other providers) $0.30 / $1.14
My test, 13 tasks, OpenRouter routing $0.0304
My test, 13 tasks, Z.ai only $0.0322

On OpenRouter, GLM-5.3 is available from 32 providers, with different quantization (fp4, nvfp4, fp8) and different response limits. A comparison with Qwen, MiMo, and Muse Spark is in our article about lesser-known top-tier AI models.

How to Use GLM-5.3

  • Z.ai API - billing in USD, rates as in the table above.
  • OpenRouter - z-ai/glm-5.3. If you want consistent quality, pin a provider (as we did in the second run).
  • chat.z.ai - browser chat, but according to the site it runs on GLM-5.3-Flash, not the full model.
  • Locally - weights are open, but 753 billion parameters require server hardware, not a home computer. What you can run at home is described in our local AI guide.

Frequently Asked Questions

Does GLM-5.3 write Polish well?

Poorly for a top-tier model: 63.6 out of 100 in our test, with grammatical errors. GPT-6 Luna scored 81.5 points. We tested it in Polish, a useful proxy for heavily inflected non-English languages.

How much does GLM-5.3 cost?

At Z.ai, $1.40 per million input tokens and $4.40 per million output tokens, excluding VAT. On OpenRouter, other providers charge from $0.30 for input.

Do cheaper GLM-5.3 providers give worse results?

Not in our test: routing through cheaper providers gave 63.6 points, while Z.ai alone gave 61.8 points. The difference falls within the variation of individual tasks.

Is GLM-5.3 open source?

Weights are open on Hugging Face, but under the GLM-5.3 license, not MIT. It only restricts the largest AI service providers.

Google · Your sourcesQuantslant higher in your Google - one clickAdd to preferred sources →

Sources and Verification Date

Pricing

Kinetyra

// read next

More on this from QUANTSLANT

Piotr Olszewski

Editor and publisher · Quantslant

I edit and publish Quantslant. AI tools help with research, drafts and translation; choosing topics, running the tests, checking facts and the decision to publish are mine, and so is the responsibility for what appears here.

read nextWho Should Use Suno v6 Based on Available Pricing Infoai toolsWho Should Use Suno v6 Based on Available Pricing InfoSuno v6-mini suits free-tier users, but the lack of token pricing or benchmarks makes it hard to judge who should pay for the full versions.

Most read

  1. 1Best AI Video Generator Apps for Your Phone (2026)
  2. 2Claude Opus 5.5 Motion Graphics: 60s Showreel from One Prompt
  3. 3Wan 2.2 on RTX 4090: timings, VRAM and four test clips
// site map

This page in other languages9

Quantslant in numbers 1,427posts in archive26news from the last 7 days18video models in the observatory
🎬 AI Video Benchmarks: Higgsfield DoP vs OpenAI Sora • Higgsfield vs Runway Gen-3 • AI Video Credit Calculator
× ‹ enlarge ›