GLM 5.3 (FW)
Last updated: September 15, 2026
GLM 5.3 (FW) completed 35 of 55 private-markets finance tasks (63.6%) at $0.30 per task and 342 seconds each, ranking #14 of 17 models tested — strongest on metric lookups, weakest on document ingestion.
Tested on 55 tasks across seven kinds of financial work — reading documents, looking up figures, building statements, finding and fixing errors, assembling dashboards, drawing charts, and multi-step requests. It passed 12 of 12 on metric lookups and 1 of 6 on document ingestion. Run-to-run noise is about ±1.8 tasks, so gaps of two tasks or fewer are ties.
Overall Rank
#14
of 17 engines tested
Pass Rate
63.6%
35 of 55 tasks passed
Judge Score
37.1
out of 55.0 available
Suite Split
34/49
analysis suite · 1/6 ingest harness
Cost per Task
$0.30
5th cheapest of 17
Cost, Full Pass
$17
all 55 tasks at list prices
Cost per Passed Task
$0.47
5th best value of 17
Latency
342s
per task · 5h 14m for a full pass
Category Breakdown
GLM 5.3 (FW) against the average of every engine tested, category by category. The gap between the two bars is the only thing worth reading here — a category where the whole field struggles is a property of the tasks, not of the engine.
- Field average
- This model
| Category | Passed | Pass Rate | Field Avg | Rank | Score | Cost/Task | Latency | Tool Calls |
|---|---|---|---|---|---|---|---|---|
| Document Ingestion | 1/6 | 16.7% | 42.2% | #13 of 17 | 1.50 | $0.54 | 994s | 34.7 |
| Metric Lookups | 12/12 | 100.0% | 88.7% | #1 of 17 | 12.00 | $0.07 | 56s | 10.8 |
| Financial Statements | 4/7 | 57.1% | 43.7% | #3 of 17 | 4.29 | $0.19 | 245s | 33.1 |
| Error Detection & Repair | 4/7 | 57.1% | 60.5% | #9 of 17 | 4.00 | $0.47 | 526s | 49.6 |
| Dashboards & Widgets | 6/8 | 75.0% | 84.6% | #12 of 17 | 6.00 | $0.40 | 423s | 42.9 |
| Charts | 3/4 | 75.0% | 66.2% | #1 of 17 | 2.99 | $0.33 | 324s | 34.8 |
| Multi-Step Requests | 4/6 | 66.7% | 54.9% | #1 of 17 | 4.45 | $0.43 | 374s | 29.5 |
Every column is measured within that category. The ingest harness is a separate suite of longer, heavier workflows — several times the tool calls of an analysis task — so its cost and latency are not comparable with the six rows below it.
Where it fell short
The 16 tasks GLM 5.3 (FW) did not pass, of 50 graded individually. A benchmark that publishes only totals has to be taken on trust; these are the specific misses behind this model's score.
| Task | Kind of work | What it tests | Result |
|---|---|---|---|
| DD-01 | Document Ingestion | PDF → new rack, 5 components to the cent | Failed |
| DD-02 | Document Ingestion | Add one drawdown, leave seeded rows untouched | Failed · 0.30 |
| DD-03 | Document Ingestion | Reuse an existing dimension, create no duplicates | Failed · 0.20 |
| TBU-01 | Document Ingestion | 556-account trial balance, signed, zero rows skipped | Failed |
| RCN-03 | Document Ingestion | 87 stores × 9 metrics, dimensioned, totals excluded | Failed |
| CTA-03 | Financial Statements | — | Failed |
| CTA-04 | Financial Statements | — | Failed · 0.34 |
| SBM-01 | Financial Statements | — | Failed |
| BUG-02 | Error Detection & Repair | — | Failed |
| DISC-02 | Error Detection & Repair | — | Failed |
| DISC-03 | Error Detection & Repair | — | Failed |
| BOARD-01 | Dashboards & Widgets | — | Failed |
| BOARD-03 | Dashboards & Widgets | — | Failed |
| CHART-02 | Charts | — | Failed |
| CMP-03 | Multi-Step Requests | — | Failed · 0.45 |
| MT-03 | Multi-Step Requests | — | Failed |
A fraction means the task was run more than once and the runs disagreed. A number after a failure is the partial credit awarded. Five of the 55 tasks in the headline total are not broken out individually in the published results.
Against the Field
Every engine on the same axis, with GLM 5.3 (FW) picked out. Grey bars are the rest of the field.
Overall Pass Rate
#14 of 17 · higher is better
Cost — One Full Pass (55 tasks)
#5 of 17 · lower is better
Cost per Passed Task
#5 of 17 · lower is better
Latency — Average per Task
#17 of 17 · lower is better
Tool Calls — Average per Task
#15 of 17 · lower is leaner
Cost vs Pass Rate
Up and to the left is better
Henon Tasks vs Tools benchmark — Ingest v5.1 + analysis suite v4, 17 executor models, 935 graded runs. Last updated September 15, 2026. Full results at henon.ai/benchmarks