Codex CLI 0.104.0

GPT 5.2 Codex 2026-02-24
Score
15.27
FAILED
Pass Rate: 50.0%
go: 100.0% (6 tasks)
go
kotlin: 66.7% (3 tasks)
kot
rust: 50.0% (6 tasks)
rus
typescript: 40.0% (5 tasks)
typ
dart: 0.0% (3 tasks)
dar
zig: 0.0% (3 tasks)
zig

Evaluation Report

Summary

Metric Value
Agent codex
Model gpt-5.2-codex
Reasoning Effort low
Legacy Mode Yes
Timestamp 2026-02-24T143245
Pass Rate 50.0% (13/26)
Weighted Pass Rate 45.9%
Weighted Score 15.27 / 33.29
Duration 1100.4s

Quality Breakdown

  • Clean Passes: 13
  • Partial Passes (timed out but passed): 0
  • Integrity Violations (modified test files): 0
  • Failures: 13

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 6 0 6 100.0%
kotlin 2 1 3 66.7%
rust 3 3 6 50.0%
typescript 2 3 5 40.0%
zig 0 3 3 0.0%

Results by Tier

Tier Passed Failed Total Pass Rate
core 7 5 12 58.3%
extended 6 8 14 42.9%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 36.4s
dart/isolate-pool ✘ FAIL 1.50 0.00 76.5s
dart/reactive-cache ✘ FAIL 1.50 0.00 77.6s
go/bank-account ✔ PASS 1.04 1.04 18.0s
go/dining-philosophers ✔ PASS 1.04 1.04 20.9s
go/errgroup-limit ✔ PASS 1.14 1.14 48.9s
go/parallel-letter-frequency ✔ PASS 1.04 1.04 30.6s
go/react ✔ PASS 1.14 1.14 69.6s
go/singleflight ✔ PASS 1.28 1.28 27.7s
kotlin/channel-multiplexer ✘ FAIL 1.50 0.00 68.1s
kotlin/flow-processor ✔ PASS 1.50 1.50 87.3s
kotlin/lru-cache ✔ PASS 1.09 1.09 40.3s
rust/circular-buffer ✘ FAIL 1.12 0.00 23.7s
rust/doubly-linked-list ✔ PASS 1.24 1.24 23.4s
rust/generational-arena ✔ PASS 1.24 1.24 24.1s
rust/macros ✘ FAIL 1.50 0.00 24.6s
rust/parallel-letter-frequency ✔ PASS 1.12 1.12 23.2s
rust/regex-lite ✘ FAIL 1.40 0.00 19.9s
typescript/csv-lite ✘ FAIL 1.36 0.00 48.6s
typescript/forth ✔ PASS 1.26 1.26 42.3s
typescript/glob ✔ PASS 1.14 1.14 24.5s
typescript/promise-pool ✘ FAIL 1.20 0.00 22.5s
typescript/react ✘ FAIL 1.14 0.00 42.0s
zig/arena-allocator ✘ FAIL 1.50 0.00 57.5s
zig/comptime-json ✘ FAIL 1.50 0.00 97.6s
zig/small-vector ✘ FAIL 1.34 0.00 24.5s

Verification

  • Harness Version: v1.6.1
  • Weight Version: 2.0
  • Tasks Hash: blake3:168696ded119da3ea973f15bde9c00151c127b3f54168196a84212827fa1b1f0
  • Results Hash: blake3:537d2980f9df33dade7190e33ba09439d75d3bf8e896d0aabca3aad8b49cd896

Generated by SanityHarness on 2026-02-24T143245

Run Statistics

Tasks Passed 13 / 26
Duration 18m
Cost (Est) -
By Language
dart 0%
go 100%
kotlin 67%
rust 50%
typescript 40%
zig 0%