Droid v0.55.1

GPT-5.2 Codex 2026-01-24
Score
15.15
FAILED
Pass Rate: 50.0%
go: 83.3% (6 tasks)
go
rust: 66.7% (6 tasks)
rus
typescript: 60.0% (5 tasks)
typ
kotlin: 33.3% (3 tasks)
kot
dart: 0.0% (3 tasks)
dar
zig: 0.0% (3 tasks)
zig

Evaluation Report

Summary

Metric Value
Agent droid
Model gpt-5.2-codex
Reasoning Effort xhigh
Timestamp 2026-01-24T045420
Pass Rate 50.0% (13/26)
Weighted Pass Rate 45.5%
Weighted Score 15.15 / 33.29
Duration 3033.5s

Quality Breakdown

  • Clean Passes: 13
  • Partial Passes (timed out but passed): 0
  • Integrity Violations (modified test files): 0
  • Failures: 13

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 5 1 6 83.3%
kotlin 1 2 3 33.3%
rust 4 2 6 66.7%
typescript 3 2 5 60.0%
zig 0 3 3 0.0%

Results by Tier

Tier Passed Failed Total Pass Rate
core 8 4 12 66.7%
extended 5 9 14 35.7%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 114.8s
dart/isolate-pool ✘ FAIL 1.50 0.00 196.7s
dart/reactive-cache ✘ FAIL 1.50 0.00 257.1s
go/bank-account ✔ PASS 1.04 1.04 57.4s
go/dining-philosophers ✔ PASS 1.04 1.04 68.6s
go/errgroup-limit ✘ FAIL 1.14 0.00 150.5s
go/parallel-letter-frequency ✔ PASS 1.04 1.04 65.9s
go/react ✔ PASS 1.14 1.14 140.1s
go/singleflight ✔ PASS 1.28 1.28 105.0s
kotlin/channel-multiplexer ✘ FAIL 1.50 0.00 117.3s
kotlin/flow-processor ✘ FAIL 1.50 0.00 248.3s
kotlin/lru-cache ✔ PASS 1.09 1.09 83.8s
rust/circular-buffer ✔ PASS 1.12 1.12 51.0s
rust/doubly-linked-list ✘ FAIL 1.24 0.00 1.1s
rust/generational-arena ✔ PASS 1.24 1.24 53.6s
rust/macros ✔ PASS 1.50 1.50 67.0s
rust/parallel-letter-frequency ✔ PASS 1.12 1.12 87.2s
rust/regex-lite ✘ FAIL 1.40 0.00 120.6s
typescript/csv-lite ✘ FAIL 1.36 0.00 120.8s
typescript/forth ✔ PASS 1.26 1.26 103.6s
typescript/glob ✔ PASS 1.14 1.14 82.8s
typescript/promise-pool ✘ FAIL 1.20 0.00 120.9s
typescript/react ✔ PASS 1.14 1.14 195.3s
zig/arena-allocator ✘ FAIL 1.50 0.00 245.4s
zig/comptime-json ✘ FAIL 1.50 0.00 105.7s
zig/small-vector ✘ FAIL 1.34 0.00 73.1s

Verification

  • Harness Version: v1.5.1
  • Weight Version: 2.0
  • Tasks Hash: blake3:168696ded119da3ea973f15bde9c00151c127b3f54168196a84212827fa1b1f0
  • Results Hash: blake3:6c42dacf5a86c3e53898e953679b6393eb0485018a0c65f8e65255179565c53d

Generated by SanityHarness on 2026-01-24T045420

Run Statistics

Tasks Passed 13 / 26
Duration 51m
Cost (Est) -
By Language
dart 0%
go 83%
kotlin 33%
rust 67%
typescript 60%
zig 0%