Droid v0.53.0

GLM-4.7 2026-01-18
Score
12.83
FAILED
Pass Rate: 42.3%
go: 83.3% (6 tasks)
go
typescript: 40.0% (5 tasks)
typ
kotlin: 33.3% (3 tasks)
kot
rust: 33.3% (6 tasks)
rus
zig: 33.3% (3 tasks)
zig
dart: 0.0% (3 tasks)
dar

Evaluation Report

Summary

Metric Value
Agent droid
Model glm-4.7
Timestamp 2026-01-18T180724
Pass Rate 42.3% (11/26)
Weighted Pass Rate 38.5%
Weighted Score 12.83 / 33.29
Duration 1354.4s

Quality Breakdown

  • Clean Passes: 11
  • Partial Passes (timed out but passed): 0
  • Integrity Violations (modified test files): 0
  • Failures: 15

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 5 1 6 83.3%
kotlin 1 2 3 33.3%
rust 2 4 6 33.3%
typescript 2 3 5 40.0%
zig 1 2 3 33.3%

Results by Tier

Tier Passed Failed Total Pass Rate
core 6 6 12 50.0%
extended 5 9 14 35.7%

Task Results

Task Status Weight Score Duration
dart/future-pool ❌ FAIL 1.46 0.00 97.3s
dart/isolate-pool ❌ FAIL 1.50 0.00 77.1s
dart/reactive-cache ❌ FAIL 1.50 0.00 44.2s
go/bank-account ✅ PASS 1.04 1.04 24.7s
go/dining-philosophers ✅ PASS 1.04 1.04 36.6s
go/errgroup-limit ❌ FAIL 1.14 0.00 18.2s
go/parallel-letter-frequency ✅ PASS 1.04 1.04 20.7s
go/react ✅ PASS 1.14 1.14 220.6s
go/singleflight ✅ PASS 1.28 1.28 16.1s
kotlin/channel-multiplexer ❌ FAIL 1.50 0.00 42.9s
kotlin/flow-processor ❌ FAIL 1.50 0.00 32.1s
kotlin/lru-cache ✅ PASS 1.09 1.09 37.9s
rust/circular-buffer ❌ FAIL 1.12 0.00 25.5s
rust/doubly-linked-list ❌ FAIL 1.24 0.00 45.5s
rust/generational-arena ✅ PASS 1.24 1.24 24.8s
rust/macros ❌ FAIL 1.50 0.00 24.7s
rust/parallel-letter-frequency ✅ PASS 1.12 1.12 40.9s
rust/regex-lite ❌ FAIL 1.40 0.00 120.7s
typescript/csv-lite ✅ PASS 1.36 1.36 61.8s
typescript/forth ❌ FAIL 1.26 0.00 22.0s
typescript/glob ✅ PASS 1.14 1.14 50.9s
typescript/promise-pool ❌ FAIL 1.20 0.00 29.3s
typescript/react ❌ FAIL 1.14 0.00 26.4s
zig/arena-allocator ❌ FAIL 1.50 0.00 53.0s
zig/comptime-json ❌ FAIL 1.50 0.00 116.0s
zig/small-vector ✅ PASS 1.34 1.34 44.4s

Verification

  • Harness Version: v1.3.2
  • Weight Version: 2.0
  • Tasks Hash: blake3:168696ded119da3ea973f15bde9c00151c127b3f54168196a84212827fa1b1f0
  • Results Hash: blake3:1ec07b0f824edd53143449bebb408fc77f5331ead0fad3e4503abb49e9b10ca2

Generated by SanityHarness on 2026-01-18T180724

Run Statistics

Tasks Passed 11 / 26
Duration 23m
Cost (Est) -
By Language
dart 0%
go 83%
kotlin 33%
rust 33%
typescript 40%
zig 33%