OpenCode v1.1.34

Kimi K2 2026-01-24
Score
11.20
FAILED
Pass Rate: 38.5%
go: 100.0% (6 tasks)
go
kotlin: 33.3% (3 tasks)
kot
rust: 33.3% (6 tasks)
rus
typescript: 20.0% (5 tasks)
typ
dart: 0.0% (3 tasks)
dar
zig: 0.0% (3 tasks)
zig

Evaluation Report

Summary

Metric Value
Agent opencode
Model kimi-for-coding/kimi-k2-thinking
MCP Disabled Yes
Timestamp 2026-01-24T044011
Pass Rate 38.5% (10/26)
Weighted Pass Rate 35.1%
Weighted Score 11.20 / 31.89
Duration 3697.7s

Quality Breakdown

  • Clean Passes: 9
  • Partial Passes (timed out but passed): 1
  • Integrity Violations (modified test files): 0
  • Failures: 15

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 6 0 6 100.0%
kotlin 1 2 3 33.3%
rust 2 4 6 33.3%
typescript 1 4 5 20.0%
zig 0 3 3 0.0%

Results by Tier

Tier Passed Failed Total Pass Rate
core 5 7 12 41.7%
extended 5 9 14 35.7%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 98.7s
dart/isolate-pool ✘ FAIL 1.50 0.00 141.4s
dart/reactive-cache ✘ FAIL 1.50 0.00 130.7s
go/bank-account ✔ PASS 1.04 1.04 52.8s
go/dining-philosophers ✔ PASS 1.04 1.04 93.3s
go/errgroup-limit ✔ PASS 1.14 1.14 66.2s
go/parallel-letter-frequency ✔ PASS 1.04 1.04 44.0s
go/react ✔ PASS 1.14 1.14 197.1s
go/singleflight ✔ PASS 1.28 1.28 33.4s
kotlin/channel-multiplexer ✘ FAIL 1.50 0.00 246.5s
kotlin/flow-processor ✘ FAIL 1.50 0.00 110.1s
kotlin/lru-cache ✔ PASS 1.09 1.09 83.7s
rust/circular-buffer ✘ FAIL 1.12 0.00 120.3s
rust/doubly-linked-list ✔ PASS 1.24 1.24 224.0s
rust/generational-arena ✔ PASS 1.24 1.24 168.9s
rust/macros ✘ FAIL 1.50 0.00 120.6s
rust/parallel-letter-frequency ✘ FAIL 1.12 0.00 80.7s
rust/regex-lite ✘ FAIL 0.00 0.00 240.2s
typescript/csv-lite ✘ FAIL 1.36 0.00 87.7s
typescript/forth ⚠ PARTIAL 1.26 0.95 120.8s
typescript/glob ✘ FAIL 1.14 0.00 250.8s
typescript/promise-pool ✘ FAIL 1.20 0.00 70.7s
typescript/react ✘ FAIL 1.14 0.00 300.8s
zig/arena-allocator ✘ FAIL 1.50 0.00 245.4s
zig/comptime-json ✘ FAIL 1.50 0.00 244.3s
zig/small-vector ✘ FAIL 1.34 0.00 124.4s

Errors

rust/regex-lite

{@html `executing validation: exec timed out after 2m0s`}

Verification

  • Harness Version: v1.5.1
  • Weight Version: 2.0
  • Tasks Hash: blake3:168696ded119da3ea973f15bde9c00151c127b3f54168196a84212827fa1b1f0
  • Results Hash: blake3:208f4da771b06f35fce2a5ff5ba9d8724845ec92e0d7c2da4b910eeaf4a97667

Generated by SanityHarness on 2026-01-24T044011

Run Statistics

Tasks Passed 10 / 26
Duration 62m
Cost (Est) -
By Language
dart 0%
go 100%
kotlin 33%
rust 33%
typescript 20%
zig 0%