Claude Code v2.1.20

Kimi K2 2026-01-26
Score
9.87
FAILED
Pass Rate: 34.6%
go: 83.3% (6 tasks)
go
rust: 50.0% (6 tasks)
rus
zig: 33.3% (3 tasks)
zig
dart: 0.0% (3 tasks)
dar
kotlin: 0.0% (3 tasks)
kot
typescript: 0.0% (5 tasks)
typ

Evaluation Report

Summary

Metric Value
Agent ccs
Model kimi
Timestamp 2026-01-26T005651
Pass Rate 34.6% (9/26)
Weighted Pass Rate 31.0%
Weighted Score 9.87 / 31.79
Duration 3847.7s

Quality Breakdown

  • Clean Passes: 7
  • Partial Passes (timed out but passed): 2
  • Integrity Violations (modified test files): 0
  • Failures: 15

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 5 1 6 83.3%
kotlin 0 3 3 0.0%
rust 3 3 6 50.0%
typescript 0 5 5 0.0%
zig 1 2 3 33.3%

Results by Tier

Tier Passed Failed Total Pass Rate
core 4 8 12 33.3%
extended 5 9 14 35.7%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 47.5s
dart/isolate-pool ✘ FAIL 0.00 0.00 224.8s
dart/reactive-cache ✘ FAIL 1.50 0.00 157.4s
go/bank-account ✔ PASS 1.04 1.04 50.4s
go/dining-philosophers ✔ PASS 1.04 1.04 86.6s
go/errgroup-limit ✘ FAIL 1.14 0.00 90.9s
go/parallel-letter-frequency ✔ PASS 1.04 1.04 64.2s
go/react ✔ PASS 1.14 1.14 56.1s
go/singleflight ✔ PASS 1.28 1.28 105.2s
kotlin/channel-multiplexer ✘ FAIL 1.50 0.00 246.6s
kotlin/flow-processor ✘ FAIL 1.50 0.00 246.1s
kotlin/lru-cache ✘ FAIL 1.09 0.00 187.8s
rust/circular-buffer ✘ FAIL 1.12 0.00 120.4s
rust/doubly-linked-list ✔ PASS 1.24 1.24 275.0s
rust/generational-arena ✔ PASS 1.24 1.24 139.1s
rust/macros ✘ FAIL 1.50 0.00 118.7s
rust/parallel-letter-frequency ⚠ PARTIAL 1.12 0.84 120.9s
rust/regex-lite ✘ FAIL 1.40 0.00 120.7s
typescript/csv-lite ✘ FAIL 1.36 0.00 120.8s
typescript/forth ✘ FAIL 1.26 0.00 120.9s
typescript/glob ✘ FAIL 1.14 0.00 120.9s
typescript/promise-pool ✘ FAIL 1.20 0.00 52.1s
typescript/react ✘ FAIL 1.14 0.00 300.8s
zig/arena-allocator ✘ FAIL 1.50 0.00 244.2s
zig/comptime-json ✘ FAIL 1.50 0.00 244.2s
zig/small-vector ⚠ PARTIAL 1.34 1.01 185.5s

Errors

dart/isolate-pool

{@html `executing validation: exec timed out after 2m0s`}

Verification

  • Harness Version: v1.5.3-dirty
  • Weight Version: 2.0
  • Tasks Hash: blake3:168696ded119da3ea973f15bde9c00151c127b3f54168196a84212827fa1b1f0
  • Results Hash: blake3:5196643277d7b089a688035cf9d795b8e37fd8f80646d96c4ea09427c0296562

Generated by SanityHarness on 2026-01-26T005651

Run Statistics

Tasks Passed 9 / 26
Duration 64m
Cost (Est) -
By Language
dart 0%
go 83%
kotlin 0%
rust 50%
typescript 0%
zig 33%