Claude Code v2.1.20

Kimi K2.5 2026-01-27
Score
14.95
FAILED
Pass Rate: 50.0%
go: 66.7% (6 tasks)
go
rust: 66.7% (6 tasks)
rus
typescript: 60.0% (5 tasks)
typ
kotlin: 33.3% (3 tasks)
kot
zig: 33.3% (3 tasks)
zig
dart: 0.0% (3 tasks)
dar

Evaluation Report

Summary

Metric Value
Agent ccs
Model kimi
Timestamp 2026-01-27T230022
Pass Rate 50.0% (13/26)
Weighted Pass Rate 46.9%
Weighted Score 14.95 / 31.89
Duration 2181.2s

Quality Breakdown

  • Clean Passes: 12
  • Partial Passes (timed out but passed): 1
  • Integrity Violations (modified test files): 0
  • Failures: 12

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 4 2 6 66.7%
kotlin 1 2 3 33.3%
rust 4 2 6 66.7%
typescript 3 2 5 60.0%
zig 1 2 3 33.3%

Results by Tier

Tier Passed Failed Total Pass Rate
core 6 6 12 50.0%
extended 7 7 14 50.0%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 87.5s
dart/isolate-pool ✘ FAIL 1.50 0.00 80.1s
dart/reactive-cache ✘ FAIL 1.50 0.00 199.4s
go/bank-account ✔ PASS 1.04 1.04 50.9s
go/dining-philosophers ✔ PASS 1.04 1.04 73.7s
go/errgroup-limit ✘ FAIL 1.14 0.00 150.5s
go/parallel-letter-frequency ✘ FAIL 1.04 0.00 30.6s
go/react ✔ PASS 1.14 1.14 69.2s
go/singleflight ✔ PASS 1.28 1.28 46.5s
kotlin/channel-multiplexer ✘ FAIL 1.50 0.00 193.4s
kotlin/flow-processor ✘ FAIL 1.50 0.00 47.7s
kotlin/lru-cache ✔ PASS 1.09 1.09 42.9s
rust/circular-buffer ✔ PASS 1.12 1.12 35.5s
rust/doubly-linked-list ✔ PASS 1.24 1.24 72.7s
rust/generational-arena ✔ PASS 1.24 1.24 92.9s
rust/macros ✘ FAIL 1.50 0.00 32.6s
rust/parallel-letter-frequency ✔ PASS 1.12 1.12 46.3s
rust/regex-lite ✘ FAIL 0.00 0.00 153.6s
typescript/csv-lite ⚠ PARTIAL 1.36 1.02 120.9s
typescript/forth ✘ FAIL 1.26 0.00 42.8s
typescript/glob ✔ PASS 1.14 1.14 56.1s
typescript/promise-pool ✘ FAIL 1.20 0.00 29.3s
typescript/react ✔ PASS 1.14 1.14 45.9s
zig/arena-allocator ✘ FAIL 1.50 0.00 75.3s
zig/comptime-json ✘ FAIL 1.50 0.00 244.5s
zig/small-vector ✔ PASS 1.34 1.34 60.4s

Errors

rust/regex-lite

{@html `executing validation: exec timed out after 2m0s`}

Verification

  • Harness Version: v1.5.8-dirty
  • Weight Version: 2.0
  • Tasks Hash: blake3:168696ded119da3ea973f15bde9c00151c127b3f54168196a84212827fa1b1f0
  • Results Hash: blake3:64ae2db9cde4e157dcbbde3a815f8d4353d83876d22e5ebe8aeaeef618a5c872

Generated by SanityHarness on 2026-01-27T230022

Run Statistics

Tasks Passed 13 / 26
Duration 36m
Cost (Est) -
By Language
dart 0%
go 67%
kotlin 33%
rust 67%
typescript 60%
zig 33%