OpenCode v1.4.6

GLM-5.1 • 2026-04-16
Score
16.27
PASSED
Pass Rate: 53.8%
go: 100.0% (6 tasks)
go
rust: 83.3% (6 tasks)
rus
typescript: 40.0% (5 tasks)
typ
zig: 33.3% (3 tasks)
zig
dart: 0.0% (3 tasks)
dar
kotlin: 0.0% (3 tasks)
kot

Evaluation Report

Summary

Metric Value
Agent opencode
Model opencode-go/glm-5.1
Sandbox Yes
Timestamp 2026-04-16T014950
Pass Rate 53.8% (14/26)
Weighted Pass Rate 48.9%
Weighted Score 16.27 / 33.29
Duration 4082.3s

Quality Breakdown

  • Integrity Violations (modified test files): 1
  • Failures: 11
  • Quota-affected tasks: 0
  • Auth-affected tasks: 0
  • Infra-affected tasks: 0
Failure Class Tasks
integrity 1

Behavior Telemetry

  • Total self-test commands: 35
  • Tasks with self-testing: 18/26
  • Total toolchain install attempts: 2
  • Tasks with toolchain install attempts: 1/26
  • Total out-of-workspace read attempts: 29
  • Tasks with out-of-workspace read attempts: 2/26
  • Total toolchain search attempts: 13
  • Tasks with toolchain searching: 2/26
  • Total Agent Skills usage signals: 0
  • Tasks with Agent Skills usage: 0/26 (0.0%)
Task Self Tests Self Test Conf. Tool Installs Out-of-Workspace Reads Out-of-Workspace Conf. Toolchain Searches Skills Used Skill Signals
dart/isolate-pool 2 true 2 10 true 8 false 0
go/bank-account 1 true 0 0 true 0 false 0
go/dining-philosophers 1 true 0 0 true 0 false 0
go/errgroup-limit 1 true 0 0 true 0 false 0
go/parallel-letter-frequency 1 true 0 0 true 0 false 0
go/react 1 true 0 0 true 0 false 0
go/singleflight 1 true 0 0 true 0 false 0
kotlin/lru-cache 15 true 0 19 true 5 false 0
rust/circular-buffer 1 true 0 0 true 0 false 0
rust/doubly-linked-list 2 true 0 0 true 0 false 0
rust/generational-arena 2 true 0 0 true 0 false 0
rust/macros 1 true 0 0 true 0 false 0
rust/parallel-letter-frequency 1 true 0 0 true 0 false 0
rust/regex-lite 1 true 0 0 true 0 false 0
typescript/forth 1 true 0 0 true 0 false 0
typescript/glob 1 true 0 0 true 0 false 0
typescript/promise-pool 1 true 0 0 true 0 false 0
typescript/react 1 true 0 0 true 0 false 0

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 6 0 6 100.0%
kotlin 0 3 3 0.0%
rust 5 1 6 83.3%
typescript 2 3 5 40.0%
zig 1 2 3 33.3%

Results by Tier

Tier Passed Failed Total Pass Rate
core 8 4 12 66.7%
extended 6 8 14 42.9%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 49.7s
dart/isolate-pool ✘ FAIL 1.50 0.00 355.5s
dart/reactive-cache ✘ FAIL 1.50 0.00 294.9s
go/bank-account ✔ PASS 1.04 1.04 18.9s
go/dining-philosophers ✔ PASS 1.04 1.04 35.9s
go/errgroup-limit ✔ PASS 1.14 1.14 245.2s
go/parallel-letter-frequency ✔ PASS 1.04 1.04 29.2s
go/react ✔ PASS 1.14 1.14 103.1s
go/singleflight ✔ PASS 1.28 1.28 78.6s
kotlin/channel-multiplexer ✘ FAIL 1.50 0.00 472.9s
kotlin/flow-processor ✘ FAIL 1.50 0.00 557.8s
kotlin/lru-cache 🚫 VIOLATION 1.09 -0.25 298.2s
rust/circular-buffer ✔ PASS 1.12 1.12 49.8s
rust/doubly-linked-list ✔ PASS 1.24 1.24 60.4s
rust/generational-arena ✔ PASS 1.24 1.24 50.7s
rust/macros ✔ PASS 1.50 1.50 169.3s
rust/parallel-letter-frequency ✔ PASS 1.12 1.12 59.2s
rust/regex-lite ✘ FAIL 1.40 0.00 36.7s
typescript/csv-lite ✘ FAIL 1.36 0.00 104.9s
typescript/forth ✘ FAIL 1.26 0.00 54.4s
typescript/glob ✔ PASS 1.14 1.14 42.7s
typescript/promise-pool ✘ FAIL 1.20 0.00 12.4s
typescript/react ✔ PASS 1.14 1.14 204.3s
zig/arena-allocator ✘ FAIL 1.50 0.00 219.1s
zig/comptime-json ✘ FAIL 1.50 0.00 383.5s
zig/small-vector ✔ PASS 1.34 1.34 94.8s

Errors

kotlin/lru-cache

{@html `modified task files (disallowed): build.gradle.kts`}

Verification

  • Harness Version: v1.8.11-dirty
  • Weight Version: 2.1
  • Tasks Hash: blake3:3c951bc4b67b6739ff03d9f42709ffaa3652df423ebc3d8bdf4bf5b0961db82e
  • Results Hash: blake3:16e12ae03d0e5b0f83d10e80a9d0ebf0bd8fe3624f158f3dcf435227c9b412d0

Generated by SanityHarness on 2026-04-16T014950

Run Statistics

Tasks Passed 14 / 26
Duration 68m
Cost (Est) -
By Language
dart 0%
go 100%
kotlin 0%
rust 83%
typescript 40%
zig 33%