OpenCode v1.1.36

Gemini 3 Pro 2026-01-25
Score
14.97
FAILED
Pass Rate: 50.0%
go: 100.0% (6 tasks)
go
kotlin: 66.7% (3 tasks)
kot
typescript: 40.0% (5 tasks)
typ
rust: 33.3% (6 tasks)
rus
zig: 33.3% (3 tasks)
zig
dart: 0.0% (3 tasks)
dar

Evaluation Report

Summary

Metric Value
Agent opencode
Model google/antigravity-gemini-3-pro
Reasoning Effort high
MCP Disabled Yes
Timestamp 2026-01-25T171626
Pass Rate 50.0% (13/26)
Weighted Pass Rate 45.0%
Weighted Score 14.97 / 33.29
Duration 3649.5s

Quality Breakdown

  • Clean Passes: 12
  • Partial Passes (timed out but passed): 1
  • Integrity Violations (modified test files): 0
  • Failures: 12

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 6 0 6 100.0%
kotlin 2 1 3 66.7%
rust 2 4 6 33.3%
typescript 2 3 5 40.0%
zig 1 2 3 33.3%

Results by Tier

Tier Passed Failed Total Pass Rate
core 6 6 12 50.0%
extended 7 7 14 50.0%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 132.9s
dart/isolate-pool ✘ FAIL 1.50 0.00 196.8s
dart/reactive-cache ✘ FAIL 1.50 0.00 178.8s
go/bank-account ✔ PASS 1.04 1.04 69.3s
go/dining-philosophers ✔ PASS 1.04 1.04 114.2s
go/errgroup-limit ⚠ PARTIAL 1.14 0.86 121.8s
go/parallel-letter-frequency ✔ PASS 1.04 1.04 69.5s
go/react ✔ PASS 1.14 1.14 209.6s
go/singleflight ✔ PASS 1.28 1.28 121.6s
kotlin/channel-multiplexer ✘ FAIL 1.50 0.00 178.4s
kotlin/flow-processor ✔ PASS 1.50 1.50 243.5s
kotlin/lru-cache ✔ PASS 1.09 1.09 128.2s
rust/circular-buffer ✔ PASS 1.12 1.12 113.7s
rust/doubly-linked-list ✔ PASS 1.24 1.24 114.0s
rust/generational-arena ✘ FAIL 1.24 0.00 66.5s
rust/macros ✘ FAIL 1.50 0.00 120.7s
rust/parallel-letter-frequency ✘ FAIL 1.12 0.00 93.6s
rust/regex-lite ✘ FAIL 1.40 0.00 120.6s
typescript/csv-lite ✘ FAIL 1.36 0.00 120.8s
typescript/forth ✘ FAIL 1.26 0.00 120.8s
typescript/glob ✔ PASS 1.14 1.14 103.5s
typescript/promise-pool ✘ FAIL 1.20 0.00 120.8s
typescript/react ✔ PASS 1.14 1.14 164.0s
zig/arena-allocator ✘ FAIL 1.50 0.00 241.7s
zig/comptime-json ✘ FAIL 1.50 0.00 241.7s
zig/small-vector ✔ PASS 1.34 1.34 142.7s

Verification

  • Harness Version: v1.5.1-1-g3b5528f
  • Weight Version: 2.0
  • Tasks Hash: blake3:168696ded119da3ea973f15bde9c00151c127b3f54168196a84212827fa1b1f0
  • Results Hash: blake3:d5837f13bafc79e275b4975b3600d7b25460017e6437a521c0a9e4730554b215

Generated by SanityHarness on 2026-01-25T171626

Run Statistics

Tasks Passed 13 / 26
Duration 61m
Cost (Est) -
By Language
dart 0%
go 100%
kotlin 67%
rust 33%
typescript 40%
zig 33%