GitHub Copilot CLI 0.0.411

GPT-5.3 Codex 2026-02-17
Score
20.87
PASSED
Pass Rate: 69.2%
kotlin: 100.0% (3 tasks)
kot
go: 83.3% (6 tasks)
go
rust: 83.3% (6 tasks)
rus
typescript: 60.0% (5 tasks)
typ
dart: 33.3% (3 tasks)
dar
zig: 33.3% (3 tasks)
zig

Evaluation Report

Summary

Metric Value
Agent copilot
Model unknown
Sandbox Yes
Timestamp 2026-02-17T120827
Pass Rate 69.2% (18/26)
Weighted Pass Rate 0.0%
Weighted Score 0.00 / 33.29
Duration 0.0s

Quality Breakdown

  • Clean Passes: 0
  • Partial Passes (timed out but passed): 0
  • Integrity Violations (modified test files): 0
  • Failures: 8

Results by Language

Language Passed Failed Total Pass Rate
dart 1 2 3 33.3%
go 5 1 6 83.3%
kotlin 3 0 3 100.0%
rust 5 1 6 83.3%
typescript 3 2 5 60.0%
zig 1 2 3 33.3%

Results by Tier

Tier Passed Failed Total Pass Rate
core 8 4 12 66.7%
extended 10 4 14 71.4%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 0.0s
dart/isolate-pool ✘ FAIL 1.50 0.00 0.0s
dart/reactive-cache ✔ PASS 1.50 0.00 0.0s
go/bank-account ✔ PASS 1.04 0.00 0.0s
go/dining-philosophers ✔ PASS 1.04 0.00 0.0s
go/errgroup-limit ✘ FAIL 1.14 0.00 0.0s
go/parallel-letter-frequency ✔ PASS 1.04 0.00 0.0s
go/react ✔ PASS 1.14 0.00 0.0s
go/singleflight ✔ PASS 1.28 0.00 0.0s
kotlin/channel-multiplexer ✔ PASS 1.50 0.00 0.0s
kotlin/flow-processor ✔ PASS 1.50 0.00 0.0s
kotlin/lru-cache ✔ PASS 1.09 0.00 0.0s
rust/circular-buffer ✔ PASS 1.12 0.00 0.0s
rust/doubly-linked-list ✔ PASS 1.24 0.00 0.0s
rust/generational-arena ✔ PASS 1.24 0.00 0.0s
rust/macros ✔ PASS 1.50 0.00 0.0s
rust/parallel-letter-frequency ✔ PASS 1.12 0.00 0.0s
rust/regex-lite ✘ FAIL 1.40 0.00 0.0s
typescript/csv-lite ✔ PASS 1.36 0.00 0.0s
typescript/forth ✘ FAIL 1.26 0.00 0.0s
typescript/glob ✔ PASS 1.14 0.00 0.0s
typescript/promise-pool ✘ FAIL 1.20 0.00 0.0s
typescript/react ✔ PASS 1.14 0.00 0.0s
zig/arena-allocator ✘ FAIL 1.50 0.00 0.0s
zig/comptime-json ✘ FAIL 1.50 0.00 0.0s
zig/small-vector ✔ PASS 1.34 0.00 0.0s

Verification

  • Harness Version: v1.5.13-2-g468cfe3-dirty
  • Weight Version: 2.0
  • Tasks Hash: blake3:168696ded119da3ea973f15bde9c00151c127b3f54168196a84212827fa1b1f0
  • Results Hash: blake3:39f6941ea0bb5d63db1cf9a82dbb36f746381655646f261ca8df107c754ab47d

Generated by SanityHarness on 2026-02-17T120827

Run Statistics

Tasks Passed 18 / 26
Duration 0m
Cost (Est) -
By Language
dart 33%
go 83%
kotlin 100%
rust 83%
typescript 60%
zig 33%