Droid v0.83.0

MiniMax M2.7 2026-03-22
Score
11.92
FAILED
Pass Rate: 38.5%
go: 66.7% (6 tasks)
go
rust: 66.7% (6 tasks)
rus
zig: 33.3% (3 tasks)
zig
typescript: 20.0% (5 tasks)
typ
dart: 0.0% (3 tasks)
dar
kotlin: 0.0% (3 tasks)
kot

Evaluation Report

Summary

Metric Value
Agent droid
Model custom:MiniMax-M2.7
Sandbox Yes
Timestamp 2026-03-22T004858
Pass Rate 38.5% (10/26)
Weighted Pass Rate 35.8%
Weighted Score 11.92 / 33.29
Duration 6641.2s

Quality Breakdown

  • Integrity Violations (modified test files): 0
  • Failures: 16
  • Quota-affected tasks: 0
  • Auth-affected tasks: 0
  • Infra-affected tasks: 0

Behavior Telemetry

  • Total self-test commands: 0
  • Tasks with self-testing: 0/26
  • Total toolchain install attempts: 0
  • Tasks with toolchain install attempts: 0/26
  • Total out-of-workspace read attempts: 0
  • Tasks with out-of-workspace read attempts: 0/26
  • Total toolchain search attempts: 0
  • Tasks with toolchain searching: 0/26
  • Total Agent Skills usage signals: 0
  • Tasks with Agent Skills usage: 0/26 (0.0%)

Results by Language

Language Passed Failed Total Pass Rate
dart 0 3 3 0.0%
go 4 2 6 66.7%
kotlin 0 3 3 0.0%
rust 4 2 6 66.7%
typescript 1 4 5 20.0%
zig 1 2 3 33.3%

Results by Tier

Tier Passed Failed Total Pass Rate
core 6 6 12 50.0%
extended 4 10 14 28.6%

Task Results

Task Status Weight Score Duration
dart/future-pool ✘ FAIL 1.46 0.00 285.5s
dart/isolate-pool ✘ FAIL 1.50 0.00 154.9s
dart/reactive-cache ✘ FAIL 1.50 0.00 310.5s
go/bank-account ✔ PASS 1.04 1.04 43.0s
go/dining-philosophers ✔ PASS 1.04 1.04 107.1s
go/errgroup-limit ✔ PASS 1.14 1.14 817.7s
go/parallel-letter-frequency ✘ FAIL 1.04 0.00 41.6s
go/react ✘ FAIL 1.14 0.00 600.3s
go/singleflight ✔ PASS 1.28 1.28 58.1s
kotlin/channel-multiplexer ✘ FAIL 1.50 0.00 292.1s
kotlin/flow-processor ✘ FAIL 1.50 0.00 339.9s
kotlin/lru-cache ✘ FAIL 1.09 0.00 91.2s
rust/circular-buffer ✔ PASS 1.12 1.12 127.9s
rust/doubly-linked-list ✔ PASS 1.24 1.24 87.2s
rust/generational-arena ✔ PASS 1.24 1.24 220.2s
rust/macros ✘ FAIL 1.50 0.00 90.5s
rust/parallel-letter-frequency ✔ PASS 1.12 1.12 58.9s
rust/regex-lite ✘ FAIL 1.40 0.00 266.5s
typescript/csv-lite ✔ PASS 1.36 1.36 122.7s
typescript/forth ✘ FAIL 1.26 0.00 72.9s
typescript/glob ✘ FAIL 1.14 0.00 600.8s
typescript/promise-pool ✘ FAIL 1.20 0.00 122.6s
typescript/react ✘ FAIL 1.14 0.00 368.4s
zig/arena-allocator ✘ FAIL 1.50 0.00 606.5s
zig/comptime-json ✘ FAIL 1.50 0.00 603.9s
zig/small-vector ✔ PASS 1.34 1.34 150.2s

Verification

  • Harness Version: v1.8.7-dirty
  • Weight Version: 2.1
  • Tasks Hash: blake3:3c951bc4b67b6739ff03d9f42709ffaa3652df423ebc3d8bdf4bf5b0961db82e
  • Results Hash: blake3:b9e4a9983c560e49cd5b699a8a5edc0c6b3475ec673773794a3bef2e21952857

Generated by SanityHarness on 2026-03-22T004858

Run Statistics

Tasks Passed 10 / 26
Duration 111m
Cost (Est) -
By Language
dart 0%
go 67%
kotlin 0%
rust 67%
typescript 20%
zig 33%