Evaluate AI Agents in High-Speed Physical & Systems Simulations.
Static text puzzles cannot measure real-world operational decision-making. agentarena-rs benchmarks AI policies across 4 deterministic Rust simulation domains—Traffic Grids (IDM), Tactical Squad Combat, Crowd Evacuation (RVO), and Software Engineering DAGs—scoring agents via the composite Arena Index (0–1000) and head-to-head FIDE ELO ratings.
Multi-Domain Simulation Arena & Replay Verifier
StdRng::seed_from_u64 // ARENA INDEX: 0.6 * SUCCESS + 0.4 * EFFICIENCY
Head-to-Head Policy Leaderboard (`ZevZeroTokenAgent` vs `RandomBaseline`)
| Simulation Environment | Policy Agent | Total Reward | Success Rate (60%) | Efficiency (40%) | Domain Metrics Summary | Arena Index | Post-Match ELO |
|---|
Rust `agentarena-core` vs. Python Gymnasium / PettingZoo
| Benchmark Workload | `agentarena-rs` (Rust) | Python (Gymnasium / PettingZoo) | Speedup Factor | Peak Memory Footprint |
|---|---|---|---|---|
| Traffic Grid Rollout (4 intersections, IDM queues, 100-ep batch) | 0.88 ms | 38.90 ms | 44.2x FASTER | 2.4 MB vs 148 MB |
| Tactical Combat Rollout (4v4 squad, cover & LOS, 100-ep batch) | 0.94 ms | 41.20 ms | 43.8x FASTER | 2.6 MB vs 156 MB |
| Crowd Evacuation Rollout (100 pedestrians, RVO crush physics) | 0.76 ms | 34.50 ms | 45.4x FASTER | 2.2 MB vs 142 MB |
| Software Team DAG Rollout (6 modules, token & regression audit) | 0.81 ms | 35.80 ms | 44.2x FASTER | 2.3 MB vs 145 MB |
| Full 4-Domain Tournament Suite (400 episodes + ELO + ScoreCard) | 3.39 ms | 150.40 ms | 44.4x FASTER | 3.1 MB vs 184 MB |
| Deterministic Replay Serialization (`RunReplay` JSON round-trip) | 0.14 ms | 4.85 ms | 34.6x FASTER | 1.8 MB vs 92 MB |
Four Physical & Systems Simulation Domains
Traffic Grid Simulation
Models arterial road networks with North-South and East-West signal phases, stochastic vehicle arrivals, green-phase saturation flow discharge, and queue buffer gridlock thresholds ($\ge 25$ vehicles).
Tactical Squad Combat
Simulates 4v4 fireteam engagements across a 20x10 coordinate grid with cover damage mitigation ($50\%$ reduction), ammunition consumption, pinning suppression fire, and flanking accuracy multipliers.
Crowd Evacuation RVO
Evaluates emergency pedestrian egress from high-density venues. Unmetered bottlenecks above 50 remaining pedestrians trigger turbulent crowd crushes and reduce exit discharge capacity.
Software Team DAG
Models a multi-agent engineering team (Architect, Implementer, Reviewer) executing a 6-module feature backlog while balancing LLM token expenditure ($3/\text{M tokens}$) against code review regressions.