MirrorCode Benchmark Shows AI Reverse-Engineering Full Codebases

Editorial digest April 13, 2026
Last updated : 12:01

The story of the day

AI measurement organizations METR and Epoch have released MirrorCode, a benchmark that tests whether AI models can autonomously reverse-engineer and reimplement existing software spanning thousands of lines of code. According to Import AI, the results suggest "AI systems are more capable than most people think at certain types of coding task."

This matters more than another leaderboard entry. MirrorCode tests long-horizon autonomous coding — not autocomplete, not single-function generation, but sustained architectural reasoning across entire codebases. The kind of work that, until recently, required a senior engineer with domain context and a week of uninterrupted focus.

For engineering leaders: this is the benchmark to watch when evaluating AI-assisted migration, legacy modernization, or competitive analysis tooling. For investors: the gap between "AI writes functions" and "AI reverse-engineers systems" just narrowed significantly. The implications for security research are equally obvious — and equally uncomfortable. If a model can reimplement a codebase from behavior alone, the line between analysis and replication gets thin fast.

Meanwhile, Ben Thompson at Stratechery frames the broader economic picture: reasoning models have reintroduced marginal costs to compute, effectively ending the zero-marginal-cost assumption that underpinned Aggregation Theory. The question isn't whether AI can do the work — it's whether the economics of doing it make sense at scale.

New tools & launches

Kepler Orbital Compute Cluster — 40 GPUs flying in Earth orbit, now commercially available. First customer: Sophia Space. The largest orbital compute deployment to date. [TechCrunch]

Ollama Cloud Pro — $20/month hosted inference service, now being compared head-to-head with OpenAI Plus ($23/month) for running parallel AI agents. Community testing suggests competitive token throughput for self-hosted agent frameworks like OpenClaw. [Reddit r/OpenAI]

OpenAI London Expansion — Sam Altman announced a new London office tied to UK Stargate plans, though OpenAI already has a Kings Cross presence. The strategic signal: doubling down on UK regulatory goodwill and talent access. [CNBC via Reddit]

Models & research

MiniMax M2.7 — The new open-weight model is generating strong results in local inference, particularly for code generation tasks. Reddit users report it "kicking ass" in agentic coding scaffolds, with one user running it at IQ2_XXS quantization while maintaining coherence. Benchmark testing on a GTA-like 3D generation task showed competitive performance against GLM 5, though the latter still leads on visual aesthetics. Open-weight. [Reddit r/LocalLLaMA]

MirrorCode (METR × Epoch) — A benchmark specifically designed to measure autonomous software reimplementation capability. Unlike standard coding benchmarks that test isolated tasks, MirrorCode evaluates whether models can understand, decompose, and rebuild complex multi-file software systems. The benchmark targets a gap in existing evaluation: long-horizon coding autonomy. [Import AI 453]

Community pulse

Unsloth MiniMax M2.7 quants flagged as broken — A LocalLLaMA user ran perplexity measurements on Unsloth's UD-Q4_K_XL quantization of MiniMax M2.7 and found NaN values, indicating numerical instability. The post criticizes the rush-to-publish culture among quant providers: "let's be the first cause we know we have people starving for new models." Alternative quants from other providers (Q5_K_M) appear functional. A recurring theme — speed-to-market versus quality assurance remains unresolved in the open-weight ecosystem. [Reddit r/LocalLLaMA]

Voice-first LLM usage gaining traction — Users are wiring together Whisper + Fast-Kokoro TTS + local models for real-time voice conversations running entirely on consumer hardware (RTX 4060 Ti). The setup reportedly achieves near-real-time latency, suggesting voice interfaces for local LLMs are crossing the usability threshold. [Reddit r/LocalLLaMA]

Stat of the day

40 GPUs in Earth orbit. Kepler Communications is now operating the largest orbital compute cluster ever deployed, according to TechCrunch. For context, that's fewer GPUs than a single rack in a terrestrial data center — but it's compute where no fiber can reach. The use case isn't raw throughput; it's processing satellite data at the point of collection, eliminating downlink bottlenecks. Watch this number: if it 10x's within two years, orbital edge compute becomes a real infrastructure category.

Get the full analysis — subscribe to Gradient Pro.