Preventing Code Slop and Enforcing Task Completion with Mechanical Gates

How active helper cataloging reduces slop to zero and deterministic gates complete 96.6% to 100% of required items on skip-told briefs.

Core Finding:Autonomous agents introduce two subtle forms of codebase rot: generating duplicate helper functions instead of reusing existing ones ('code slop'), and declaring tasks complete while omitting steps requested in the prompt. Required items completed on skip-told briefs: Hook-only runs completed 56/58 items on Claude (96.6%) and 29/29 on Gemini (100%). Ungated skip-told runs completed 39/65 and 21/29 items respectively. Total measured slop fell from 4 events in 12 Claude OFF runs to zero in 12 Claude ON and 6 Gemini ON runs.

Code Slop Events

4 -> 0 Events

Total measured slop fell from 4 events in 12 Claude OFF runs to zero in 12 Claude ON and 6 Gemini ON runs.

Required items completed on skip-told briefs

56/58 Claude, 29/29 Gemini

Hook-only runs completed 56/58 items on Claude (96.6%) and 29/29 on Gemini (100%). Ungated skip-told runs completed 39/65 and 21/29 items respectively.

False Block Rate

0.0% (0 / 59)

Zero false-positive blocks across 59 valid completion sessions.

Injection Hook Latency

0.27 - 1.16 s

Observed hook latency ranged from 0.27 to 1.16 seconds in the October 2 evaluation.

Empirical Findings Table

Slop reduction and required items completed on skip-told briefs under mechanical gating.

Telemetry Metric	Measured Value	Context & Observability
Code Slop Events	4 -> 0 Events	Total measured slop fell from 4 events in 12 Claude OFF runs to zero in 12 Claude ON and 6 Gemini ON runs.
Required items completed on skip-told briefs	56/58 Claude, 29/29 Gemini	Hook-only runs completed 56/58 items on Claude (96.6%) and 29/29 on Gemini (100%). Ungated skip-told runs completed 39/65 and 21/29 items respectively.
False Block Rate	0.0% (0 / 59)	Zero false-positive blocks across 59 valid completion sessions.
Injection Hook Latency	0.27 - 1.16 s	Observed hook latency ranged from 0.27 to 1.16 seconds in the October 2 evaluation.

Engineering Action Directives

In this benchmark, active catalog injection eliminated helper duplication across tested runs by surfacing canonical names before execution.
Deterministic mechanical completion gates effectively counter premature task abandonment under complex prompt constraints without relying on conversational compliance.

Methodology Boundaries & Limits

Adversarial prompt scope: Tested against specific skip-instruction patterns; models may discover novel unmonitored failure modes not covered by current completion rules.
Single-repository evaluation: Evaluated within MeshTen engineering harnesses across 30 runs; cross-organization workflows with divergent conventions require tailored gate criteria.
Six incomplete runs passed because generic file-change checks accepted the wrong edit.