Contain, Conform, Compare (Extended Version): A Red-Teamed Evaluation Kit for Small Coding Agents and the Full Record of Its Experiments
The paper presents drydock-eval, a local evaluator for small coding agents that runs jobs in fresh network-isolated containers and checks local scoring behavior against a hosted scorer. It reports throughput of about 250...