CAREFUL-Bench: Effect-Aware, Judge-Free Evaluation of Multi-Turn LLM Function Calling
CAREFUL-Bench enhances the Berkeley Function Calling Leaderboard (BFCL) by making evaluation effect-aware without replacing it. It infers effect declarations for all 128 functions via simulator execution and uses a judge-free replay scorer that reproduces official results while reporting unrequested destructive calls, duplicate writes, redundant reads, and token costs. Across 11 open models, effect-aware scoring preserves ranking but reveals quality gaps, and a confirmation-aware protocol shows models rarely obtain explicit permission before destructive actions.
Why it matters: Provides a concrete, recent improvement to function-calling benchmarks, exposing critical limitations in current evaluation and offering actionable metrics for model developers.