Live intelligence

Latest AI updates

2 updates
Research

Planning Agents Should Reshape Search Space by Showing Plans, Not Asking Preferences

This paper introduces ReSHAPE, a task for evaluating whether an agent's revision of a user's initial specification improves planning by better matching acceptable plans. Using ReSHAPE Planter with human-validated simulated users, the authors analyze 5,800 agent-revised specifications in travel and shopping. They find that a single correct trade-off can make the same planner reach an acceptable plan up to 4.6x as often, while current agents admit at most 32% of acceptable plans. Showing concrete plans instead of asking about preferences raises F1 by 9.7 points in travel across two model families.

AI planninghuman-agent interactionbenchmarking
Research

Joi-Bench-Task benchmarks task coordination in full-duplex voice agents

The paper introduces Joi-Bench-Task, a benchmark designed to isolate coordination between task execution and conversation in full-duplex voice agents. It uses an interactive user simulator that injects configurable interventions during tool execution and spoken result delivery for reproducible evaluation. Five commercial voice agents are assessed on execution responsiveness, coordination under request changes, and coordination under interruptions. The reported results show a maximum 55% result completion rate under request changes and average information omission rates of at least 23% after interruption for four of the five agents.

full-duplex voice agentsbenchmark evaluationhuman-agent interaction