Live intelligence

Latest AI updates

2 updates
Research

Simple Generate-and-Select Baseline Matches Costlier Prompt Optimizers, Audit Finds

Researchers introduce Demonstration-Conditioned Prompt Search (DCPS), a deliberately simple control that freezes a generator, conditions it on randomly sampled demonstrations, scores candidates on validation data, and keeps the best candidate without learned updates, reflection, or evolution. Across two optimizer families, DCPS reportedly matches StablePrompt's PPO-based classification accuracy within 0.5 percentage points at roughly one-third the measured cost, and matches GEPA's macro accuracy on GPT-4.1-mini in DSPy compound systems using 55% fewer rollouts at 32% lower measured API cost on average. The audit finds gains are task-dependent: proposal-and-selection recovers much of heavier optimizers' performance on structured and instruction-following tasks, while extra mechanisms still help in some open-ended and reasoning-heavy settings. The authors recommend benchmarking prompt optimizers against generate-and-select controls and reporting rollout counts, token usage, and dollar costs alongside accuracy.

prompt optimizationLLM evaluationDSPy
Products

Cmpnd Releases dspy-wsp, a DSPy Optimizer That Edits Model Weights Without Gradients

Cmpnd has released dspy-wsp, an MIT-licensed prototype that packages weight-space programming as a DSPy optimizer called WeightSpace, which plugs into existing DSPy programs and metrics. A frontier writer LLM reads a small student model's weight tensors inside a sandbox and writes targeted patches, working within a fixed forward-pass budget (25 passes in the reported tests) with no gradients or training loop. On Cmpnd's Typed Decisions benchmark, runs costing roughly $5.42 to $7.63 improved decision models from 0.6B to 9B parameters, with d1-omni-600M rising from 50.9% to 69.1% when WeightSpace was combined with the earlier ReAnchor optimizer. Cmpnd reports the approach is experimental, slow (78 to 167 minutes per run) and weakest on the largest model tested, where WeightSpace alone added only 1.9 points.

DSPyWeight-space programmingCmpnd