Live intelligence

Latest AI updates

3 updates
Research

SPADE Uses Soft Prompts as a Signal for AI-Text Detection

Researchers introduce SPADE, a framework that detects AI-generated text by measuring how well a prompt explains a candidate text using a Pointwise Mutual Information term. SPADE trains one soft prompt per class and predicts the class whose prompt best explains the text. The method is designed to improve robustness and transfer across datasets, with experiments reporting state-of-the-art out-of-distribution performance against various detectors.

AI-text detectionsoft promptsLLMs
Research

Hx2Dx ARENA benchmarks LLMs on interactive clinical diagnosis

Researchers introduce Hx2Dx ARENA, an interactive benchmark of 1,000 clinical cases from the New England Journal of Medicine that simulates encounters from initial presentation through history taking, physical examination and diagnostic workup. Open- and closed-source LLMs are evaluated under multiple configurations. Every evaluated model loses diagnostic accuracy in the interactive setting compared with a static setting where the full case is presented upfront, and the ability to ask targeted questions accounts for much of the variation between models and the accuracy loss. The work highlights a gap between reasoning over available clinical data and hypothesis-driven information gathering.

LLMsclinical diagnosisbenchmarking
Research

From Fluent Text to Ontology-Compatible Definitions: A Quality-Control Agentic Workflow

The paper addresses the gap between fluent LLM-generated biomedical ontology definitions and definitions that are compatible with ontology entities and logical constraints. It introduces Entity Error Rate and Logical Inconsistency Rate to measure entity grounding and logical consistency, complementing reference-based text metrics. An agentic quality-control workflow iteratively generates definitions, extracts axioms, checks entity existence and logical consistency, and uses diagnostics for repair. Experiments on Disease Ontology, Uberon, and Uberon-ConstraintStress show reduced Entity Error Rate while conventional text-generation performance remains strong; Logical Inconsistency Rate reveals failures that similarity metrics miss, though repair remains limited.

LLMsbiomedical ontologiesagentic workflows