Live intelligence

Latest AI updates

2 updates
Research

Benchmarking LLMs on Heterogeneous Cognitive and Biomedical Knowledge Graphs

The study benchmarks GPT-5.1, Gemini 2.0 Pro, Llama 3, Qwen, and BioGPT across DrugBank, NeuroSynth, Cognitive Atlas, Brain Map, and GDPKG using a multitier query dataset under graph-grounded and graph-agnostic conditions. It reports that general-purpose models generally outperform domain-specific models on multi-hop and high-level reasoning, although performance declines as query complexity increases. Knowledge-graph grounding reduces hallucination rates across all evaluated models, while domain-specific models do not consistently outperform general-purpose models on specialized tasks without grounding.

Large language modelsKnowledge graphsBiomedical AI
Research Editor selected

Operon-S1: a fast decision controller for long-horizon biomedical agents

Operon-S1 is a fast decision system that separates judging from doing in language-model agents for biology. It poses recurring agent judgments as closed questions at 13 decision points, using a local model that runs on CPU in 0.6 seconds with no request cost. The system records every decision with its consequence and can be retrained on labels from task construction, verifiers, or execution. It makes agent judgments a measurable, replaceable, and trainable layer without affecting task scores.

Why it matters: Introduces a practical architecture for transparent, fast, and trainable decision-making in biomedical AI agents, with measurable efficiency gains.

AI agentsbiomedical AIdecision systems