Live intelligence

Latest AI updates

11 updates

Research Editor selected

LifeVal: A Benchmark for Personalized Agentic Consumer Tasks

LifeVal is a new benchmark that evaluates AI models on personalized agentic consumer tasks, covering 148 categories with an estimated $1.7 trillion in annual willingness-to-pay. It is built from a survey of over 3,800 consumers and cross-referenced with time-use studies, with tasks created by experts and quality-controlled. The benchmark aims to measure performance on high-value real-life tasks like managing finances and job searching.

Why it matters: This introduces a novel, data-driven benchmark for a growing area of AI, offering concrete methodology and economic grounding that is valuable for researchers and developers.

arxiv11h agoScore 82

AI benchmarkspersonalized assistantsagentic AI

Research Editor selected

CWE-bench v2: More coverage, quality, and transparency

Hugging Face released CWE-bench v2, an updated benchmark for evaluating AI agents on real-world software vulnerabilities. The new version expands coverage to 25 CWE categories, improves data quality through manual curation, and adds transparency features like per-sample metadata and leaderboard filtering. This update aims to provide a more reliable and comprehensive evaluation for AI-driven security tools.

Why it matters: Provides concrete details on a new benchmark version, directly useful for AI security researchers and developers evaluating agent performance.

Hugging Face Blog2d agoScore 85

AI benchmarkssoftware securityAI agents

Research

OpenAI Introduces LifeVal Benchmark for Everyday Task Assistance

OpenAI has released LifeVal, a new benchmark designed to evaluate how effectively AI systems assist users with real-world tasks such as finding childcare, managing finances, and handling government paperwork. The benchmark focuses on practical, everyday scenarios rather than abstract reasoning. This initiative aims to measure AI's utility in daily life.

OpenAI News3d agoScore 75

AI benchmarksOpenAItask assistance

Research

GDPx: Measuring Frontier Model Capabilities Across the Most Valuable Domains

GDPx is described as a frontier benchmark spanning domains including RSI, hardware design, cyber, bio, finance, legal, quant trading, chip design, software engineering, materials science, and alignment. The supplied material provides only a high-level description, without methodology, results, or model comparisons. It is presented as a way to measure frontier model capabilities across economically valuable domains.

AIHUB3d agoScore 72

AI benchmarksfrontier modelsmodel evaluation

Models Editor selected

Google DeepMind launches Gemini 4 Carbon, a frontier model for cyber defense

Google DeepMind announced Gemini 4 Carbon, a new frontier model positioned for cybersecurity and long-horizon tasks, initially available to trusted cyber defenders through the Fairwind Program with wider developer access promised. Google claims 88.2% on SEC-bench Pro for vulnerability finding, 54.8% on ExploitGym for exploitation, and 71.0% on CWE-bench for patching. Artificial Analysis ranks Carbon #1 on its Intelligence Index v5 with a score of 59, leading four of nine index evaluations, while noting a 1M-token context window and multimodal input support. Reported pricing is $4/$20 per million input/output tokens with a 50% launch discount, and cached input at $0.20 per million tokens.

Why it matters: It gives readers a concrete look at a major new frontier model launch, its independent benchmark standing, cyber-focused availability, and reported pricing.

latentOct 29, 2026Score 92

Gemini 4 CarbonGoogle DeepMindAI benchmarks

Models Editor selected

Google DeepMind releases Gemini 4 Carbon with top AI Index score and security focus

Google DeepMind has released Gemini 4 Carbon just two weeks after Gemini 4 Argon, achieving 59 points on the Artificial Analysis Intelligence Index v5. The model is designed for extended agent workflows and the full cyber defense lifecycle, with initial access limited to selected security experts due to advanced security capabilities.

Why it matters: This is a concrete, recent model release with a measurable benchmark score and a distinct security-focused positioning, offering timely value to AI industry watchers.

The DecoderOct 29, 2026Score 85

Gemini 4Google DeepMindAI benchmarks

Products Editor selected

Google DeepMind Unveils Gemini 4 Carbon for Cyber Defense and Coding

Google DeepMind has introduced Gemini 4 Carbon, its strongest model to date, designed for long-horizon agentic coding and cybersecurity defense. It ranks #1 on the Artificial Analysis Intelligence Index v5.0 with a score of 59, leading 15 of 17 published benchmarks against rivals like GPT-6 Astra and Claude Opus 5.5. Access is initially limited to vetted cyber defenders through a pre-release testing process, with broader availability later. The model shows notable gains in vulnerability finding, exploitation, and patching, though some rival benchmarks remain competitive.

Why it matters: This is a concrete, recent frontier model release with detailed benchmark data and a clear cybersecurity focus, offering actionable insights for developers and security professionals.

MarkTechPostOct 29, 2026Score 85

Gemini 4 Carboncybersecurity AIfrontier models

Industry

Anthropic Drops Coding Interviews; Genie 4, FrontierCode 2.0, and New Models Ship

Anthropic hiring manager Felix Rieseberg announces the end of traditional coding interviews, advising junior engineers to focus on business impact and rapid prototyping. Google DeepMind launches Genie 4, a real-time world model with audio and Gemini planning, while Cognition releases FrontierCode 2.0 benchmark. Axiom formalizes the Classification of Finite Simple Groups in Lean, and multiple model releases include Liquid LFM3 and GPT-6.1 Terra.

latentOct 28, 2026Score 78

AI hiring practicesworld modelsformal verification

Models

Google's Gemini 4 Argon Tops 95% on ARC-AGI-3, but Only in One Test Setup

Google DeepMind's Gemini 4 Argon reportedly scored 97.5% on the ARC-AGI-3 benchmark, making Google the second lab after OpenAI to cross 95%. The result is highly setup-dependent, dropping to 49.8% in the standard harness. The model also trails rivals in math and software engineering benchmarks.

The DecoderOct 16, 2026Score 77

Google DeepMindGemini 4 ArgonARC-AGI-3

Models

Google releases Gemini 4 Argon

Google has launched Gemini 4 Argon, its long-awaited frontier AI model, after months of sitting out the frontier race. The company claims Argon offers frontier reasoning and better performance across complex workflows while reducing hedging, repetition, and cliches. Google says Argon outperforms GPT-6 Astra, Claude Fable 5.1, and Claude Opus 5.5 across benchmarks in areas including coding, cybersecurity, science, finance, and law. Google also says it is already using Argon internally.

The Verge AIOct 14, 2026Score 73

GoogleGemini 4 Argonfrontier AI models

Industry

Google DeepMind Executive: Every AI Product Company Must Build Its Own Benchmarks

Logan Kilpatrick, Senior Product Manager at Google DeepMind and Head of Google AI Studio, has issued a strong directive to the AI industry: every company building products on top of AI should establish its own proprietary benchmarks (standa

AITopic existing contentApr 27, 2026Score 70

Google DeepMindAI BenchmarksModel Performance