Live intelligence

Latest AI updates

1 updates
Research Editor selected

Re-Reading Is Not Free: Token Traces and Cache-Aware Energy Estimation for LLM Agents in Software Engineering

A ten-week study of nearly one billion tokens across 42 sessions and 752 task episodes finds cached-context reads account for 94.8% of API-reported tokens, with about 260 cached tokens read per generated token. The authors extend an analytical inference-energy model to account for cached-context processing, estimating roughly 250 kWh for the workload versus about 10 kWh from the output-based EcoLogits estimator. Starting each task from a fresh context would lower the estimate by about 60%, and parent-session logs undercount delegated subagent tokens by a factor of ten.

Why it matters: It exposes a large gap between current token-based energy estimators and real agentic software-development workloads, offering practical guidance for more accurate AI energy accounting.

LLM energy consumptionagentic workflowscache-aware inference