Metamodels Forecast LLM Answer Activations Before First Token
Researchers propose context-answer metamodels that map context activations to forecasts of mean-pooled answer activations, capturing variability across stochastic rollouts. The metamodels achieve high fidelity, scale wit...