Live intelligence

Latest AI updates

4 updates
Research

Balanced Accuracy Can Hide Silent Class Loss in Neural-Signal Test-Time Adaptation

A new arXiv paper evaluates full test-time adaptation across 11 dataset-encoder cells on Siena/EEG, PTB-XL/ECG and Sleep-EDF/EEG under fixed splits and update rules. It shows that in the binary case balanced accuracy can score a decoder that stopped predicting a minority class the same as one predicting both classes, with a class covering about a tenth of a subject's samples going unpredicted in 26-47 of 112 subject-cells versus 7-9 for controls. The study also finds the within-subject class contrast follows the encoder rather than the aggregate metric, with aggregate and contrast naming different encoders in 10 of 11 cells, and recommends reporting class-level and subject-level change alongside aggregate scores.

Test-time adaptationModel evaluationNeural-signal decoding
Research

Encoding Memory in World Models with Test-Time Model-Based Reinforcement Learning

The paper introduces Test-Time Model-Based Reinforcement Learning (TT-MBRL), which uses gradient descent at test time to encode episode observations into world-model parameters. This gives the agent a distinct world model per episode and aims to improve long-term memory beyond contextual-memory approaches. The authors report consistent gains in a simplified 2D Memory Maze variant across world-model architectures, new state-of-the-art results on the 3D Memory Maze benchmark, and maintained performance on DeepMind Control and Atari 100k.

reinforcement learningworld modelsmemory
Research

Test-Time Optimization Turns Frozen Reconstructors into Imputers for Missing Time-Series Channels

This paper introduces a test-time optimization method that converts a frozen time-series reconstructor into an imputer for complete channel failures, without mask augmentation during training. Missing entries are optimized to minimize reconstruction error on observed coordinates, with an optional temporal-smoothness prior. Across five datasets and four architectures, the method reduces MAE in 19 of 20 combinations versus one-pass reconstruction, though it trails mask-aware imputers on three datasets and requires more inference time.

time-series imputationtest-time adaptationmissing data handling
Research Editor selected

Uncertainty-Aware Prototype Learning for Open-Set Test-Time Adaptation

This paper introduces UAPA, a plug-and-play method for open-set test-time adaptation that handles both covariate-shifted in-distribution and out-of-distribution samples. It combines uncertainty-driven ID/OOD separation, dynamic prototype refinement, and contrastive prototype entropy adaptation to improve adaptation reliability. Experiments on CIFAR benchmarks and Tiny-ImageNet-C show average OSCR improvements of 2.08 and 1.28 percentage points over strong baselines.

Why it matters: Presents a novel, concrete method with empirical gains for a challenging open-set TTA problem, useful for researchers and practitioners.

Test-Time AdaptationOpen-Set RecognitionPrototype Learning