Back to AI News
arxiv

Mixed Signals: Weight-Space Programming for EEG and ECG

This arXiv paper applies weight-space programming, in which language models read and edit trained neural-network weights, to biosignal models trained on EEG and ECG data. It reports that frontier models could debug planted faults in such models and write network weights from scratch given the architecture, task and a minimal set of training subjects. In one experiment, a language model matched standard gradient-descent training using 6x fewer training subjects; networks written by Claude Opus 5.5 also outperformed classic hand-crafted EEG pipelines built from the same five subjects. The authors note limitations, including an inability to improve already well-trained classifiers or reliably infer the training task from weights alone, and conclude the approach is promising for small edge and wearable models but needs further investigation.

AI Brief

It provides a concrete research demonstration of language models generating and repairing neural-network weights for biosignal models, an approach potentially useful for small edge and wearable deployments.

arXiv:2611.13758v1 Announce Type: cross Abstract: Weight-space programming allows language models to read a trained neural network's weights and edit them. This opens the door to ``training'' by reasoning rather than through gradient descent. Prior work has demonstrated its functionality and promise for game-playing networks and fixing specific failures in language models, even extending to diffusion models. In this work, we present its applicability to models trained on biosignal data, specifically EEG and ECG data. We show that frontier models are not only able to debug specific faults planted in biosignal-based models without being told what these faults are, but are even capable of writing all the weights of a network from scratch, given only the architecture, the task, and a minimal set of training subjects. In particular, in one set of experiments, a language model was able to match standard gradient-descent training using $6\times$ fewer training subjects, through reasoning alone and without any gradient descent step. Networks written by Claude Opus 5.5 also scored higher than classic hand-crafted EEG pipelines (alpha band power, and common spatial patterns with linear discriminant analysis) when built from the same 5 subjects. We also highlight some of the limitations, which include the inability of language models to improve already well-trained classification models, and their incapacity to reliably recognize, from the weights alone, the task a network was trained on. Overall, our results indicate that weight-space programming can be useful for small networks, such as those deployed on edge devices and wearables, but the concept still requires further investigation before it can be used in practice.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!