Back to AI News
arxiv

Backpropagation-free Learning for Time-Series Classification Lags Behind Standard Methods

A systematic study evaluates three backpropagation-free learning rules (DFA, DRTP, NoProp) on 112 UCR time-series datasets with 1D convolutional architectures. The optimized learners achieve mean F1 scores of 0.76–0.79, below ROCKET (0.83) and InceptionTime (0.84). DRTP reduces training FLOPs by 33% and speeds up only for long series, while NoProp cuts peak memory by 38% at the cost of longer training.

AI Brief

Provides the first systematic benchmark of backpropagation-free learning on time-series classification, offering practical insights into their trade-offs versus standard methods.

arXiv:2610.41805v1 Announce Type: cross Abstract: Deep neural networks for time series classification (TSC) are trained almost exclusively by error backpropagation, which imposes update locking and the weight-transport problem. Backpropagation-free learning rules such as Direct Feedback Alignment (DFA), Direct Random Target Projection (DRTP), and the diffusion-inspired NoProp relax these constraints but have been evaluated almost exclusively on 2D image benchmarks. We adapt these three learners to univariate TSC with 1D convolutional architectures and present the first systematic study of them across 112 datasets from the UCR time series archive, with one hyperparameter-optimized configuration per method. The optimized learners reach mean F1 scores of 0.76 to 0.79, below ROCKET (0.83) and InceptionTime (0.84). We propose an analysis framework that relates the per-dataset gap to InceptionTime to dataset properties and tests convolutional feature learning by replacing the flatten readout with global average pooling, measured as a difference-in-differences (DD) against a backpropagation control on the identical architecture. Intra-class temporal variability is the dataset property most consistently associated with the gap for all three learners (partial Spearman $\rho$ from $0.28$ to $0.40$). Pooling harms DFA and DRTP more than backpropagation (DD $-0.025$ and $-0.055$), consistent with near-random convolutional features, whereas NoProp tolerates pooling as backpropagation does (DD $+0.013$). Relative to backpropagation on the same architectures, DRTP reduces training floating-point operations (FLOPs) by 33% and trains faster only on series longer than about 700 time steps, DFA yields no computational reduction, and NoProp reduces peak memory by 38% at the cost of 48% longer training.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!