arXiv:2610.41805v1 Announce Type: cross
Abstract: Deep neural networks for time series classification (TSC) are trained almost exclusively by error backpropagation, which imposes update locking and the weight-transport problem. Backpropagation-free learning rules such as Direct Feedback Alignment (DFA), Direct Random Target Projection (DRTP), and the diffusion-inspired NoProp relax these constraints but have been evaluated almost exclusively on 2D image benchmarks. We adapt these three learners to univariate TSC with 1D convolutional architectures and present the first systematic study of them across 112 datasets from the UCR time series archive, with one hyperparameter-optimized configuration per method. The optimized learners reach mean F1 scores of 0.76 to 0.79, below ROCKET (0.83) and InceptionTime (0.84). We propose an analysis framework that relates the per-dataset gap to InceptionTime to dataset properties and tests convolutional feature learning by replacing the flatten readout with global average pooling, measured as a difference-in-differences (DD) against a backpropagation control on the identical architecture. Intra-class temporal variability is the dataset property most consistently associated with the gap for all three learners (partial Spearman $\rho$ from $0.28$ to $0.40$). Pooling harms DFA and DRTP more than backpropagation (DD $-0.025$ and $-0.055$), consistent with near-random convolutional features, whereas NoProp tolerates pooling as backpropagation does (DD $+0.013$). Relative to backpropagation on the same architectures, DRTP reduces training floating-point operations (FLOPs) by 33% and trains faster only on series longer than about 700 time steps, DFA yields no computational reduction, and NoProp reduces peak memory by 38% at the cost of 48% longer training.
arxiv
Backpropagation-free Learning for Time-Series Classification Lags Behind Standard Methods
A systematic study evaluates three backpropagation-free learning rules (DFA, DRTP, NoProp) on 112 UCR time-series datasets with 1D convolutional architectures. The optimized learners achieve mean F1 scores of 0.76–0.79, below ROCKET (0.83) and InceptionTime (0.84). DRTP reduces training FLOPs by 33% and speeds up only for long series, while NoProp cuts peak memory by 38% at the cost of longer training.
Provides the first systematic benchmark of backpropagation-free learning on time-series classification, offering practical insights into their trade-offs versus standard methods.
Comments & Questions (0)
No comments yet
Be the first to comment!