Back to AI News
arxiv

PACT: Piecewise Adaptation via Chart Transport for Incremental Time-Series Foundation Models

This arXiv paper addresses incremental adaptation of pretrained time-series foundation models (TSFMs) under shifting operating conditions, where a model must learn new conditions without forgetting earlier ones and without knowing the condition at inference time. The authors observe that embedding-space shifts are non-uniform: some local regions change substantially while others stay nearly unchanged, so global adaptation can disturb already-correct embeddings. They propose PACT (Piecewise Adaptation via Chart Transport), which partitions the frozen source embedding space into local charts, learns lightweight residual transports for regions affected by each new condition, retains an identity path, and uses a learned gate to select among the identity and accumulated transports. With 5% labeled calibration data per arriving condition, PACT reports average macro-F1 above 0.95 across a four-condition bearing-fault stream, with similar retention-adaptation behavior on public benchmarks; code is available on GitHub.

AI Brief

It offers a concrete, code-backed method for continual adaptation of time-series foundation models without catastrophic forgetting, useful for practitioners deploying such models under changing conditions.

arXiv:2611.24075v1 Announce Type: new Abstract: Pretrained Time-Series Foundation Models (TSFMs) provide strong representations for downstream classification tasks. Yet adapting a TSFM under changing operating conditions remains challenging. A model must improve on each newly observed condition without sacrificing conditions it has already learned, often from only a small labeled calibration set and without knowing the operating condition at inference time. We find that this difficulty has an important geometric structure. Under an operating-condition shift, the embedding space of a TSFM does not move uniformly: some local regions change substantially, while others remain nearly unchanged. Consequently, a global adaptation can unnecessarily move embeddings that were already correctly classified. To address this, we propose the novel PACT (Piecewise Adaptation via Chart Transport). PACT partitions the frozen source embedding space into local charts and learns lightweight residual transports for the regions affected by each new condition. An explicit identity path is always retained, and a learned gate softly selects among the identity and accumulated transports for each input. The pretrained TSFM encoder, classifier head, and previously learned transports remain fixed. With only 5% labeled calibration data per arriving condition and no condition identity at test time, PACT maintains an average macro-F1 above 0.95 across a four-condition bearing-fault stream. Under homogeneous tasks and label spaces, similar retention-adaptation behavior is observed across public benchmarks. Code is available at https://github.com/Sachithx/PACT.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!