arXiv:2611.06688v1 Announce Type: cross
Abstract: Post-hoc out-of-distribution (OOD) detection is mature on far-OOD yet remains weak on near-OOD. These two settings differ in their use of class-characteristic feature directions: far-OOD inputs largely fail to activate those of their predicted class, whereas near-OOD inputs activate them much as in-distribution samples do. Because the axis separating far-OOD leaves near-OOD almost indistinguishable from ID, a score optimized for one setting is misaligned with the other; where a detector already saturates far-OOD, added near-OOD sensitivity is bought partly against it. This divergence motivates a targeted near-OOD signal designed to complement existing scores. We propose PLUS (Per-class Low-dimensional sUbspace Signal). For each class, PLUS selects the $m$ most class-active neurons from a sparse autoencoder, orthonormalizes the corresponding decoder directions to form a low-dimensional subspace, and scores an input by its per-class whitened squared Mahalanobis distance $z$ within the subspace of its predicted class. Designed as a dedicated complement rather than a standalone detector, the signal $z$ is fused additively with any calibrated base score at a single, fixed weight. This weight is a single global constant: no value is adjusted per backbone, per OOD dataset, or per deployment, and all calibration statistics are estimated from ID validation data alone. When applied to 18 existing detectors spanning diverse method families, $z$ consistently improves near-OOD AUROC in all 126 detector--backbone combinations. Far-OOD performance is broadly maintained or improved, with only marginal declines where the base score is near-optimal, making $z$ a robust, detector-agnostic complement across backbones.
arxiv
PLUS: A Detector-Agnostic Subspace Signal for Near-OOD Detection
The paper introduces PLUS, a post-hoc signal that complements existing out-of-distribution (OOD) detectors to improve near-OOD detection. PLUS builds per-class low-dimensional subspaces from sparse autoencoder decoder directions and scores inputs via whitened squared Mahalanobis distance. Fused additively with any calibrated base score at a fixed global weight, it improves near-OOD AUROC across all 126 detector-backbone combinations tested, while largely maintaining far-OOD performance.
This presents a novel, broadly applicable method that addresses a known weakness in OOD detection, with strong empirical results across many detectors and backbones.
Comments & Questions (0)
No comments yet
Be the first to comment!