DeepMem: A Multiscale Byte-Level Language Model with Invertible Subband Transform
DeepMem is a causal multiscale architecture for byte-level language modeling that separates semantic compression from exact byte preservation using a learned invertible subband transform. It builds a hierarchy of shorter...