i14's Laplace 3B linear attention model trained and served on AWS Trainium2 with native PyTorch
AWS and i14 describe how the Laplace 3B model, built on Gated Linear Attention instead of softmax attention, was adapted to run on Trainium2 using native PyTorch via TorchNeuron Native. The recurrent state stays fixed at...