Explore tools, prompts, skills, news and resources related to transformer architecture.
Prompt works related to transformer architecture
Latest articles, prompts, use cases and editorial content about transformer architecture
An arXiv study evaluates 250 paired GSM8K derivations on Qwen3-8B and LLaMA-3.1-8B-Instruct, comparing clustered attention-head masking with budget-matched diffuse i.i.d. dropout. At onset B=0.10, Qwen3-8B accuracy fell...
Researchers propose DP-Learner, an equivariant learning framework that performs message passing directly on Hamiltonian-like operator blocks in direct-product space rather than direct-sum spaces of irreducible spherical...
Ricursive Intelligence has released Ripple-65B Preview, a 65B dense open-weight model pretrained from scratch for agentic coding. It achieves 80.5 on Terminal-Bench 2.1, the top self-reported score among US open-weight m...
The paper introduces MambaPFN, a Transformer-based method for model-agnostic variable selection that identifies variables with nonlinear dependence on a response. It uses a functional-mapping perspective, pretraining on...
A new arXiv study systematically examines how patch size affects encoder-only and decoder-only time series foundation models trained on the same data and compute budget. Across 97 GIFT-Eval tasks, encoder-only models fav...
AWS and i14 describe how the Laplace 3B model, built on Gated Linear Attention instead of softmax attention, was adapted to run on Trainium2 using native PyTorch via TorchNeuron Native. The recurrent state stays fixed at...
Discover tools, products and platforms related to transformer architecture