#swa

Princeton Researcher Proposes Recurrent Looped Transformer (RLT)NEW⭐7

Princeton's Recurrent Looped Transformer (RLT) carries decoder state and SWA cache across tokens, with no reset. A design spec for unbounded recurrent depth.