Training-Free Looped Transformers

by [unverified] · free · Last verified 2026-06-21T03:07:55.912Z

We introduce training-free looped transformers, in which a lightweight inference-time wrapper loops a contiguous mid-stack block of layers of a frozen checkpoint without additional fine-tuning, continued training, or architectural changes. Unlike prior looped transformer methods that train with t...