What RetNet seeded
RetNet's most important legacy is not its own deployments — it's what came after, directly drawing from RetNet's framework:
Mamba-2's State Space Duality. The SSD framework explicitly cites retention as a precursor; the duality between SSM and structured attention that SSD formalizes was first demonstrated in concrete form by RetNet's parallel-vs-recurrent equivalence.
Hawk and Griffin (Google, 2024). Both architectures use a recurrent operator with exponential-decay-flavored gating that is structurally a generalization of retention. Griffin (a hybrid with sliding window attention) is one of Google's productionized alternative architectures.
Gated Linear Attention (GLA). A family of linear-attention variants where the decay becomes input-dependent — essentially retention with the constraint relaxed. GLA is the bridge between RetNet and full Mamba-style selectivity.
The status today
RetNet itself is best understood as an enabling research concept rather than a deployed model family. The ideas have been absorbed into subsequent architectures. Builders working in the alternative-architecture space should understand retention as a foundational primitive that shaped the current landscape, even if you never deploy a RetNet model.
The broader lesson
Sometimes a research contribution's greatest value is in the ideas it seeds, not the models it ships. RetNet demonstrated what was possible — three execution paradigms, the recurrence-attention duality, multi-scale fixed decay — and the field built on that demonstration. The success metric for some architectures isn't "how widely was this deployed" but "how much did this change how people think about the design space". By that metric RetNet succeeded enormously.