Part III · Beyond SSMs Week 11 Coming Soon

Linear attention and Hyena: long convolution and gated recurrence

Katharopoulos lineage; Hyena operator; gated linear attention (GLA/RetNet/HGRN2).

Linear attention and Hyena: long convolution and gated recurrence

This chapter is planned. See the chapter-at-a-glance (foundations §3) for the full design; the crosswalk (foundations §22) maps this chapter to the relevant post_transformers/roadmap.md weeks.