xLSTM: The Sequel To The Legendary LSTM

Опубликовано: 11 Март 2026
на канале: bycloud
56,336
2.6k

Join the waitlist now for exclusive access to the OnDemand platform: https://on-demand.io/contact


The LSTM sequel by Sepp Hochreiter is finally here, surpassing its own self by 300x and even Mamba architectures. This innovative architecture blends Scalar and Matrix LSTMs, offering a great performance increase in benchmarks and language modeling tasks. This could be big??

Check out my newsletter https://mail.bycloud.ai/

LSTM (1997)
[Paper] https://deeplearning.cs.cmu.edu/F23/d...

xLSTM (2024)
[Paper] https://arxiv.org/abs/2405.04517
[unofficial resource collection] https://github.com/AI-Guru/xlstm-reso...


This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner, Akkusativ, Oleg Wock, FantomBloth

[Discord]   / discord  
[Twitter]   / bycloudai  
[Patreon]   / bycloud  

[Music] massobeats - noon
[Profile & Banner Art]   / pygm7  
[Video Editor] Silas