Dossier
LLM Attention
Coverage of LLM Attention in the Nexus archive.
- Persistent State Machines: LLM Attention with INT4 In-Memory Cells
The article introduces 'Persistent State Machines' as a method for Large Language Model (LLM) attention mechanisms using INT4 in-memory cells. It is hosted on Zenodo and linked to Hacker News for comments.