On the Mechanism and Dynamics of Modular Addition: Fourier Features, Lottery Ticket, and Grokking

39 minute read

In-Context Linear Regression Demystified

19 minute read

Taming Polysemanticity in LLMs: Provable Feature Recovery via Sparse Autoencoders

15 minute read