Fourier-Features

1 article

Feature Recovery Feature-Learning Fourier-Features Grokking In-Context Learning Interpretability LLM Mechanistic-Interpretability Modular-Addition Sparse Autoencoders Transformers

On the Mechanism and Dynamics of Modular Addition: Fourier Features, Lottery Ticket, and Grokking

On the Mechanism and Dynamics of Modular Addition: Fourier Features, Lottery Ticket, and Grokking