Formulation of Feature Circuits with Sparse Autoencoders in LLM
Sparse Autoencoders can help interpret Large Language Models despite challenges posed by superposition.
Feature circuits in neural networks illustrate how input features combine to form complex patterns.