Tag: linear-representation-hypothesis

Representation Geometry: How Neural Networks Encode Meaning

The linear representation hypothesis, superposition, polysemanticity, and why transformer activations are more structured than they look.