beezlebub33 t1_iy9tozq wrote
Reply to comment by literum in [r] The Singular Value Decompositions of Transformer Weight Matrices are Highly Interpretable - LessWrong by visarga
V1 refers the the mammalian primary visual cortex. http://www.scholarpedia.org/article/Area_V1
Cells in V1 respond to simple features such as lines of various orientations, certain simple frequencies, colors, etc. the article discusses it more.
The first layer of a CNN does something similar.
Viewing a single comment thread. View all comments