VS
HMMs and Transformers, ICL
Linear probing and Truthflow
Autoencoders and Truthflow
Linear and nonlinear Probing
Two Hop Factual recall, Self Correction
HMMs and transformers, superposition, Factual recall circuits
Non linear Probing, Truth Subspace, HMMs and Transformers, ICL, Factual Recall Circuits