You don't need error nodes, you need better features
Scaling replacement-aware SAE training to Gemma-2-2B.
Replacement-aware SAE Training
In which a term for the feature-space error of the next layer's SAE is added to the standard SAE loss function.
No matching items