Don't allow setting both d_sae and expansion_factor in config

[chanind]

These are both ways of setting the size of the SAE

[anthonyduong9]

I can work on this this week.

[anthonyduong9]

@chanind I was thinking that as part of this, we should also change

SAELens/sae_lens/config.py

Line 134 in a708220

expansion_factor: int = 4

to

expansion_factor: Optional[int] = None

since it's less explicit to check if expansion_factor is 4 than None to check if it's been set. However, people would always have to pass a value for either d_sae or expansion_factor when they instantiate LanguageModelSAERunnerConfig. What do you think?

[jbloomAus]

seems good

[chanind]

I think that sounds reasonable! But just make sure that if both expansion_factor is None, and d_sae is None, then expansion_factor should default to 4 for backwards compatibility. This can be noted in the docstring and also as a comment after expansion_factor: Optional[int] = None # defaults to 4 if d_sae and expansion_factor is None