You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The TokenIdentity class in obvs/lenses.py currently has a run_and_compute() method, which uses batched versions of surprisal and precision. It also calculates these metrics alongside running the patchscope, saving GPU memory.
The PatchscopeLogitLens and ClassicLogitLens don't use such a method, but would benefit from it.
Can we generalise this run_and_compute() method to work for any lens? Or should it work for any patchscope?
The
TokenIdentity
class inobvs/lenses.py
currently has a run_and_compute() method, which uses batched versions of surprisal and precision. It also calculates these metrics alongside running the patchscope, saving GPU memory.The
PatchscopeLogitLens
andClassicLogitLens
don't use such a method, but would benefit from it.Can we generalise this
run_and_compute()
method to work for any lens? Or should it work for any patchscope?This arose from #48.
The text was updated successfully, but these errors were encountered: