Skip to content

Commit

Permalink
skip inactive preloading for efficiency (#390)
Browse files Browse the repository at this point in the history
  • Loading branch information
drcege authored Aug 21, 2024
1 parent 06a61b6 commit 9646fe7
Showing 1 changed file with 0 additions and 3 deletions.
3 changes: 0 additions & 3 deletions data_juicer/utils/model_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -551,9 +551,6 @@ def prepare_model(model_type, **model_kwargs):
global MODEL_ZOO
model_func = MODEL_FUNCTION_MAPPING[model_type]
model_key = partial(model_func, **model_kwargs)
# always instantiate once for possible caching
model_objects = model_key()
MODEL_ZOO[model_key] = model_objects
return model_key


Expand Down

0 comments on commit 9646fe7

Please sign in to comment.