Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
liamhazan committed Feb 8, 2024
1 parent 0a2b150 commit 17a787e
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions fuse/data/utils/collates.py
Original file line number Diff line number Diff line change
Expand Up @@ -193,9 +193,9 @@ def _pad_size(value: torch.Tensor, dim: int) -> List[int]:
return default_collate(padded_values)

@staticmethod
def crop_to_min_pad(input_ids_list: List[torch.Tensor], pad_token_id: int):
def crop_padding(input_ids_list: List[torch.Tensor], pad_token_id: int):
"""
Crop padding of a batch of input_ids tensors to the maximum length.
Crop padding of a batch of input_ids tensors to the minimum length possible.
Args:
input_ids_list (list of torch.Tensor): List of input_ids tensors, where each tensor represents a sequence.
Expand Down

0 comments on commit 17a787e

Please sign in to comment.