Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
priyakasimbeg committed Nov 16, 2023
1 parent 88bfde9 commit a440604
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -297,7 +297,7 @@ def forward(self, inputs, key_padding_mask=None):
attn_mask=~key_padding_mask[:, None, None],
dropout_p=self.dropout,
).transpose(1, 2).reshape(batch_size, seq_len, embed_dim)
out = out * attention_temperature
out = out * self.attention_temperature
out = self.out_proj(out)
return out

Expand Down

0 comments on commit a440604

Please sign in to comment.