[Hackathon 7th] 修复 vctk 的 ernie_sat 训练时出现的类型提升问题 (#3943)

* [Fix] vctk type promotion * [Fix] type promotion
PaddlePaddle · Dec 9, 2024 · e4038b4 · e4038b4
1 parent b84e86d
commit e4038b4
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/paddlespeech/t2s/modules/losses.py b/paddlespeech/t2s/modules/losses.py
@@ -1114,6 +1114,7 @@ def forward(
                     paddle.reshape(after_outs, (-1, self.odim)),
                     paddle.reshape(xs_pad, (-1, self.odim))),
                 axis=-1)
+        mlm_loss_pos = (mlm_loss_pos).astype(loss.dtype)
         mlm_loss = paddle.sum((loss * paddle.reshape(
             mlm_loss_pos,
             [-1]).astype(loss.dtype))) / paddle.sum((mlm_loss_pos) + 1e-10)