Exposure bias Evaluation shows negative value

[Phuc3010]

Hi, I noticed that the ExAccErr (Error Accumulative Error) in MiniLLM’s exposure bias evaluation file is showing a negative value. Could this indicate a potential issue in the implementation, or is there another explanation for this behavior?

[t1101675]

Hi! This is probablity because we compute ExAccErr using sampling to estimate the expectations. Therefore, the ExAccErr value may fluctuate to negative when it is close to 0.