Skip to content
This repository has been archived by the owner on Jul 7, 2023. It is now read-only.

Deprecation notice for get_ende_bleu.sh #1827

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Deprecation notice for get_ende_bleu.sh #1827

wants to merge 1 commit into from

Commits on Jul 7, 2020

  1. Deprecation notice for get_ende_bleu.sh 

    This script is harmful because it propagates a non-standard way to compute BLEU that is not reflective of the WMT 2014 task.  Entirely too many papers are submitted with BLEU scores computed in undocumented ways.  It's not even reasonable to allow people to run this script to compare against prior work, because most prior work does not document which script it used.  And there are multiple of these running around.  

https://www.aclweb.org/anthology/W18-6319/
    @kpu
    kpu authored Jul 7, 2020
    Configuration menu
    Copy the full SHA
    4c2cc49 View commit details
    Browse the repository at this point in the history