Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SLTev evaluation is taking excessively long #71

Open
bhaddow opened this issue Dec 10, 2021 · 0 comments
Open

SLTev evaluation is taking excessively long #71

bhaddow opened this issue Dec 10, 2021 · 0 comments
Labels
invalid This doesn't seem right

Comments

@bhaddow
Copy link
Contributor

bhaddow commented Dec 10, 2021

Hi

Running SLTev sometimes takes excessively long to evaluate (about 10 minutes). An example is available at http://www.statmt.org/bhaddow/SLTev-slow-mwe/

I run with:

SLTeval  -i ende.teacher.k0.en-de.en.txt.slt en-de.de.txt en-de.en.txt.OStt -f slt ref ostt

Profiling the code, I see that it spends most of its time here:

def extract_match_tokens_based_on_time(estimat_times, display_times, start, end):

I do not know the code well enough to know what the problem is, but (eg) the two loops could be combined, and the iteration should use for x in list rather than range()

best
Barry

@bhaddow bhaddow added the invalid This doesn't seem right label Dec 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
invalid This doesn't seem right
Projects
None yet
Development

No branches or pull requests

1 participant