Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing data to run Evaluation #10

Open
neerajvashistha opened this issue May 14, 2019 · 0 comments
Open

Missing data to run Evaluation #10

neerajvashistha opened this issue May 14, 2019 · 0 comments

Comments

@neerajvashistha
Copy link

I am trying to run an evaluation on the model built for bidaf, since its missing in the readme on how to run the model after it is built, the code (in main.py) pretty well explains it (thanks :)),

elif FLAGS.mode == "official_eval":
        if FLAGS.json_in_path == "":
            raise Exception("For official_eval mode, you need to specify --json_in_path")

and in generating_predicitions_json file for official_eval mode, --json_in_path=data/tiny-dev.json is used. But the file data/tiny-dev.json does not exists. Is it a smaller file of data/dev-v1.1.json, if so why are we using that to evaluate?

Any help will be appriciated!

Also the repo is missing evaluation and running the model as an application, this I am ready to write and send a pull request :) but need to figure out the rest of the code.

Thanks in advance!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant