You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am trying to run an evaluation on the model built for bidaf, since its missing in the readme on how to run the model after it is built, the code (in main.py) pretty well explains it (thanks :)),
elif FLAGS.mode == "official_eval":
if FLAGS.json_in_path == "":
raise Exception("For official_eval mode, you need to specify --json_in_path")
and in generating_predicitions_json file for official_eval mode, --json_in_path=data/tiny-dev.json is used. But the file data/tiny-dev.json does not exists. Is it a smaller file of data/dev-v1.1.json, if so why are we using that to evaluate?
Any help will be appriciated!
Also the repo is missing evaluation and running the model as an application, this I am ready to write and send a pull request :) but need to figure out the rest of the code.
Thanks in advance!
The text was updated successfully, but these errors were encountered:
I am trying to run an evaluation on the model built for bidaf, since its missing in the readme on how to run the model after it is built, the code (in
main.py
) pretty well explains it (thanks :)),and in
generating_predicitions_json
file forofficial_eval
mode,--json_in_path=data/tiny-dev.json
is used. But the filedata/tiny-dev.json
does not exists. Is it a smaller file ofdata/dev-v1.1.json
, if so why are we using that to evaluate?Any help will be appriciated!
Also the repo is missing evaluation and running the model as an application, this I am ready to write and send a pull request :) but need to figure out the rest of the code.
Thanks in advance!
The text was updated successfully, but these errors were encountered: