Code for Reproducing Results in WiCE Paper

Files in exec_fiels instruct how to run the experiments in this directory.

Setup

cd wice/code_and_resources/code
# install and activate conda environment
sh setup.sh

This code split articles into chunks and sentences, and also generate the oracle retrieval dataset.

sh exec_files/run_dataset_preprocessing.sh

Evaluate GPT-3.5 and GPT-4 on the oracle retrieval dataset.

# put your OpenAI API key in ../openai_api_key.txt
sh exec_files/evaluate_gpt_on_oracle.sh