Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Train data #2

Open
qjh-nj opened this issue Dec 27, 2023 · 1 comment
Open

Train data #2

qjh-nj opened this issue Dec 27, 2023 · 1 comment

Comments

@qjh-nj
Copy link

qjh-nj commented Dec 27, 2023

Hello!
It seems that there is no train dataset. Should I just run "run_dataset_preprocessing.sh" to get train data by myself?

and where is the test data--"a paired bootstrap test" described in the paper? Do I need to sample data by myself?

and what's the function of the code below, why "add oracle sentences to training data". Does the Table 5 in the paper use the code below to get more train data?

##add oracle sentences to training data
if "train" in args.split:
chunks_output_list.append(chunks_output_dict)

Thanks!

@ryokamoi
Copy link
Owner

ryokamoi commented Dec 31, 2023

Hi,

It seems that there is no train dataset. Should I just run "run_dataset_preprocessing.sh" to get train data by myself?

To get chunk-level train data, you need to run the code.

and where is the test data--"a paired bootstrap test" described in the paper? Do I need to sample data by myself?

Yes.

and what's the function of the code below, why "add oracle sentences to training data". Does the Table 5 in the paper use the code below to get more train data?

Yes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants