Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

evaluation implementation #8

Open
lizhuorong opened this issue Aug 28, 2017 · 10 comments
Open

evaluation implementation #8

lizhuorong opened this issue Aug 28, 2017 · 10 comments

Comments

@lizhuorong
Copy link

Would you please release your evaluation implementation? Thank you and I am looking forward to that!

@lizhuorong
Copy link
Author

Do you mean that the results in Table 1 of your paper is achieved by means of tests deployed on the
AMT platform rather than the automatic measures?

@CQFIO
Copy link
Owner

CQFIO commented Aug 28, 2017

The evaluation is essentially user study on Amazon Turk. I will update the evaluation code soon. It just creates javascript for Amazon Turk. There is no automatic measurement.

@tesfaldet
Copy link

+1 would like to see the mturk eval code! I'm currently working on a project where your mturk tests would serve as a great starting point.

@CQFIO
Copy link
Owner

CQFIO commented Aug 31, 2017

Hi, I just upload the Amazon Turk scripts on Github. See folder "mturk_scripts".

@lizhuorong
Copy link
Author

Thanks : )

@tesfaldet
Copy link

Awesome! Thanks!

@tesfaldet
Copy link

For the sake of completeness, mind sharing any relevant javascript code you use for the mturk experiments? Thank you!

@CQFIO
Copy link
Owner

CQFIO commented Sep 23, 2017

@tesfaldet I forgot to put the Javascript code on GitHub. I just upload example code in "mturk_scripts".

@tesfaldet
Copy link

Thanks a lot for the quick responses :)

@tesfaldet
Copy link

tesfaldet commented Sep 28, 2017

Just a heads up that there's no javascript in unlimited_time_comparison/example_javascript.txt Not a problem for me though since I took it from limited_time_comparison/example_javascript.txt.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants