Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to compare fine-tuned CodeBERT and UniXcoder? #189

Open
nevermet opened this issue Oct 25, 2024 · 0 comments
Open

How to compare fine-tuned CodeBERT and UniXcoder? #189

nevermet opened this issue Oct 25, 2024 · 0 comments

Comments

@nevermet
Copy link

Dear all,

I would like to compare the embedding performance between fine-tuned CodeBERT and UniXcoder. I followed the instructions on https://github.com/microsoft/CodeXGLUE/tree/main/Text-Code/NL-code-search-Adv

This page outputs MRR on fine-tuned CodeBERT but if I want to get MRR on UniXcoder, how can I modify the code?

On the other hand, if I want to get similarity between PL and NL on fine-tuned CodeBERT as described for UniXcoder in this page: https://github.com/microsoft/CodeBERT/tree/master/UniXcoder
, can I just load the fine-tuned CodeBERT with the same code?

Thank you in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant