Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add on-the-fly sampling #134

Open
lebionick opened this issue Mar 16, 2020 · 2 comments
Open

Add on-the-fly sampling #134

lebionick opened this issue Mar 16, 2020 · 2 comments
Labels
enhancement New feature or request

Comments

@lebionick
Copy link

As far as I understand, right now text pairs are picked directly using Datapack samples. However it is almost impossible to mine "hard" negative samples before training. Just adding into class 0/ rank 0.0 random pairs which are not corresponding is very wasteful and inefficient.

@lebionick lebionick added the enhancement New feature or request label Mar 16, 2020
@faneshion
Copy link
Member

Hi @lebionick , do you mean the sampling strategy should be dynamically adjusted according to the performance after each epoch?

@lebionick
Copy link
Author

@faneshion exactly

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants