Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add text_pair_similarity_filter #405

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

Add text_pair_similarity_filter #405

wants to merge 3 commits into from
+206 −9

Conversation

Qirui-jiao
Copy link
Collaborator

Calculate the CLIP text features for text pairs, and filter the samples based on their cosine similarity.
Hyperparameters:

  • min_score – the min similarity score of filter range.
  • max_score – the max similarity score of filter range.
  • any_or_all – keep this sample when any/all text pairs meet the filter condition.

@Qirui-jiao Qirui-jiao added enhancement New feature or request dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs labels Aug 28, 2024
@github-actions GitHub Actions
Copy link

This PR is marked as stale because there has been no activity for 21 days. Remove stale label or add new comments or this PR will be closed in 3 day.

@github-actions GitHub Actions
Copy link

Close this stale PR.

@github-actions github-actions bot closed this Sep 28, 2024
@yxdyc yxdyc reopened this Oct 9, 2024
@github-actions github-actions bot removed the stale-pr label Oct 9, 2024
@drcege drcege marked this pull request as draft November 12, 2024 12:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@HYLcool HYLcool Awaiting requested review from HYLcool

@BeachWang BeachWang Awaiting requested review from BeachWang

@zhijianma zhijianma Awaiting requested review from zhijianma

@pan-x-c pan-x-c Awaiting requested review from pan-x-c

@garyzhang99 garyzhang99 Awaiting requested review from garyzhang99

@yxdyc yxdyc Awaiting requested review from yxdyc

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
dj:multimodal issues/PRs about multimodal data processing dj:op issues/PRs about some specific OPs enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Qirui-jiao @zhijianma @yxdyc