Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add license and optimize import #1391

Closed
wants to merge 87 commits into from
Closed

Add license and optimize import #1391

wants to merge 87 commits into from

Conversation

xinyual
Copy link
Collaborator

@xinyual xinyual commented Sep 27, 2023

Description

[Describe what this change achieves]

Issues Resolved

[List any issues this PR will resolve]

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@xinyual
add tokenizer and sparse encoding
e37956e 
Signed-off-by: xinyual <[email protected]>
@xinyual
add tokenizer and sparse encoding
27d8fe0 
Signed-off-by: xinyual <[email protected]>
@xinyual
add tokenizer and sparse encoding
0f8cd9c 
Signed-off-by: xinyual <[email protected]>
@xinyual
add tokenizer and sparse encoding
af9ba42 
Signed-off-by: xinyual <[email protected]>
@xinyual
add tokenizer and sparse encoding
6f49c22 
Signed-off-by: xinyual <[email protected]>
@xinyual
remove special token
2b5ea1b 
Signed-off-by: xinyual <[email protected]>
@xinyual
add filter
f832494 
Signed-off-by: xinyual <[email protected]>
@xinyual
try empty model
f49c471 
Signed-off-by: xinyual <[email protected]>
@xinyual
remove warm up
2be43a7 
Signed-off-by: xinyual <[email protected]>
@xinyual
try empty model
4b96521 
Signed-off-by: xinyual <[email protected]>
@xinyual
add block
7b9f97e 
Signed-off-by: xinyual <[email protected]>
@xinyual
add log
084c56f 
Signed-off-by: xinyual <[email protected]>
@xinyual
add log
c2951cf 
Signed-off-by: xinyual <[email protected]>
@xinyual
add log
61720c3 
Signed-off-by: xinyual <[email protected]>
@xinyual
remove log
99eda1a 
Signed-off-by: xinyual <[email protected]>
@xinyual
remove pt file detect
5aa5698 
Signed-off-by: xinyual <[email protected]>
@xinyual
add log
1d4ddba 
Signed-off-by: xinyual <[email protected]>
@xinyual
add functionName pipeline
b6614ca 
Signed-off-by: xinyual <[email protected]>
@xinyual
remove verify log
e3ca040 
Signed-off-by: xinyual <[email protected]>
@xinyual
skip special token in sparse encoding
5eaf588 
Signed-off-by: xinyual <[email protected]>
@xinyual
skip omit tokenize config
37a878f 
Signed-off-by: xinyual <[email protected]>
@xinyual
skip omit tokenize config-change warm up logic
4c4ac28 
Signed-off-by: xinyual <[email protected]>
@xinyual
reArch
03ce4af 
Signed-off-by: xinyual <[email protected]>
@xinyual
deduplicate
eac759d 
Signed-off-by: xinyual <[email protected]>
@xinyual
omit ml config in sparse encoding
c0513b4 
Signed-off-by: xinyual <[email protected]>
@xinyual
add null config in warm up
0428cf4 
Signed-off-by: xinyual <[email protected]>
@xinyual
fix original test
51eef93 
Signed-off-by: xinyual <[email protected]>
@xinyual
add tokenize ut half
17b755f 
Signed-off-by: xinyual <[email protected]>
@xinyual
fix sparse encoding bug
418aa30 
Signed-off-by: xinyual <[email protected]>
@xinyual
add UT for sparse encoding and tokenize
1fe20e2 
Signed-off-by: xinyual <[email protected]>
@xinyual
fix downloadAndSplit test
86cc578 
Signed-off-by: xinyual <[email protected]>
@xinyual
fix Helper test
a9cb526 
Signed-off-by: xinyual <[email protected]>
@xinyual
remove meaningless change
e1c9359 
Signed-off-by: xinyual <[email protected]>
@xinyual
remove complie change
31222d0 
Signed-off-by: xinyual <[email protected]>
@xinyual
rename
1214437 
Signed-off-by: xinyual <[email protected]>
@xinyual
fix typo error and simplify wrap code
fdaba84 
Signed-off-by: xinyual <[email protected]>
@xinyual
add comment
4b96a09 
Signed-off-by: xinyual <[email protected]>
@xinyual
using gson and remove useless close logic
185e95b 
Signed-off-by: xinyual <[email protected]>
@xinyual
update comment and import problem
4f8847c 
Signed-off-by: xinyual <[email protected]>
@xinyual
add static idf name
7f04f4c 
Signed-off-by: xinyual <[email protected]>
@xinyual
fix format problem
4e3dc78 
Signed-off-by: xinyual <[email protected]>
@xinyual
extract an abstract model for sparse and dense sentence transformer t…
a837080 
…ranslator

Signed-off-by: xinyual <[email protected]>
@xinyual
fix typo error
dca433a 
Signed-off-by: xinyual <[email protected]>
@xinyual
remove duplicate tokenizer file, fix import problem and add comment f…
73b3f02 
…or tokenizer model

Signed-off-by: xinyual <[email protected]>
@xinyual xinyual temporarily deployed to ml-commons-cicd-env September 27, 2023 01:22 — with GitHub Actions Inactive
@xinyual xinyual temporarily deployed to ml-commons-cicd-env September 27, 2023 01:22 — with GitHub Actions Inactive
@xinyual xinyual closed this Sep 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@b4sjoo b4sjoo Awaiting requested review from b4sjoo b4sjoo is a code owner

@dhrubo-os dhrubo-os Awaiting requested review from dhrubo-os dhrubo-os is a code owner

@jngz-es jngz-es Awaiting requested review from jngz-es jngz-es is a code owner

@model-collapse model-collapse Awaiting requested review from model-collapse model-collapse is a code owner

@rbhavna rbhavna Awaiting requested review from rbhavna rbhavna is a code owner

@wujunshen wujunshen Awaiting requested review from wujunshen

@ylwu-amzn ylwu-amzn Awaiting requested review from ylwu-amzn ylwu-amzn is a code owner

@zane-neo zane-neo Awaiting requested review from zane-neo zane-neo is a code owner

@Zhangxunmt Zhangxunmt Awaiting requested review from Zhangxunmt Zhangxunmt is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@xinyual