Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dump bmp #2349

Closed
wants to merge 53 commits into from
Closed

Dump bmp #2349

wants to merge 53 commits into from

Conversation

vsian
Copy link
Contributor

@vsian vsian commented Dec 10, 2024

What problem does this PR solve?

Dump bmp index by memory usage.

Type of change

  • New Feature (non-breaking change which adds functionality)
  • Test cases

@vsian vsian added the ci PR can be test label Dec 10, 2024
@vsian vsian added ci PR can be test and removed ci PR can be test labels Dec 10, 2024
vsian and others added 18 commits December 13, 2024 10:18
### What problem does this PR solve?

Restart tests for ivf dump when threshold is reached.

### Type of change

- [x] Test cases
### What problem does this PR solve?

1. Admin mode with starting status
2. Admin mode shouldn't allow to switch to leader/follower/learner mode
when storage type is 'local'.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

---------

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Refactoring

---------

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

Update fulltext query builder
Apply BatchOrIterator when necessary

Issue link:infiniflow#1320

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Refactoring
- [x] Performance Improvement
### What problem does this PR solve?

HTTP API of SET ROLE isn't given correct error message.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

---------

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

Update HTTP API: Add remove node

### Type of change

- [x] Documentation Update

---------

Signed-off-by: Jin Hai <[email protected]>
Co-authored-by: writinwaters <[email protected]>
### What problem does this PR solve?

1. Fix tmp file not remove
2. Fix get const column vector
3. Fix parallel compact and create index.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
…nfiniflow#2322)

### What problem does this PR solve?

distance_factors / similarity_factors / score_factors are special
functions like distance, similarity and score, can be used to debug the
calculation.

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Python SDK impacted, Need to update PyPI

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

Fix bmp index algorithm.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Test cases
### What problem does this PR solve?

_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

---------

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

This variable can be used to check the disk IO issue.

### Type of change

- [x] New Feature (non-breaking change which adds functionality)

---------

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?


### Type of change


- [x] Documentation Update
### What problem does this PR solve?

Issue link:infiniflow#2305

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] New Feature (non-breaking change which adds functionality)
### What problem does this PR solve?

Issue link:#[Link the issue here]

### Type of change


- [x] Documentation Update
### What problem does this PR solve?

Show disk cache miss

### Type of change

- [x] New Feature (non-breaking change which adds functionality)

---------

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

Minor nitpicking changes.

### Type of change

- [x] Documentation Update
### What problem does this PR solve?

- Fix corruption during parallel indexing
- Enable none smart mode

Issue link:infiniflow#2305

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] New Feature (non-breaking change which adds functionality)
### What problem does this PR solve?

Update file io for fulltext search
Disable log in phrase iterator in release build

Issue link:infiniflow#1320

### Type of change

- [x] Refactoring
- [x] Performance Improvement
small-turtle-1 and others added 27 commits December 13, 2024 10:18
### What problem does this PR solve?

Fix: add type check in parquet file import.
Fix: minio port conflict.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Test cases
### What problem does this PR solve?

Fix secondary index bug

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Breaking Change (fix or feature that could cause existing
functionality not to work as expected)
- [x] Refactoring
### What problem does this PR solve?


### Type of change


- [x] Documentation Update
### What problem does this PR solve?

Stop loading unnecessary data for the filter.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Refactoring
- [x] Performance Improvement
### What problem does this PR solve?

Fix restart bug

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

Signed-off-by: Jin Hai <[email protected]>
### Type of change

- [x] New Feature (non-breaking change which adds functionality)
Resolve cycle compiling dependency

- [x] Bug Fix (non-breaking change which fixes an issue)

---------

Signed-off-by: Jin Hai <[email protected]>
…w#2348)

### What problem does this PR solve?

_Briefly describe what this PR aims to solve. Include background context
that will help reviewers understand the purpose of the PR._

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] New Feature (non-breaking change which adds functionality)

---------

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?


### Type of change


- [x] Documentation Update
### What problem does this PR solve?

Fix table lock bug when creating a read txn.

Issue link:infiniflow#2321

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Test cases
### What problem does this PR solve?

Support whitespace analyzer for fulltext index

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update
- [x] Refactoring
- [x] Test cases
### What problem does this PR solve?

Search option

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update

---------

Signed-off-by: Jin Hai <[email protected]>
Co-authored-by: writinwaters <[email protected]>
### What problem does this PR solve?

Add 3 new config parameter for dense/sparse/fulltext index building

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update

---------

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

Fix restart problem after checkpoint & alter
Fix restart problem after checkpoint & compact
Add coresponding test case.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Test cases
### What problem does this PR solve?

Fix data race.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

Update version info of v0.5.0-dev6

### Type of change

- [x] Documentation Update
- [x] Python SDK impacted, Need to update PyPI

Signed-off-by: Jin Hai <[email protected]>
### What problem does this PR solve?

Fix catalog json compatibility with older version.

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
### What problem does this PR solve?

Refactor python SDK code

### Type of change

- [x] Refactoring
- [x] Python SDK impacted, Need to update PyPI

Signed-off-by: Jin Hai <[email protected]>
@vsian vsian closed this Dec 13, 2024
@vsian vsian deleted the dump_bmp branch December 13, 2024 02:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci PR can be test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants