Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document index upgrades #117

Open
ato opened this issue Aug 17, 2023 · 1 comment
Open

Document index upgrades #117

ato opened this issue Aug 17, 2023 · 1 comment

Comments

@ato
Copy link
Member

ato commented Aug 17, 2023

Currently the upgrade process looks like:

  1. Start OutbackCDX with desired --index-version option.
  2. curl -XPOST http://localhost:8080/myindex/upgrade to start the upgrade.
  3. The server will periodically log progress, note that the remaining time/records estimate is extremely inaccurate.

Upgrading may temporarily require double the disk space. If space is tight that maybe could worked around by periodic compacting at the expense of processing time.

If the upgrade is interrupted by a server restart it's safe to start the upgrade again. It'll scan through the records from the beginning and then continue where it left off.

Downgrading should also work as long as the index doesn't contain any records with extra JSON fields. Hasn't been test though.

The index should still be usable while it has a mix of record versions but there may be corner cases issues around deleting or replacing existing records. Inserting new records during the upgrade should be OK.

@kaij
Copy link
Contributor

kaij commented Aug 17, 2023

The upgrade worked absolutely flawless and fast on our test environment. Also CDXJ indexing worked after upgrade was done (for an existing record).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants