Code

POC for segment replication.#2075

Code

Merged

mch2 merged 11 commits intoopensearch-project:feature/segment-replicationopensearch-project/OpenSearch:feature/segment-replicationfrom mch2:feature/segment-replicationmch2/OpenSearch:feature/segment-replicationCopy head branch name to clipboardFeb 22, 2022

+3,802-141

Commits

Commits on Feb 9, 2022

• Initial POC for segment replication.

  Show description for 507bdab
  mch2

  committed
  507bdab

Commits on Feb 15, 2022

• Remove bypass of fsync on primaries and force fsync on replicas.

  Show description for 12bf217
  mch2

  committed
  12bf217

• Fix replicas from processing checkpoints from other indices.

  Show description for fc7ca0b
  mch2

  committed
  fc7ca0b

Commits on Feb 17, 2022

• Remove explicit fsync when every file is copied.

  Show description for a48d1f3
  mch2

  committed
  a48d1f3

Commits on Feb 18, 2022

• Fix recovery states to move to completed during intiial shard recovery and mark the shard as active.

  Show description for b1a0510
  mch2

  committed
  b1a0510

• Ignore replication checkpoints if we are already up to the published checkpoint.

  Show description for 9728020
  mch2

  committed
  9728020

• Fix retention lease invariant in ReplicationTracker.

  Show description for dac3a4a
  mch2

  committed
  dac3a4a

• Fix SegmentReplicationPrimaryService to wait until replica ShardRouting is setup.

  Show description for db0baac
  mch2

  committed
  db0baac

Commits on Feb 21, 2022

• Remove duplicate method to fetch local checkpoint.

  Show description for 7d0c871
  mch2

  committed
  7d0c871

• Fix startup when replicas are not listed in primary's routing table.

  Show description for f619be7
  mch2

  committed
  f619be7

Commits on Feb 22, 2022

• PR cleanup.

  Show description for f646a9e
  mch2

  committed
  f646a9e