Code

Ppl spark join command#69

Code

Merged

YANG-DB merged 60 commits intoopensearch-project:mainopensearch-project/opensearch-spark:mainfrom YANG-DB:ppl-spark-join-commandYANG-DB/opensearch-spark:ppl-spark-join-commandCopy head branch name to clipboardDec 14, 2023

+1,817-684

Commits

Commits on Aug 23, 2023

• adding support for containerized flint with spark / Livy docker-compose.yml

  Show description for 62c12cc
  YANG-DB

  committed
  62c12cc

• adding support for containerized flint with spark / Livy docker-compose.yml

  Show description for 9e6ecfc
  YANG-DB

  committed
  9e6ecfc

Commits on Sep 1, 2023

• adding support for containerized flint with spark / Livy docker-compose.yml

  Show description for 0808ea5
  YANG-DB

  committed
  0808ea5

• Merge branch 'main' into containerize_flint

  YANG-DB

  committed
  1b2ae06

• adding support for containerized flint with spark / Livy docker-compose.yml

  Show description for 91defa0
  YANG-DB

  committed
  91defa0

• update ppl ast builder

  Show description for 0febc09
  YANG-DB

  committed
  0febc09

• add ppl ast components

  Show description for 18cd83f
  YANG-DB

  committed
  18cd83f

• populate ppl test suit for covering different types of PPL queries

  Show description for 605f1bf
  YANG-DB

  committed
  605f1bf

• update additional tests

  Show description for d54530d
  YANG-DB

  committed
  d54530d

Commits on Sep 6, 2023

• separate ppl-spark code into a dedicated module

  Show description for 72dc5f7
  YANG-DB

  committed
  72dc5f7

• add ppl translation of simple filter and data-type literal expression

  Show description for d953b19
  YANG-DB

  committed
  d953b19

• remove none-used ppl ast builder

  Show description for 9fce31e
  YANG-DB

  committed
  9fce31e

• add log-plan test results validation

  Show description for a299bdf
  YANG-DB

  committed
  a299bdf

• add support for multiple table selection using union

  Show description for 019f690
  YANG-DB

  committed
  019f690

Commits on Sep 7, 2023

• add support for multiple table selection using union

  Show description for 0c7ccec
  YANG-DB

  committed
  0c7ccec

• update sbt with new IT test suite for PPL module

  Show description for 14fa7e5
  YANG-DB

  committed
  14fa7e5

• update ppl IT suite test

  Show description for d55b774
  YANG-DB

  committed
  d55b774

• update ppl IT suite dependencies

  Show description for 8bbe0d9
  YANG-DB

  committed
  8bbe0d9

• add tests for ppl IT with

  Show description for af065f7
  YANG-DB

  committed
  af065f7

• update literal transformations according to catalyst's convention

  Show description for 5819dc7
  YANG-DB

  committed
  5819dc7

• separate unit-tests into a dedicated file per each test category

  Show description for 7db7213
  YANG-DB

  committed
  7db7213

• add IT tests for additional filters

  Show description for 32573ab
  YANG-DB

  committed
  32573ab

• mark unsatisfied tests as ignored until supporting code is ready

  Show description for eec0e4a
  YANG-DB

  committed
  eec0e4a

Commits on Sep 8, 2023

• add README.md design and implementation details

  Show description for 3f9d9d1
  YANG-DB

  committed
  3f9d9d1

• Merge branch 'main' into ppl-spark-translation

  Show description for 3dbb5bb
  YANG-DB

  committed
  3dbb5bb

• remove docker related files

  Show description for 67fd56a
  YANG-DB

  committed
  67fd56a

Commits on Sep 10, 2023

• add text related unwrapping bug - fix

  Show description for 89dd114
  YANG-DB

  committed
  89dd114

Commits on Sep 11, 2023

• add AggregatorTranslator support

  Show description for 65f4372
  YANG-DB

  committed
  65f4372

• resolve group by issues

  Show description for 00e2a76
  YANG-DB

  committed
  00e2a76

• add generic ppl extension chain which registers a chain of parsers

  Show description for 17e93fb
  YANG-DB

  committed
  17e93fb

• update some tests

  Show description for 69df8ad
  YANG-DB

  committed
  69df8ad

Commits on Sep 12, 2023

• add filter test with stats

  Show description for 4a4d73a
  YANG-DB

  committed
  4a4d73a

• add support for AND / OR

  Show description for ca5ec65
  YANG-DB

  committed
  ca5ec65

• add additional unit tests support for AND / OR

  Show description for ce70d19
  YANG-DB

  committed
  ce70d19

• Merge branch 'main' into ppl-spark-translation

  YANG-DB

  committed
  d5f33b0

• add Max,Min,Count,Sum aggregation functions support

  Show description for fe11134
  YANG-DB

  committed
  fe11134

Commits on Sep 13, 2023

• add basic span support for aggregate based queries

  Show description for 7e5e0d1
  YANG-DB

  committed
  7e5e0d1

• update supported PPL and roadmap for future support ppl commands...

  Show description for dbfd82a
  YANG-DB

  committed
  dbfd82a

• update readme doc

  Show description for eaa4e33
  YANG-DB

  committed
  eaa4e33

• add head support

  Show description for 157bbb7
  YANG-DB

  committed
  157bbb7

Commits on Sep 14, 2023

• add support for sort command

  Show description for 20385c1
  YANG-DB

  committed
  20385c1

• update supported command in readme

  Show description for 7c0fd36
  YANG-DB

  committed
  7c0fd36

Commits on Sep 18, 2023

• add initial join command for ppl grammar

  Show description for aaa4831
  YANG-DB

  committed
  aaa4831

Commits on Oct 6, 2023

• Merge branch 'main' into ppl-spark-join-command

  Show description for aee86d6
  YANG-DB

  committed
  aee86d6

• update correlation command

  Show description for e9d1589
  YANG-DB

  committed
  e9d1589

Commits on Oct 8, 2023

• update correlation command

  Show description for f998427
  YANG-DB

  committed
  f998427

Commits on Oct 11, 2023

• update correlation command

  Show description for 4ee2fbf
  YANG-DB

  committed
  4ee2fbf

• Merge branch 'main' into ppl-spark-join-command

  YANG-DB

  committed
  b632f70

• fix testScalastyle issues

  Show description for 1258dc5
  YANG-DB

  committed
  1258dc5

• add correlation tests

  Show description for 63ece19
  YANG-DB

  committed
  63ece19

• ignore not completed tests - for build purpose

  Show description for 9b0251c
  YANG-DB

  committed
  9b0251c

Commits on Oct 14, 2023

• update correlation related traversal

  Show description for 400fbad
  YANG-DB

  committed
  400fbad

Commits on Oct 17, 2023

• add assertion tests for failing correlation conditions

  Show description for 2c23149
  YANG-DB

  committed
  2c23149

• remove un-implemented tests

  Show description for e1735b2
  YANG-DB

  committed
  e1735b2

Commits on Oct 19, 2023

• Merge branch 'main' into ppl-spark-join-command

  YANG-DB

  committed
  bb16e7a

• update according to scalastyle

  Show description for c6649ad
  YANG-DB

  committed
  c6649ad

• set the correlation scope parameter as optional

  Show description for a3df76f
  YANG-DB

  committed
  a3df76f

• update scala-fmt style

  Show description for 41fc9f4
  YANG-DB

  committed
  41fc9f4

• remove merged file that was previously removed

  Show description for 23d3dff
  YANG-DB

  committed
  23d3dff

• update scala style fmt

  Show description for cca23b4
  YANG-DB

  committed
  cca23b4