[SD-517] Upgrade data_pipelines to 2.0#559

Draft

vincent-gao wants to merge 3 commits intodevelopfrom feature/SD-517-upgrade-datapipelines

+169-212

Commits on Nov 29, 2024

[SD-517] Upgrade data_pipelines to 2.0
vincent-gao
committed

Commits on Dec 9, 2024

remove the incompatible class
vincent-gao
committed

Commits on Dec 11, 2024

Make some necessary changes to meet the requirements of elasticsearch_connector 8.x
vincent-gao
committed