Adding multi-process extraction to create_workloads

[AkshathRaghav]

Description

Adding multi-process functionality that works concurrently.

Issues Resolved

#375

Testing

• Tested if the create_workloads completes, and checks if it runs properly.

REQUEST FOR HELP:
Below, is the sample output for the create_workloads with multi-processing. The render_progress is not working as expected, I have added a lock() to not overload and print for every thread thats running, but it doesn't seem to be working. Please help if you can!

╭─aksha@Akshaths-PC ~/Workbench/opensearch-benchmark ‹AkshathRaghav/multi_process_index_extraction●› 
╰─$ opensearch-benchmark create-workload \
--workload=flights \
--target-host="https://127.0.0.1:9200" \
--client-options="basic_auth_user:'admin',basic_auth_password:'admin'" \
--output-path=~/Workbench/Workloads \
--indices=opensearch_dashboards_sample_data_flights \
--number-of-docs opensearch_dashboards_sample_data_flights:2500 \
--client-options="timeout:300,use_ssl:true,verify_certs:false,basic_auth_user:'admin',basic_auth_password:'admin'" \


   ____                  _____                      __       ____                  __                         __
  / __ \____  ___  ____ / ___/___  ____ ___________/ /_     / __ )___  ____  _____/ /_  ____ ___  ____ ______/ /__
 / / / / __ \/ _ \/ __ \\__ \/ _ \/ __ `/ ___/ ___/ __ \   / __  / _ \/ __ \/ ___/ __ \/ __ `__ \/ __ `/ ___/ //_/
/ /_/ / /_/ /  __/ / / /__/ /  __/ /_/ / /  / /__/ / / /  / /_/ /  __/ / / / /__/ / / / / / / / / /_/ / /  / ,<
\____/ .___/\___/_/ /_/____/\___/\__,_/_/   \___/_/ /_/  /_____/\___/_/ /_/\___/_/ /_/_/ /_/ /_/\__,_/_/  /_/|_|
    /_/

[INFO] Connected to OpenSearch cluster [opensearch-node1] version [2.11.0].

Extracting documents for index [opensearch_dashboards_sampl...     2/1000 docs [0.2% done]                       Extracting documents for index [opensearch_dashboards_sampl...     3/1000 docs [0.3% done]                       Extracting documents for index [opensearch_dashboards_sa...     251/1000 docs [25.1% done]                       Extracting documents for index [opensearch_dashboards_sa...     252/1000 docs [25.2% done]                       Extracting documents for index [opensearch_dashboards_sa...     627/1000 docs [62.7% done]                       Extracting documents for index [opensearch_dashboards_sa...     253/1000 docs [25.3% done]                       Extracting documents for index [opensearch_dashboards_sa...     501/1000 docs [50.1% done]                       Extracting documents for index [opensearch_dashboards_sa...     875/1000 docs [87.5% done]                       Extracting documents for index [opensearch_dashboards_sampl...     2/2500 docs [0.1% done]                       Extracting documents for index [opensearch_dashboards_sa...     626/2500 docs [25.0% done]                       Extracting documents for index [opensearch_dashboards_sampl...     4/2500 docs [0.2% done]                       Extracting documents for index [opensearch_dashboards_s...     1562/2500 docs [62.5% done]                       Extracting documents for index [opensearch_dashboards_s...     1874/2500 docs [75.0% done]                       Extracting documents for index [opensearch_dashboards_sa...     316/2500 docs [12.6% done]                       Extracting documents for index [opensearch_dashboards_s...     1250/2500 docs [50.0% done]                       Extracting documents for index [opensearch_dashboards_sa...     936/2500 docs [37.4% done]                       Extracting documents for index [opensearch_dashboards_s...     2496/2500 docs [99.8% done]
[INFO] Workload flights has been created. Run it with: opensearch-benchmark --workload-path=/home/aksha/Workbench/Workloads/flights

-------------------------------
[INFO] SUCCESS (took 5 seconds)
-------------------------------

---

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.