[Feature Request] Create setting to disable CompoundFile usage

[sam-herman]

Is your feature request related to a problem? Please describe

At the moment this is impossible to choose whether we want our indices to use a compound file and the InternalEngine automatically set that to "true", see here for reference.

Avoiding the compound file can sometime be important for debugging purposes when a customer is trying to look at the Lucene files structure to determine for any issues, or alternatively in cases where we want to change codec and expose the OpenSearch Lucene index files in a snapshot to be read by a different system.
For example we might want to convert our doc values or StoredDocs to Parquet and read those from snapshot later by leveraging Apache Spark.

Describe the solution you'd like

Allow to set the "useCompoundFile" format via a setting.

Related component

Indexing

Describe alternatives you've considered

NA

Additional context

No response

[peternied]

[Triage - attendees 1 2 3 4 5 6 7 8]
@samuel-oci Thanks for creating this issue, thanks for creating a pull request!