Feature/support dbr 15.x

[pariksheet]

Update python dependancies to resolve conflict with DBR15.x also support DBR 11.x and above.

Description

System requirement for DBR15

System environment
Operating System: Ubuntu 22.04.4 LTS

Java: Zulu 8.78.0.19-CA-linux64
Scala: 2.12.18
Python: 3.11.0
R: 4.3.2
Delta Lake: 3.2.0

Related Issue

Motivation and Context

How Has This Been Tested?

on databricks workflows using 15.4 LTS.

Screenshots (if appropriate):

Types of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

• My code follows the code style of this project.
• My change requires a change to the documentation.
• I have updated the documentation accordingly.
• I have read the CONTRIBUTING document.
• I have added tests to cover my changes.
• All new and existing tests passed.

[asingamaneni]

LGTM