[FEATURE] Rest API Support in the SDK

[bogdanghit]

Is your feature request related to a problem? Please describe.
Existing connection dialog details requires going back and forth between Tableau and DBR backend. We want to avoid having to copy paste connection details from the backend to the connection dialog.

Describe the solution you'd like
Currently the Databricks connector requires setting up a specific endpoint (cluster) to connect to in the form of an HTTP Path field. We would like to have the ability to leverage the Databricks REST API 2.0. We want to replace the manual setting of the HTTP Path field by doing a REST API call to the Server Hostname using the token.

We propose the following changes:

1. Pass the Workspace URL (workspaceId is currently included in the HTTP Path field) instead of Server Hostname
   Provide Auth details and click Sign In
2. In the backend, the connector makes a REST API call to list either all available clusters if PAT is used, or all passthrough-enabled clusters if AAD is used
3. The connector populates a drop-down with the list of clusters retrieved
4. The user selects the cluster to connect to.

About You
Name: Bogdan Ghit
Company: Databricks

[VasanthiNeelagiri]

Hi, I am a new PM for the Connector SDK and I am looking at our feature backlog and getting things prioritized. I would appreciate if you can give your feedback for our product via this form. It should only take 2-5 mins but would be super valuable to our team. Thanks in advance!!
https://docs.google.com/forms/d/e/1FAIpQLSfs5OreNsxnva_uTO2vTxnoF-oq-37tEdrUpirUKwqud2Ib7g/viewform?usp=sf_link