[SPARK-49284][CONNECT][SQL] Create a shared Catalog interface

### What changes were proposed in this pull request? This PR creates a shared Catalog interface. We also move the interfaces to sql/api. ### Why are the changes needed? We are creating a shared Scala Spark SQL interface for Classic and Connect. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Existing tests. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #47991 from hvanhovell/SPARK-49284. Lead-authored-by: Herman van Hovell <[email protected]> Co-authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Hyukjin Kwon <[email protected]>
apache · Sep 6, 2024 · 68718fe · 68718fe
1 parent 13a102d
commit 68718fe
Show file tree

Hide file tree

Showing 9 changed files with 915 additions and 1,464 deletions.
diff --git a/connector/connect/client/jvm/src/main/scala/org/apache/spark/sql/SparkSession.scala b/connector/connect/client/jvm/src/main/scala/org/apache/spark/sql/SparkSession.scala
@@ -230,12 +230,7 @@ class SparkSession private[sql] (
 
   lazy val streams: StreamingQueryManager = new StreamingQueryManager(this)
 
-  /**
-   * Interface through which the user may create, drop, alter or query underlying databases,
-   * tables, functions etc.
-   *
-   * @since 3.5.0
-   */
+  /** @inheritdoc */
   lazy val catalog: Catalog = new CatalogImpl(this)
 
   /** @inheritdoc */