[Question]Packages and libraries

[aimtsou]

There is some inconsistency between the docs and the packages:

For the Delta Sharing Server:

• In the GitHub release page we have the delta-sharing server as of version 1.0.4
• The docker image in the official repository is not in version 1.0.4, so it needs an update.

For being able to read the delta tables with the Delta Sharing Server we need, Apache connector

• Delta Sharing Java Library, which in the docs appears as io.delta:delta-sharing-spark_2.12:0.6.4, although in maven latest vetsion 3.1.0, which is bigger in size and released after 1.0.4. What are their differences?

If we user the python connector, delta-sharing it is being in version 1.0.3, is that correct or it should align with the versioning of delta sharing server?

[linzhou-db]

Hi, thanks for your questions!
The versions for delta-sharing-server, delta-sharing python connector and delta-sharing-spark are independent with each other.

• It is true that the latest delta-sharing-spark is 3.1.0, which is able to read shared DV tables.
• The latest delta-sharing python connector is 1.0.3, but it uses the latest delta-sharing-spark installed on your machine when calling load_as_spark, not restricted to the python connector version. 

We'll update our doc to make it more clear.

[aimtsou]

Hi @linzhou-db,

Thanks for the clarification, more or less what I understood from my research but now it is confirmed.
I can help you with the docs if needed.

It would be nice if we could get the newest docker image for delta sharing server.

[aimtsou]

@linzhou-db:
The release page has started to be confusing.

• There are different versions of Delta Sharing 1.2.0, 1.1.3, 0.7.10
• Delta Sharing Client versions, which we should call them probably delta sharing client instead of python
• Delta Sharing spark versions, without definition

None of the releases are actual releases since there is no binaries after version 1.0.5 at least for server.
For client we have it on pypi
Also there is no explanation what is the purpose of the packages in the docs.

I can help in some parts of the documentation.