add 1.4.0 version to latest (#745)

* add 1.4.0 version to latest * update path * update content * update doc
apache · Aug 5, 2023 · 5ac061a · 5ac061a
1 parent 2de1ec8
commit 5ac061a
Show file tree

Hide file tree

Showing 648 changed files with 78,453 additions and 6,499 deletions.
diff --git a/docs/deployment/deploy-quick.md b/docs/deployment/deploy-quick.md
diff --git a/docs/feature/other.md b/docs/feature/other.md
@@ -3,28 +3,26 @@ title: Description of other features
 sidebar_position: 0.6
 ---
 
-## 1. Linkis 1.4.0 other feature upgrade instructions
-
-### 1.1 Do not kill EC when ECM restarts
+## 1. Do not kill EC when ECM restarts
 When the ECM restarts, there is an option not to kill the engine, but to take over the existing surviving engine. Makes the Engine Connection Manager (ECM) service stateless.
 
-### 1.2 Remove json4s dependency
+## 2. Remove json4s dependency
 Different versions of spark depend on different json4s versions, which is not conducive to the support of multiple versions of spark. We need to reduce this json4s dependency and remove json4s from linkis.
 For example: spark2.4 needs json4s v3.5.3, spark3.2 needs json4s v3.7.0-M11.
 
-### 1.3 EngineConn module definition depends on engine version
-The version definition of the engine is in `EngineConn` by default. Once the relevant version changes, it needs to be modified in many places. We can put the relevant version definition in the top-level pom file. When compiling a specified engine module, it needs to be compiled in the project root directory, and use `-pl` to compile the specific engine module, for example:
+## 3. EngineConn module definition depends on engine version
+The version definition of the engine is in `EngineConn` by default. Once the relevant version is changed, it needs to be modified in many places. We can put the relevant version definition in the top-level pom file. When compiling a specified engine module, it needs to be compiled in the project root directory, and use `-pl` to compile the specific engine module, for example:
 ```
 mvn install package -pl linkis-engineconn-plugins/spark -Dspark.version=3.2.1
 ```
 The version of the engine can be specified by the -D parameter of mvn compilation, such as -Dspark.version=xxx, -Dpresto.version=0.235
-At present, all underlying engine versions have been moved to the top-level pom file. When compiling a specified engine module, it needs to be compiled in the project root directory, and `-pl` is used to compile the specific engine module.
+At present, all the underlying engine versions have been moved to the top-level pom file. When compiling the specified engine module, it needs to be compiled in the project root directory, and `-pl` is used to compile the specific engine module.
 
-### 1.4 Linkis Main Version Number Modification Instructions
+## 4. Linkis main version number modification instructions
 
 Linkis will no longer be upgraded by minor version after version 1.3.2. The next version will be 1.4.0, and the version number will be 1.5.0, 1.6.0 and so on. When encountering a major defect in a released version that needs to be fixed, it will pull a minor version to fix the defect, such as 1.4.1.
 
 
-## 1.5 LInkis code submission main branch description
+## 5. LInkis code submission main branch instructions
 
 The modified code of Linkis 1.3.2 and earlier versions is merged into the dev branch by default. In fact, the development community of Apache Linkis is very active, and new development requirements or repair functions will be submitted to the dev branch, but when users visit the Linkis code base, the master branch is displayed by default. Since we only release a new version every quarter, it seems that the community is not very active from the perspective of the master branch. Therefore, we decided to merge the code submitted by developers into the master branch by default starting from version 1.4.0.
diff --git a/docs/feature/overview.md b/docs/feature/overview.md
@@ -5,12 +5,12 @@ sidebar_position: 0.1
 
 - [Base engine dependencies, compatibility, default version optimization](./base-engine-compatibilty.md)
 - [Hive engine connector supports concurrent tasks](./hive-engine-support-concurrent.md)
-- [Support more data sources](./spark-etl.md)
-- [linkis-storage supports S3 file systems (Experimental version)](../deployment/deploy-quick#s3-mode-optional)
-- [Add postgresql database support (Experimental version)](../deployment/deploy-quick#22-configure-database)
-- [Add impala engine support（Experimental version）](../engine-usage/impala.md)
+- [Support more datasources](../user-guide/datasource-manual#31-jdbc-datasource)
 - [Spark ETL enhancements](./spark-etl.md)
 - [Generate SQL from data source](./datasource-generate-sql.md)
+- [linkis-storage supports S3 file system (experimental version)](../deployment/deploy-quick#343-s3-mode)
+- [add postgresql database support (experimental version)](../deployment/deploy-quick#22-configuration database information)
+- [Add impala engine support (experimental version)](../engine-usage/impala.md)
 - [Other feature description](./other.md)
 - [version of Release-Notes](/download/release-notes-1.4.0)
 
@@ -25,7 +25,8 @@ sidebar_position: 0.1
 | mg-eureka | new | eureka.instance.lease-expiration-duration-in-seconds | 12 | eureka waits for the next heartbeat timeout (seconds)|
 | EC-shell | Modify | wds.linkis.engineconn.support.parallelism | true | Whether to enable parallel execution of shell tasks |
 | EC-shell | Modify | linkis.engineconn.shell.concurrent.limit | 15 | Concurrent number of shell tasks |
-| Entrance  | Modify | linkis.entrance.auto.clean.dirty.data.enable | true | Whether to clean dirty data during startup |
+| Entrance | Modify | linkis.entrance.auto.clean.dirty.data.enable | true | Whether to clean dirty data at startup |
+
 
 
 ## Database table changes

diff --git a/docs/feature/spark-etl.md b/docs/feature/spark-etl.md
@@ -61,7 +61,7 @@ sh ./bin/linkis-cli -engineType spark-3.2.1 -codeType data_calc -code "{\"plugin
 ```
 ### 4.3 Synchronization json script description of each data source
 
-### 4.3.1 jdbc
+#### 4.3.1 jdbc
 
 Configuration instructions
 ```text
@@ -127,7 +127,7 @@ kingbase8-8.6.0.jar
 postgresql-42.3.8.jar
 ```
 
-### 4.3.2 file
+#### 4.3.2 file
 
 Configuration instructions
 
@@ -173,7 +173,7 @@ Need to add new jar
 spark-excel-2.12.17-3.2.2_2.12-3.2.2_0.18.1.jar
 ```
 
-### 4.3.3 redis
+#### 4.3.3 redis
 
 ```text
 sourceTable: source table,
@@ -225,7 +225,7 @@ commons-pool2-2.8.1.jar
 spark-redis_2.12-2.6.0.jar
 ```
 
-### 4.3.4 kafka
+#### 4.3.4 kafka
 
 Configuration instructions
 ```text
@@ -302,7 +302,7 @@ spark-sql-kafka-0-10_2.12-3.2.1.jar
 spark-token-provider-kafka-0-10_2.12-3.2.1.jar
 ```
 
-###elasticsearch
+#### 4.3.5 elasticsearch
 
 Configuration instructions
 ```text
@@ -380,7 +380,7 @@ Need to add new jar
 elasticsearch-spark-30_2.12-7.17.7.jar
 ```
 
-###mongo
+#### 4.3.6 mongo
 
 Configuration instructions
 ```text
@@ -461,7 +461,7 @@ mongodb-driver-core-3.12.8.jar
 mongodb-driver-sync-3.12.8.jar
 ```
 
-###delta
+#### 4.3.7 delta
 
 Configuration instructions
 ```text
@@ -539,7 +539,7 @@ delta-core_2.12-2.0.2.jar
 delta-storage-2.0.2.jar
 ```
 
-###hudi
+#### 4.3.8 hudi
 
 Configuration instructions
 ```text

diff --git a/docusaurus.config.js b/docusaurus.config.js
@@ -41,10 +41,10 @@ const darkCodeTheme = require('prism-react-renderer/themes/dracula');
           editUrl: 'https://github.com/apache/linkis-website/edit/dev/',
           versions: {
             current: {
-              path: '1.4.0',
-              label: 'Next(1.4.0)'
+              path: '1.5.0',
+              label: 'Next(1.5.0)'
             },
-            '1.3.2': {
+            '1.4.0': {
               path: 'latest',
             },
           }
@@ -161,12 +161,13 @@ const darkCodeTheme = require('prism-react-renderer/themes/dracula');
           label: 'Doc',
           position: 'right',
           items: [
-            {label: '1.3.2', to: '/docs/latest/about/introduction'},
+            {label: '1.4.0', to: '/docs/latest/about/introduction'},
+            {label: '1.3.2', to: '/docs/1.3.2/about/introduction'},
             {label: '1.3.1', to: '/docs/1.3.1/about/introduction'},
             {label: '1.3.0', to: '/docs/1.3.0/introduction'},
             {label: '1.2.0', to: '/docs/1.2.0/introduction'},
             {label: '1.1.1', to: '/docs/1.1.1/introduction'},
-            {label: 'Next(1.4.0)', to: '/docs/1.4.0/about/introduction'},
+            {label: 'Next(1.5.0)', to: '/docs/1.5.0/about/introduction'},
             {label: 'All Version', to: '/versions'}
           ]
         },
@@ -356,7 +357,7 @@ const darkCodeTheme = require('prism-react-renderer/themes/dracula');
         createRedirects(existingPath) {
           if (existingPath.includes('/latest')) {
             return [
-              existingPath.replace('/latest', '/1.3.2'),
+              existingPath.replace('/latest', '/1.4.0'),
             ];
           }
           return undefined; // Return a false value: no redirect created

diff --git a/download/main.md b/download/main.md
@@ -9,6 +9,7 @@ Use the links below to download the Apache Linkis Releases, the latest release i
 
 | Version                                      | Release Date | Source                                                                                                                                                                                                                                                                                                                                                                  | Binary                                                                                                                                                                                                                                                                                                                                                                  | Web Binary                                                                                                                                                                                                                                                                                                                                                                           | Release Notes                           |
 |----------------------------------------------|--------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------|
+| 1.4.0 | 2023-08-05   | [[Source](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-src.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-src.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-src.tar.gz.sha512)] | [[Binary](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-bin.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-bin.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-bin.tar.gz.sha512)] | [[Binary](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-web-bin.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-web-bin.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/1.4.0/apache-linkis-1.4.0-web-bin.tar.gz.sha512)] | [Release-Notes](release-notes-1.4.0.md) |
 | 1.3.2 | 2023-04-03   | [[Source](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-src.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-src.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-src.tar.gz.sha512)] | [[Binary](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-bin.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-bin.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-bin.tar.gz.sha512)] | [[Binary](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-web-bin.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-web-bin.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/1.3.2/apache-linkis-1.3.2-web-bin.tar.gz.sha512)] | [Release-Notes](release-notes-1.3.2.md) |
 | 1.3.1  | 2023-01-18   | [[Source](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-src.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-src.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-src.tar.gz.sha512)] | [[Binary](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-bin.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-bin.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-bin.tar.gz.sha512)] | [[Binary](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-web-bin.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-web-bin.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/linkis/release-1.3.1/apache-linkis-1.3.1-web-bin.tar.gz.sha512)] | [Release-Notes](release-notes-1.3.1.md) |
 | 1.3.0  | 2022-10-25   | [[Source](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-src.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-src.tar.gz.asc)] [[SHA512](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-src.tar.gz.sha512)] | [[Binary](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-bin.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-bin.tar.gz.asc) ][[SHA512](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-bin.tar.gz.sha512)] | [[Binary](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-web-bin.tar.gz)] [[Sign](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-web-bin.tar.gz.asc )] [[SHA512](https://www.apache.org/dyn/closer.lua/incubator/linkis/release-1.3.0/apache-linkis-1.3.0-incubating-web-bin.tar.gz.sha512)] | [Release-Notes](release-notes-1.3.0.md) |