Streamis application initialization supports online application import and versioning #67

jefftlin · 2023-03-01T08:55:22Z

What is the purpose of the change

#64

Brief change log

Adjust the order to inspect the savepoint path defined first;
Sort the job version details;
Get latestJobVersion form StreamJobVersion;
Problem in sql expression;
Avoid the ambiguity in sql expression;
Add lastVersion property in the resultSet of querying job list;
Fix the null pointer exception in "/execute/inspect";
Fix the bug of uploading job exception;
Inspections of stream job; Support to define job configuration in meta.json file;
Support to deploy the version of job when the related task not completed.

Verifying this change

View the version upgrade feature in the docs directory and use the feature.

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (no)
Anything that affects deployment: (no)
The Core framework, i.e., JobManager, Server.: (no)

Documentation

Does this pull request introduce a new feature? (yes)
If yes, how is the feature documented? (docs)

… flink will be larger）

Add mysql connector jar.

…ach the tenant label to streamis job; Enable to store the undefined configuration pairs.

…meters that with blank character in job.

…and dss to "1.1.0" and "1.1.3"

…into dev-0.2.0

…-0.2.0

…bState interface

…-0.2.0

…v-0.2.3-log-collector

…ollector New log collector module

* Upgrade the version of pom to 0.2.3 * Minor fix Co-authored-by: jefftlin <[email protected]>

…s.path" fixed WeBankFinTech#56

Fix the problem of transformer component in Streamis

Co-authored-by: jefftlin <[email protected]>

* Add keyword filter strategy in log4j/log4j2. * Use the stream log event timestamp as the enqueue time. * Init the structure of supporting multiple disks/drivers. * Load balancer strategies for storing stream log. * Adjust the default value of configuration. * Add test unit for job log storage. * optimize the restful performance. * Add debug mode in log collector; Add the strategy to discard log cache. * Fix the problem in closing log4j bucket. * Optimize the strategies.

…ted.

…a.json file.

green241 and others added 30 commits March 1, 2022 18:32

Add mysql connector jar.

3d55c1e

Set upload zip file size to 500MB.（Sometimes the fat package built by…

c0be1a0

… flink will be larger）

Merge pull request WeBankFinTech#14 from green241/main

617eae6

Add mysql connector jar.

Fix the problem that fetch workspace users failed.

e4f7b29

Merge remote-tracking branch 'origin/main' into main

804f25b

Fix the problem that alert records will persistent failed by dao.

147003c

modify stoped to stopped

559837e

Fix the problem that method call in circle.

9c458d4

Merge remote-tracking branch 'origin/main' into main

7ecd67f

Add support of extra flink configs.

95d36a5

Consider the situation of no matched configuration in web page

601d0cb

Enable the developer to update/insert the configuration of users; Att…

f0e365c

…ach the tenant label to streamis job; Enable to store the undefined configuration pairs.

Adjust the streamis_ddl.sql

d9fcda6

Adjust the streamis_ddl.sql to accept large value of field

66ab96c

Redefine the project file regex; Filter and replace the specific para…

37faddf

…meters that with blank character in job.

Roll the version to "0.2.0"; Change the dependency version of linkis …

8e4e52e

…and dss to "1.1.0" and "1.1.3"

Init the streamis AppConn

79cf5ab

feat: 【前端】流式应用的 Yarn 执行日志展示

c25fdb0

feat: modify detail tab i18n

f81ad9e

add streamis Appconn

2d7ffa8

Merge branch 'dev-0.2.0' of https://github.com/WeDataSphere/Streamis …

1ea2c62

…into dev-0.2.0

feat: 初步写下前端逻辑，还剩进度条

7b52f8b

Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…

e25ee11

…-0.2.0

update streamis Appconn

54177a8

feat: 失败信息列表也加一下

db7a846

Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…

0cf3cbf

…-0.2.0

Adjust dependency and structure of the job launcher module and add Jo…

f45b3a1

…bState interface

Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…

42b1156

…-0.2.0

Refresh the TODO list

7fc81b2

Adjust the module of job launcher for Linkis.

58bbf27

wushengyeyouya and others added 23 commits October 31, 2022 16:58

Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…

bf06bd1

…v-0.2.3-log-collector

adjust the relation path in pom.xml.

4cda151

Fix the problem in pom.xml of stream job log modules.

6a07287

resolve the LinkisJobInfo is null for adding task.

a0e59b7

Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…

1d933a6

…v-0.2.3-log-collector

Merge pull request WeBankFinTech#54 from WeDataSphere/dev-0.2.3-log-c…

fe00dff

…ollector New log collector module

Upgrade the version of pom to 0.2.3 (WeBankFinTech#55)

95e6643

* Upgrade the version of pom to 0.2.3 * Minor fix Co-authored-by: jefftlin <[email protected]>

Use the "flink.yarn.ship-directories" instead of "flink.app.user.clas…

0e98bab

…s.path" fixed WeBankFinTech#56

Merge pull request WeBankFinTech#57 from WeDataSphere/dev-0.2.3-bugfix

00c93e8

Fix the problem of transformer component in Streamis

Upgrade the version of pom to 0.2.4 (WeBankFinTech#58)

ced5eff

Co-authored-by: jefftlin <[email protected]>

Support to deploy the version of job when the related task not comple…

5ac9a6f

…ted.

Inspections of stream job; Support to define job configuration in met…

b6a1d31

…a.json file.

Fix some problems.

a070d23

Fix the bug of uploading job exception

f28c5ca

Fix the null pointer exception in "/execute/inspect".

3268ae4

Add lastVersion property in the resultSet of querying job list.

d640410

Avoid the ambiguity in sql expression.

e69db11

Problem in sql expression.

2f7980f

Get latestJobVersion form StreamJobVersion

f4d3846

Fix bug of getting inspectName & getLatestJobVersion

09a3a5e

Sort the job version details

b5659fc

Adjust the order to inspect the savepoint path defined first

6ea958a

jefftlin requested a review from Davidhua1996 March 1, 2023 08:57

Alexkun force-pushed the dev-0.2.5-job-version branch from 60f6667 to 4b8ce4f Compare November 29, 2023 05:16

GLeXios force-pushed the dev-0.2.5-job-version branch from 4b8ce4f to 27d7bb9 Compare November 29, 2023 14:55

Alexkun force-pushed the dev-0.2.5 branch from 4052f2f to 466938a Compare November 30, 2023 13:07

Alexkun force-pushed the dev-0.2.5 branch from 466938a to f7b6291 Compare April 15, 2024 13:45

Alexkun force-pushed the dev-0.2.5-job-version branch from 27d7bb9 to 6ea958a Compare December 27, 2024 03:51

Alexkun force-pushed the dev-0.2.5 branch from f7b6291 to 64b9d7e Compare December 27, 2024 04:00

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Streamis application initialization supports online application import and versioning #67

Streamis application initialization supports online application import and versioning #67

jefftlin commented Mar 1, 2023

Streamis application initialization supports online application import and versioning #67

Are you sure you want to change the base?

Streamis application initialization supports online application import and versioning #67

Conversation

jefftlin commented Mar 1, 2023

What is the purpose of the change

Brief change log

Verifying this change

Does this pull request potentially affect one of the following parts:

Documentation