Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Streamis application initialization supports online application import and versioning #67

Open
wants to merge 650 commits into
base: dev-0.2.5
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
650 commits
Select commit Hold shift + click to select a range
3d55c1e
Add mysql connector jar.
green241 Mar 1, 2022
c0be1a0
Set upload zip file size to 500MB.(Sometimes the fat package built by…
green241 Mar 1, 2022
617eae6
Merge pull request #14 from green241/main
wushengyeyouya Mar 1, 2022
e4f7b29
Fix the problem that fetch workspace users failed.
wushengyeyouya Mar 2, 2022
804f25b
Merge remote-tracking branch 'origin/main' into main
wushengyeyouya Mar 2, 2022
147003c
Fix the problem that alert records will persistent failed by dao.
wushengyeyouya Mar 2, 2022
559837e
modify stoped to stopped
Mar 7, 2022
9c458d4
Fix the problem that method call in circle.
wushengyeyouya Apr 1, 2022
7ecd67f
Merge remote-tracking branch 'origin/main' into main
wushengyeyouya Apr 1, 2022
95d36a5
Add support of extra flink configs.
wushengyeyouya Apr 6, 2022
601d0cb
Consider the situation of no matched configuration in web page
Davidhua1996 Apr 17, 2022
f0e365c
Enable the developer to update/insert the configuration of users; Att…
Davidhua1996 Apr 17, 2022
d9fcda6
Adjust the streamis_ddl.sql
Davidhua1996 Apr 17, 2022
66ab96c
Adjust the streamis_ddl.sql to accept large value of field
Davidhua1996 Apr 18, 2022
37faddf
Redefine the project file regex; Filter and replace the specific para…
Davidhua1996 May 5, 2022
8e4e52e
Roll the version to "0.2.0"; Change the dependency version of linkis …
Davidhua1996 May 10, 2022
79cf5ab
Init the streamis AppConn
Davidhua1996 May 10, 2022
c25fdb0
feat: 【前端】流式应用的 Yarn 执行日志展示
May 11, 2022
f81ad9e
feat: modify detail tab i18n
May 11, 2022
2d7ffa8
add streamis Appconn
May 11, 2022
1ea2c62
Merge branch 'dev-0.2.0' of https://github.com/WeDataSphere/Streamis …
May 11, 2022
7b52f8b
feat: 初步写下前端逻辑,还剩进度条
May 12, 2022
e25ee11
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
May 12, 2022
54177a8
update streamis Appconn
May 12, 2022
db7a846
feat: 失败信息列表也加一下
May 13, 2022
0cf3cbf
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
May 13, 2022
f45b3a1
Adjust dependency and structure of the job launcher module and add Jo…
Davidhua1996 May 13, 2022
42b1156
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 May 13, 2022
7fc81b2
Refresh the TODO list
Davidhua1996 May 13, 2022
58bbf27
Adjust the module of job launcher for Linkis.
Davidhua1996 May 15, 2022
a26e008
Note the progress of AbstractLinkisJobStateFetcher
Davidhua1996 May 16, 2022
7dead32
feat: fake some code
May 16, 2022
e4eada6
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
May 16, 2022
6b28a2a
fix: forget to change the test code
May 16, 2022
b13ddce
feat: temporarily create test.vue
May 16, 2022
bc09b6b
update streamis Appconn
May 16, 2022
66341a6
Merge remote-tracking branch 'origin/dev-0.2.0' into dev-0.2.0
May 16, 2022
874a34b
Complete the jobState entities and jobState Manager. Add FlinkTrigger…
Davidhua1996 May 17, 2022
94d7476
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 May 17, 2022
2e4f65c
Get the Checkpoint file information
May 18, 2022
e3379f5
Get the Checkpoint file information, update exception handling
May 18, 2022
30c8c7a
request parater validation
May 19, 2022
98b5ed3
Streamis scheduler module and Reconstruct the TaskService class (50%)
Davidhua1996 May 19, 2022
4024d88
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 May 19, 2022
7fec466
update Get the Checkpoint file information
May 20, 2022
b13216f
Resolve the JobStateResult.java compilation issues
May 20, 2022
3b840cd
Reconstruct the TaskService (100%); Bulk operation for job; Make the …
Davidhua1996 May 23, 2022
620c57c
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 May 23, 2022
e70a06f
feat: complete the i18n config
May 23, 2022
0fc7733
feat: complete the logic of batch restart
May 23, 2022
b3a99ac
feat: no need for jobid
May 23, 2022
c14560f
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
May 23, 2022
4a1b837
feat: the function of job list ready
May 24, 2022
317ac59
feat: config还有点问题,先遗留
May 24, 2022
90cd350
fix: the child_def array empty problem
May 24, 2022
67a09b0
feat: improve the functions comment by DH
May 25, 2022
b104ec9
feat: improve style
May 25, 2022
964ec7b
fix: logic error
May 25, 2022
5d842d6
fix: bugs
May 25, 2022
a838c0c
fix: splice bug
May 25, 2022
3c1d44e
feat: hide the extra checkbox
May 25, 2022
2a12edd
feat: multi key warning
May 25, 2022
753ec0b
feat: add savepoint cgi and change the button load
May 25, 2022
3e0c9d3
fix: remained bugs
May 26, 2022
fae8f0f
feat: snapshot path & logs history problems
May 26, 2022
3a5a34c
fix: several warnings
May 26, 2022
df36b33
feat: savepoint modal
May 26, 2022
2759cb2
fix: endline logic problem
May 26, 2022
2e89881
Strategy to fetch the JobState from Linkis server.
Davidhua1996 May 26, 2022
44bb659
Fix the compilation problem in modules.
Davidhua1996 May 26, 2022
b9f68fa
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 May 26, 2022
14b8e8b
feat: validate configs
May 26, 2022
c317559
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
May 26, 2022
cbf8e0f
feat: delete the extra logic
May 26, 2022
93197cd
fix: the cognition bugs
May 30, 2022
558fbf1
adjust appconn
May 30, 2022
7ed3412
init projectPrivilege
May 30, 2022
4a17a62
Merge remote-tracking branch 'origin/dev-0.2.0' into dev-0.2.0
May 30, 2022
dae49ba
Reconstruct the configuration module; Adjust the log4j2.xml
Davidhua1996 May 31, 2022
3615af9
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 May 31, 2022
78d6b03
Project Privilege Update
May 31, 2022
78bd170
Merge branch 'dev-0.2.0' of https://github.com/WeDataSphere/Streamis …
May 31, 2022
390979f
AppConn Update
Jun 2, 2022
2e4d054
Adjust the linkis.properties and log4j2.xml.
Davidhua1996 Jun 6, 2022
95111bf
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 Jun 6, 2022
ef06697
Store the linkis job id when the launched job has failed.
Davidhua1996 Jun 7, 2022
15d6bb0
AppConn related table update
Jun 8, 2022
acd945d
Flink the problem in JobRestfulApi; Enable to set flink application n…
Davidhua1996 Jun 8, 2022
1d92838
Upgrade the .gitignore file
Davidhua1996 Jun 8, 2022
742ea5d
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 Jun 8, 2022
cacedcd
privilege manage update
Jun 8, 2022
0c0141e
Merge branch 'dev-0.2.0' of https://github.com/WeDataSphere/Streamis …
Jun 8, 2022
aa83b42
resolving injection conflicts
Jun 8, 2022
b877448
project privilege change
Jun 10, 2022
e3822fc
project privilege change
Jun 10, 2022
ba3b8cc
project privilege change
Jun 13, 2022
5cc3c17
appconn init DDL update
Jun 13, 2022
e6e0cda
Adjust the stream job service and the strategy of data authority.
Davidhua1996 Jun 13, 2022
a7fbd89
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 Jun 13, 2022
c581adf
Resolve the conflict in Job service.
Davidhua1996 Jun 13, 2022
4e2f185
bug repair
Jun 13, 2022
26daf23
bug repair
Jun 13, 2022
239fe45
adjusting privilefe service
Jun 13, 2022
925f454
bug repair 277118
Jun 14, 2022
e45d65a
Modify the assembly configuration of streamis Appconn.
Davidhua1996 Jun 14, 2022
c6b7005
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Davidhua1996 Jun 14, 2022
303d32b
bug repair 277133
Jun 14, 2022
c32a610
Consider the situation of no matched configuration in web page
Davidhua1996 Apr 17, 2022
9d31291
Enable the developer to update/insert the configuration of users; Att…
Davidhua1996 Apr 17, 2022
1a8e49a
Adjust the streamis_ddl.sql
Davidhua1996 Apr 17, 2022
42ca2d5
Adjust the streamis_ddl.sql to accept large value of field
Davidhua1996 Apr 18, 2022
31666cb
Redefine the project file regex; Filter and replace the specific para…
Davidhua1996 May 5, 2022
e8b42bf
Roll the version to "0.2.0"; Change the dependency version of linkis …
Davidhua1996 May 10, 2022
ee26e7b
Init the streamis AppConn
Davidhua1996 May 10, 2022
ebc174b
add streamis Appconn
May 11, 2022
7316f17
update streamis Appconn
May 12, 2022
baddb04
Adjust dependency and structure of the job launcher module and add Jo…
Davidhua1996 May 13, 2022
020e871
Added switches for automatic restart of jobs and state recovery when …
Davidhua1996 Jun 16, 2022
38434d7
Adjust the notification message
Davidhua1996 Jun 16, 2022
30bb508
Avoid duplicate code
Davidhua1996 Jun 16, 2022
e6343da
Merge pull request #25 from WeDataSphere/dev-0.2.0-jobstate-interface
wushengyeyouya Jun 16, 2022
cb3ceb2
Reduce the duplicated dependencies of streamis-appconn
Davidhua1996 Jun 22, 2022
26a6464
update DeleteOperation and UpdateOperation Generic type
Jun 22, 2022
7fbf733
Revert "[Feature] JobState component in launcher module"
Davidhua1996 Jun 22, 2022
f66fd2e
adjust pom
Jun 22, 2022
5ef453c
Merge pull request #27 from WeBankFinTech/revert-25-dev-0.2.0-jobstat…
wushengyeyouya Jun 22, 2022
cbd43ae
Sync the latest ddl and dml sql for streamis
Davidhua1996 Jun 22, 2022
474b197
Remove the useless restful/mybatis configuration
Davidhua1996 Jun 23, 2022
e509121
Merge branch 'dev-0.2.0' of github.com:WeBankFinTech/Streamis into de…
Davidhua1996 Jun 23, 2022
9cf23b7
Merge remote-tracking branch 'wedata/dev-0.2.0-webank' into dev-0.2.0
Davidhua1996 Jun 23, 2022
d7f41ab
update init.sql ip port
Jun 23, 2022
c4e9799
Merge remote-tracking branch 'origin/dev-0.2.0-webank' into dev-0.2.0…
Jun 23, 2022
dc57a33
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
Davidhua1996 Jun 23, 2022
21a8acf
Merge pull request #28 from WeDataSphere/dev-0.2.0
Davidhua1996 Jun 24, 2022
30a4351
Merge pull request #29 from WeBankFinTech/dev-0.2.0
wushengyeyouya Jun 24, 2022
85903aa
update init.sql IP PORT
Jun 24, 2022
a8c85db
StreamisAppConnDesignDocument
Jun 16, 2022
a0feda4
update web project version、 config.sh project version and project-ser…
Jun 25, 2022
ffe496c
Streamis安装文档
Jun 25, 2022
e2370de
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
Jun 27, 2022
6a471fd
fix: the diy config problem
Jun 27, 2022
a1a5a59
Merge branch 'dev-0.2.0' of github.com:WeDataSphere/Streamis into dev…
Jun 27, 2022
5afe230
Merge pull request #30 from WeDataSphere/dev-0.2.0
Davidhua1996 Jun 27, 2022
7328b03
Remove StreamSQL development menu in DSS
Jun 27, 2022
4734eee
Optimize install.sh
Jun 27, 2022
e0ed4ce
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
Jun 27, 2022
1c3535d
Optimize Streamis installation documentation
Jun 27, 2022
c1b5f85
Merge pull request #26 from WeDataSphere/dev-0.2.0-docs-appconn
Davidhua1996 Jun 28, 2022
45658a0
Solve the problem of no loss of Streamis Product Center
Jun 28, 2022
b37ad25
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
Jun 28, 2022
efc73f2
update installation documentation
Jun 28, 2022
25cd526
Merge pull request #31 from WeBankFinTech/dev-0.2.0
Davidhua1996 Jun 29, 2022
037b0c5
Merge pull request #32 from WeDataSphere/dev-0.2.0
Davidhua1996 Jun 29, 2022
edf462a
Merge pull request #34 from WeBankFinTech/dev-0.2.0
Davidhua1996 Jun 29, 2022
75dc711
update insert dss_workspace_dictionary table
Jun 29, 2022
2db2847
Merge branch 'dev-0.2.0-webank' into dev-0.2.0
Jun 29, 2022
1e042ef
Merge pull request #35 from WeDataSphere/dev-0.2.0
Davidhua1996 Jun 29, 2022
bc7a52e
Merge pull request #36 from WeBankFinTech/dev-0.2.0
Davidhua1996 Jun 29, 2022
cd062ac
use document
Jun 30, 2022
d19be7c
Merge pull request #33 from WeDataSphere/dev-0.2.0-docs-appconn
Davidhua1996 Jul 1, 2022
f12b28a
Update English StreamisAppConnDesignDocument
Jul 1, 2022
3751197
add linkis1.1.2 support description
Jul 4, 2022
3aea2c5
Merge pull request #38 from WeDataSphere/dev-0.2.0-docs-appconn
Davidhua1996 Jul 4, 2022
81150dc
Enable the streamis to support different version of Linkis
Davidhua1996 Jul 4, 2022
72218d3
Merge branch 'dev-0.2.0' into dev-0.2.0-version-compatible
Davidhua1996 Jul 4, 2022
0efc59b
Change the format of linkis.properties
Davidhua1996 Jul 4, 2022
14a5aeb
Merge pull request #40 from WeDataSphere/dev-0.2.0-version-compatible
wushengyeyouya Jul 4, 2022
ea8d3d2
init upgrade document and update English pictures
Jul 4, 2022
106433b
update architecture picture
Jul 5, 2022
f70e82d
Merge pull request #41 from WeDataSphere/dev-0.2.0-docs-appconn
Davidhua1996 Jul 5, 2022
179fdf6
Merge pull request #42 from WeBankFinTech/dev-0.2.0
Davidhua1996 Jul 5, 2022
36b9ec7
Support the method to get engine conn resource information.
Davidhua1996 Oct 17, 2022
9c75477
Init the structure of log module.
Davidhua1996 Oct 17, 2022
0aa09cc
Add the new feature for adding task and stop task for existed jobs.
wushengyeyouya Oct 18, 2022
06c4962
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Oct 18, 2022
0b44316
Use the "\u0001" instead of "\0x001" to act as blank placeholder.
Davidhua1996 Oct 18, 2022
7dea7f6
SendBuffer and BucketConfig.
Davidhua1996 Oct 18, 2022
343eb2b
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 19, 2022
1945775
Add the new feature for adding task and stop task for existed jobs.
wushengyeyouya Oct 19, 2022
41da9e5
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Oct 19, 2022
6c6d50d
Complete the log collector (80%).
Davidhua1996 Oct 19, 2022
6814106
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 19, 2022
8b1bab8
fix the bug for adding task for existed jobs.
wushengyeyouya Oct 20, 2022
40588d3
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 20, 2022
77f616c
1. Add the ability for updating task for existed jobs.
wushengyeyouya Oct 20, 2022
5d274ab
RPC(Http) module classes in collector
Davidhua1996 Oct 20, 2022
223c590
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 20, 2022
1165614
1. Add the ability for updating task for existed jobs.
wushengyeyouya Oct 20, 2022
5af5289
1. Add the ability for updating task for existed jobs.
wushengyeyouya Oct 20, 2022
75a6ffb
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Oct 20, 2022
e32b3e0
The strategy to retry the request and compact the buffer in log colle…
Davidhua1996 Oct 20, 2022
718227a
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 20, 2022
bd3ced3
Complete the log collector (95%)
Davidhua1996 Oct 20, 2022
7574928
Fix the problem in send buffer and consumer.
Davidhua1996 Oct 21, 2022
adc0124
Optimize the architecture of fetch Job details.
wushengyeyouya Oct 21, 2022
d354c5c
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Oct 21, 2022
96f90d8
Add config autowired interface to set the log appender params.
Davidhua1996 Oct 21, 2022
cdf0468
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 21, 2022
0419c6d
fix the compilation bug.
wushengyeyouya Oct 21, 2022
9e648ba
fix the long to int parse bug.
wushengyeyouya Oct 21, 2022
ce152b8
Complete the log collector (100%)
Davidhua1996 Oct 22, 2022
ef5b0a3
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 22, 2022
0790ed9
Add Flink log collector and the transform in streamis which resolves …
Davidhua1996 Oct 22, 2022
ab64563
Complete stream log server to store the log events.
Davidhua1996 Oct 22, 2022
3979625
Fix the problem in job builder.
Davidhua1996 Oct 23, 2022
6eb95c2
Move the internal group config into JobConfKeyConstants.
Davidhua1996 Oct 23, 2022
1adf7d7
Move the internal group config into JobConfKeyConstants.
Davidhua1996 Oct 23, 2022
c07a5c2
Make the constraints in transforms be configurable.
Davidhua1996 Oct 23, 2022
0494533
Fix serialization and configuration problem.
Davidhua1996 Oct 23, 2022
977ba31
Optimize the update task and stop task logic.
wushengyeyouya Oct 24, 2022
2403de8
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Oct 24, 2022
cf4acfa
Fix the problem in fetching user info when the flink application does…
Davidhua1996 Oct 24, 2022
8633652
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 24, 2022
05744cb
Add new strategy named ThresholdFilter
Davidhua1996 Oct 25, 2022
3427e13
Fix the problem when closing bucket.
Davidhua1996 Oct 25, 2022
641dc10
Split the log collector into log4j1 and log4j2; Avoid the jackson mod…
Davidhua1996 Oct 25, 2022
d9e9179
Add module to collect spark container log.
Davidhua1996 Oct 26, 2022
5f4de3a
Add the new requestBody parameter `projectName` for adding task and s…
wushengyeyouya Oct 26, 2022
f90542a
Add the new requestBody parameter `projectName` for adding task and s…
wushengyeyouya Oct 26, 2022
461232f
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Oct 26, 2022
bbb0887
Complete the strategy in JsonTool.escapeStrValue().
Davidhua1996 Oct 26, 2022
68a9358
resolve 413 response status for update task.
wushengyeyouya Oct 29, 2022
111881e
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Oct 29, 2022
c95af1b
resolve 413 response status for update task.
wushengyeyouya Oct 29, 2022
e474e29
Fix the in method restoreInvariants of AbstractRpcLogSender.
Davidhua1996 Oct 29, 2022
447440e
Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Str…
Davidhua1996 Oct 29, 2022
35bbdd0
resolve 413 response status for update task.
wushengyeyouya Oct 31, 2022
bf06bd1
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Oct 31, 2022
4cda151
adjust the relation path in pom.xml.
Davidhua1996 Nov 7, 2022
6a07287
Fix the problem in pom.xml of stream job log modules.
Davidhua1996 Nov 7, 2022
a0e59b7
resolve the LinkisJobInfo is null for adding task.
wushengyeyouya Nov 15, 2022
1d933a6
Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into de…
wushengyeyouya Nov 15, 2022
fe00dff
Merge pull request #54 from WeDataSphere/dev-0.2.3-log-collector
jefftlin Dec 15, 2022
95e6643
Upgrade the version of pom to 0.2.3 (#55)
jefftlin Dec 20, 2022
0e98bab
Use the "flink.yarn.ship-directories" instead of "flink.app.user.clas…
Davidhua1996 Dec 20, 2022
00c93e8
Merge pull request #57 from WeDataSphere/dev-0.2.3-bugfix
jefftlin Dec 20, 2022
ced5eff
Upgrade the version of pom to 0.2.4 (#58)
jefftlin Dec 20, 2022
1d33075
Optimization of log collector module (#60)
Davidhua1996 Dec 20, 2022
5ac9a6f
Support to deploy the version of job when the related task not comple…
Davidhua1996 Dec 22, 2022
b6a1d31
Inspections of stream job; Support to define job configuration in met…
Davidhua1996 Dec 25, 2022
a070d23
Fix some problems.
Davidhua1996 Dec 25, 2022
f28c5ca
Fix the bug of uploading job exception
Dec 29, 2022
3268ae4
Fix the null pointer exception in "/execute/inspect".
Davidhua1996 Dec 29, 2022
d640410
Add lastVersion property in the resultSet of querying job list.
Davidhua1996 Dec 29, 2022
e69db11
Avoid the ambiguity in sql expression.
Davidhua1996 Dec 29, 2022
2f7980f
Problem in sql expression.
Davidhua1996 Dec 29, 2022
f4d3846
Get latestJobVersion form StreamJobVersion
Feb 8, 2023
09a3a5e
Fix bug of getting inspectName & getLatestJobVersion
Feb 14, 2023
b5659fc
Sort the job version details
Feb 15, 2023
6ea958a
Adjust the order to inspect the savepoint path defined first
Davidhua1996 Feb 19, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
99 changes: 99 additions & 0 deletions .github/ISSUE_TEMPLATE/bug_report.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
name: Bug report
title: "[Bug] "
description: Problems and issues with code of Streamis
labels: [bug, triage]
body:
- type: markdown
attributes:
value: |
Thank you for reporting the problem!
Please make sure what you are reporting is a bug with reproducible steps. To ask questions
or share ideas, pleae post on our [Discussion page](https://github.com/WeBankFinTech/Streamis/discussions) instead.

- type: checkboxes
attributes:
label: Search before asking
description: >
Please make sure to search in the [issues](https://github.com/WeBankFinTech/Streamis/issues) first to see
whether the same issue was reported already.
options:
- label: >
I searched the [issues](https://github.com/WeBankFinTech/Streamis/issues) and found no similar
issues.
required: true

- type: dropdown
attributes:
label: Streamis Component
description: |
What component are you using? Streamis has many modules, please make sure to choose the module that
you found the bug.
multiple: true
options:
- "streamis-commons"
- "streamis-server"
- "streamis-job-manager"
- "streamis-job-launcher"
- "streamis-web"
validations:
required: true

- type: textarea
attributes:
label: What happened + What you expected to happen
description: Describe 1. the bug 2. expected behavior 3. useful information (e.g., logs)
placeholder: >
Please provide the context in which the problem occurred and explain what happened. Further,
To Reproduce Steps to reproduce the behavior: 1. Go to '...' 2. Click on '....' 3. Scroll down to '.... 4. See error
please also explain why you think the behaviour is erroneous. It is extremely helpful if you can
copy and paste the fragment of logs showing the exact error messages or wrong behaviour here.

**NOTE**: Expected behavior A clear and concise description of what you expected to happen.Screenshots If applicable, add screenshots to help explain your problem.
validations:
required: true

- type: textarea
attributes:
label: Relevent platform
description: The platform where you occurred this issue
placeholder: >
Please specify Desktop or Smartphone, Version / Dependencies / OS / Browser
validations:
required: true

- type: textarea
attributes:
label: Reproduction script
description: >
Please provide a reproducible script. Providing a narrow reproduction (minimal / no external dependencies) will
help us triage and address issues in the timely manner!
placeholder: >
Please provide a short code snippet (less than 50 lines if possible) that can be copy-pasted to
reproduce the issue. The snippet should have **no external library dependencies**
(i.e., use fake or mock data / environments).

**NOTE**: If the code snippet cannot be run by itself, the issue will be marked as "needs-repro-script"
until the repro instruction is updated.
validations:
required: true

- type: textarea
attributes:
label: Anything else
description: Anything else we need to know?
placeholder: >
How often does this problem occur? (Once? Every time? Only when certain conditions are met?)
Any relevant logs to include? Are there other relevant issues?

- type: checkboxes
attributes:
label: Are you willing to submit a PR?
description: >
This is absolutely not required, but we are happy to guide you in the contribution process
especially if you already have a good understanding of how to implement the fix.
options:
- label: Yes I am willing to submit a PR!

- type: markdown
attributes:
value: "Thanks for completing our form!"
5 changes: 5 additions & 0 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
blank_issues_enabled: fasle
contact_links:
- name: Ask a question or get support
url: https://github.com/WeBankFinTech/Streamis/discussions
about: Ask a question or request support for using Streamis
63 changes: 63 additions & 0 deletions .github/ISSUE_TEMPLATE/feature_request.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,63 @@
name: Streamis feature request
description: Suggest an idea for Streamis project
title: "[Feature] "
labels: [enhancement]
body:
- type: markdown
attributes:
value: |
Thank you for finding the time to propose a new feature!
We really appreciate the community efforts to improve Streamis.
- type: checkboxes
attributes:
label: Search before asking
description: >
Please make sure to search in the [issues](https://github.com/WeBankFinTech/Streamis/issues) first to see
whether the same feature was requested already.
options:
- label: >
I had searched in the [issues](https://github.com/WeBankFinTech/Streamis/issues) and found no similar
feature requirement.
required: true
- type: textarea
attributes:
label: Problem Description
description: Is your feature request related to a problem? Please describe.

- type: textarea
attributes:
label: Description
description: A short description of your feature

- type: textarea
attributes:
label: Use case
description: >
Describe the use case of your feature request.
placeholder: >
Describe the solution you'd like A clear and concise description of what you want to happen.

- type: textarea
attributes:
label: solutions
description: Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

- type: textarea
attributes:
label: Anything else
description: Anything else we need to know?
placeholder: >
Additional context Add any other context or screenshots about the feature request here.

- type: checkboxes
attributes:
label: Are you willing to submit a PR?
description: >
This is absolutely not required, but we are happy to guide you in the contribution process
especially if you already have a good understanding of how to implement the feature.
options:
- label: Yes I am willing to submit a PR!

- type: markdown
attributes:
value: "Thanks for completing our form!"
27 changes: 27 additions & 0 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
### What is the purpose of the change
(For example: Streamis-Server defines the restful interfaces of Streamis, we can use linkis-httpclient to access it.
Related issues: #50. )

### Brief change log
(for example:)
- Define the the restful interfaces of Streamis;
- Define the service and dao interfaces of Streamis.

### Verifying this change
(Please pick either of the following options)
This change is a trivial rework / code cleanup without any test coverage.
(or)
This change is already covered by existing tests, such as (please describe tests).
(or)
This change added tests and can be verified as follows:
(example:)
- Added tests for creating and execute the Streamis jobs and verify the availability of different Streamis Job, such as flinkSQL, Jar.

### Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (yes / no)
- Anything that affects deployment: (yes / no / don't know)
- The Core framework, i.e., JobManager, Server.: (yes / no)

### Documentation
- Does this pull request introduce a new feature? (yes / no)
- If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
55 changes: 55 additions & 0 deletions .github/workflows/build.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,55 @@
#
# Copyright 2019 WeBank.
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#

name: Streamis CI Actions

on:
push:
pull_request:

jobs:
build:

runs-on: ubuntu-latest

strategy:
matrix:
node-version: [14.17.3]
# See supported Node.js release schedule at https://nodejs.org/en/about/releases/

steps:
- name: Checkout
uses: actions/checkout@v2
- name: Set up JDK 8
uses: actions/setup-java@v2
with:
distribution: 'adopt'
java-version: 8
- name: Use Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v2
with:
node-version: ${{ matrix.node-version }}
- name: Build backend by maven
run: |
mvn -N install
mvn clean package
- name: Build frontend by node.js
run: |
cd web
npm install
npm run build
48 changes: 48 additions & 0 deletions .github/workflows/check_license.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
#
# Copyright 2019 WeBank.
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
#

name: Streamis License check

on: [push, pull_request]

jobs:
build:
runs-on: ubuntu-latest
steps:
- name: Checkout source
uses: actions/checkout@v2
- name: Set up JDK 8
uses: actions/setup-java@v2
with:
java-version: '8'
distribution: 'adopt'
- name: mvn -N install
run:
mvn -N install
- name: License check with Maven
run: |
rat_file=`mvn apache-rat:check | { grep -oe "\\S\\+/rat.txt" || true; }`
echo "rat_file=$rat_file"
if [[ -n "$rat_file" ]];then echo "check error!" && cat $rat_file && exit 123;else echo "check success!" ;fi
- name: Upload the report
uses: actions/upload-artifact@v2
with:
name: license-check-report
path: "**/target/rat.txt"
21 changes: 20 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,4 +1,23 @@
*.iml
.idea
.DS_Store
assembly/target
assembly/target
streamis-jobmanager/streamis-job-launcher/streamis-job-launcher-base/target
streamis-jobmanager/streamis-job-launcher/streamis-job-launcher-linkis/target
streamis-jobmanager/streamis-job-launcher/streamis-job-launcher-service/target
streamis-jobmanager/streamis-job-launcher/streamis-job-launcher.iml
streamis-jobmanager/streamis-job-manager/streamis-job-manager-base/target
streamis-jobmanager/streamis-job-manager/streamis-job-manager-service/target
streamis-jobmanager/streamis-jobmanager-common/target
streamis-jobmanager/streamis-jobmanager-server/target
streamis-jobmanager/streamis-projectmanager-server/target

streamis-project/streamis-project-common/target
streamis-project/streamis-project-server/target

streamis-server/target
streamis-appconn/target
/logs/streamis-server.log
/logs/linkis.log
/test/target
/test/src
Loading