Merge branch 'StarRocks:main' into map_agg

.github/workflows/ci-pipeline.yml

@@ -312,7 +312,7 @@ jobs:
  - name: UPDATE ECI & RUN Clang Tidy
  id: run_clang_tidy
  shell: bash
- timeout-minutes: 60
+ timeout-minutes: 90
  run: |
  rm -rf ./ci-tool && cp -rf /var/lib/ci-tool ./ci-tool && cd ci-tool && git pull && source lib/init.sh
  if [[ "${{ needs.be-checker.outputs.thirdparty_filter }}" == 'true' ]]; then
@@ -592,7 +592,7 @@ jobs:
 
  build:
  runs-on: [self-hosted, normal]
- needs: [test-checker, clang-tidy, fe-ut, thirdparty-info]
+ needs: [test-checker, be-ut, fe-ut, thirdparty-info]
  name: BUILD
  env:
  PR_NUMBER: ${{ github.event.number }}
@@ -606,7 +606,7 @@ jobs:
  is_self_build: ${{ steps.run_build.outputs.is_self_build }}
  build_nece: ${{ steps.check-necessity.outputs.BUILD_NECE }}
  if: >
- always() && needs.clang-tidy.result != 'failure' && needs.fe-ut.result != 'failure'
+ always() && needs.be-ut.result != 'failure' && needs.fe-ut.result != 'failure' && (needs.be-ut.result == 'success' || needs.fe-ut.result == 'success' || needs.test-checker.result == 'success')
  steps:
  - name: CLEAN
  run: |
@@ -666,9 +666,9 @@ jobs:
  - name: Check necessity
  id: check-necessity
  if: >
- (needs.clang-tidy.result == 'success' && needs.fe-ut.result == 'success') || 
+ (needs.be-ut.result == 'success' && needs.fe-ut.result == 'success') || 
  (steps.parsing-be-path-filter.outputs.src_filter != 'true' && steps.parsing-fe-path-filter.outputs.src_filter == 'true' && needs.fe-ut.result == 'success') || 
- (steps.parsing-fe-path-filter.outputs.src_filter != 'true' && steps.parsing-be-path-filter.outputs.src_filter == 'true' && needs.clang-tidy.result == 'success') ||
+ (steps.parsing-fe-path-filter.outputs.src_filter != 'true' && steps.parsing-be-path-filter.outputs.src_filter == 'true' && needs.be-ut.result == 'success') ||
  (steps.parsing-be-path-filter.outputs.src_filter != 'true' && steps.parsing-fe-path-filter.outputs.src_filter != 'true' && needs.test-checker.outputs.output1 == 'true')
  run: |
  echo "BUILD_NECE=true" >> $GITHUB_OUTPUT
@@ -1043,4 +1043,4 @@ jobs:
  if: always()
  run: |
  rm -f $CONF_FILE
- rm -rf ${{ github.workspace }}/*
+ rm -rf ${{ github.workspace }}/*

.github/workflows/ci-sync.yml

@@ -11,7 +11,7 @@ on:
 
 jobs:
  sync:
- runs-on: [self-hosted, quick]
+ runs-on: [self-hosted, sync]
  if: github.event.pull_request.merged == true && github.repository == 'StarRocks/starrocks'
  env:
  PR_NUMBER: ${{ github.event.number }}

.trivyignore

@@ -0,0 +1,6 @@
+# ignore protobuf cve temporary
+CVE-2024-7254
+# ignore commons-io-2.11.0.jar introduced by odps-reader
+CVE-2024-47554
+# ignore avro-1.11.3.jar introduced by iceberg-core-1.6.0
+CVE-2024-47561

CONTRIBUTING.md

@@ -2,7 +2,7 @@
 
 StarRocks is built by an open and friendly community. We are dedicated to building a collaborative, inspiring, and exuberant open-source community for our members. Everyone is more than welcome to join our community to get help and to contribute to StarRocks.
 
-## Table of content
+## Table of contents
 
 - [How to contribute](#How-to-contribute)
 - [Contributing guideline](#Contributing-guideline)

README.md

@@ -34,8 +34,7 @@
 <div align="center"> 
 
 </div>
-StarRocks, a Linux Foundation project, is the next-generation data platform designed to make data-intensive real-time analytics fast and easy. 
-It delivers query speeds 5 to 10 times faster than other popular solutions. StarRocks can perform real-time analytics well while updating historical records. It can also enhance real-time analytics with historical data from data lakes easily. With StarRocks, you can get rid of the de-normalized tables and get the best performance and flexibility. <br></br>
+StarRocks is the world's fastest open query engine for sub-second, ad-hoc analytics both on and off the data lakehouse. With average query performance 3x faster than other popular alternatives, StarRocks is a query engine that eliminates the need for denormalization and adapts to your use cases, without having to move your data or rewrite SQL. A Linux Foundation project. <br></br>
 
 Learn more 👉🏻 [What Is StarRocks: Features and Use Cases](https://www.youtube.com/watch?v=RfXO5GOnbW4&ab_channel=CelerData)
 
@@ -74,7 +73,7 @@ StarRocks’s streamlined architecture is mainly composed of two modules: Fronte
 Starting from version 3.0, StarRocks supports a new shared-data architecture, which can provide better scalability and lower costs.
 
  <p align="center">
- <img src="docs/en/_assets/shared-data.png">
+ <img src="docs/en/_assets/shared-data.png" width="55%" height="55%">
  </a>
 </p>
 
@@ -116,6 +115,8 @@ We welcome all kinds of contributions from the community, individuals and partne
 **📝 License:** StarRocks is licensed under [Apache License 2.0](https://www.apache.org/licenses/LICENSE-2.0).
 
 **👥 Community Membership:** Learn more about different [contributor roles](community/membership.md) in StarRocks community.
+
+**💬 Developer Group：** Please join our [Google Groups](https://groups.google.com/g/starrocks-dev) to discuss StarRocks features, project directions, issues, pull requests, or share suggestions.
 
 <br>
 
@@ -126,7 +127,8 @@ This project is used by the following companies. Learn more about their use case
 - [Airbnb](https://www.youtube.com/watch?v=AzDxEZuMBwM&ab_channel=StarRocks_labs)
 - [Pinterest](https://medium.com/pinterest-engineering/delivering-faster-analytics-at-pinterest-a639cdfad374)
 - [Coinbase](https://www.youtube.com/watch?v=3Z9jSCaHnYg&list=PL0eWwaesODdhBhKSnvpfIEAB9sgk8rKmy)
-- [Tencent](https://www.starrocks.io/blog/tencent-unifies-their-gaming-analytics-with-starrocks)
-- [Shopee](https://www.youtube.com/watch?v=FJf6tVFr-20)
+- [Tencent(Games)](https://www.starrocks.io/blog/tencent-unifies-their-gaming-analytics-with-starrocks)
+- [Tencent(LLM)](https://www.youtube.com/watch?v=WVHXFks9EQk)
+- [Shopee](https://celerdata.com/blog/how-shopee-3xed-their-query-performance-with-starrocks)
 - [Trip.com](https://starrocks.medium.com/trip-com-starrocks-efficiently-supports-high-concurrent-queries-dramatically-reduces-labor-and-1e1921dd6bf8) 
 - [Didi](https://www.starrocks.io/blog/reduced-80-cost-didis-journey-from-multiple-olap-engines-to-starrocks)