v0.1.6

What's Changed

Click to Expand

• chore: remove java from coverage by @fuyufjh in #1697
• style(frontend): adjust mod and pub use ordering by @xiangjinwu in #1696
• chore(frontend): hints for pg_catalog by @TennyZhuang in #1700
• test: Add tpch q1 for batch distributed query by @liurenjie1024 in #1701
• chore(legacy): bump proto & grpc version by @BugenZhao in #1704
• chore(doc): add two lines of comments to enforce consistency by @yingjunwu in #1710
• fix(risedev): ulimit on linux by @BugenZhao in #1699
• docs: library -> binary by @skyzh in #1711
• refactor mock meta client by @Little-Wallace in #1694
• feat: support state recovery when meta reboot by @yezizp2012 in #1702
• chore(docs): update new URLs by @CharlieSYH in #1712
• test: Add tpch q5 for batch distributed query by @liurenjie1024 in #1709
• doc: updated developer doc readme by @hengm3467 in #1715
• fix(risedev): kill using C-c by @skyzh in #1719
• doc: flush command in readme.md is optional by @wyhyhyhyh in #1706
• chore(batch): remove unnecessary logs by @skyzh in #1716
• chore(docs): add a logo in readme by @skyzh in #1720
• docs(readme): change Kafka to Apache Kafka by @Sunt-ing in #1725
• fix: quick fix for create mv ut timeout by @yezizp2012 in #1728
• ci: only build one docker image by @neverchanje in #1703
• chore(risedev): ask users to modify cluster config by @skyzh in #1733
• community: add discussions and community chat in issue template by @skyzh in #1741
• test: Add tpch q6 for batch distributed query by @liurenjie1024 in #1743
• refactor: replace prettytable-rs with comfy-table by @PsiACE in #1726
• feat(streaming): migrate LookupExecutor to ExecutorV2 by @pleiadesian in #1742
• feat(batch): support hash join non-equi condition in java frontend by @yuhao-su in #1713
• chore(docs): instructions to check-in PRs from forks by @skyzh in #1748
• fix(source): fix previously omitted review by @tabVersion in #1749
• chore(ci): remove setup kafka step by @skyzh in #1752
• test: Add tpch q7 for batch distributed query by @liurenjie1024 in #1750
• doc: add architecture-design doc by @neverchanje in #1698
• feat(cell_based_table): add sentinel column and cell_based muti_get by @wcy-fdu in #1590
• test: remove global rowsort to prevent mistakes by @skyzh in #1755
• feat: disable meta recovery process in CI by @yezizp2012 in #1754
• fix(source): build connector when calling next by @tabVersion in #1746
• chore(docs): Tweak some details of dev docs by @Sunt-ing in #1756
• style: enable rustfmt reorder_impl_items by @TennyZhuang in #1758
• feat(session-config): introduce entry-level pure in-memory set configuration by @BowenXiao1999 in #1714
• feat(frontend): not expression push down by @Enter-tainer in #1744
• fix(fe-server): do not print unexpected eof as error to log by @BowenXiao1999 in #1760
• feat(risedev): support set disable-recovery by @skyzh in #1765
• fix(risedev): forbid unused parameters in config by @skyzh in #1767
• feat: apply retry strategy when recovery by @yezizp2012 in #1768
• chore(meta): fix retry strategy naming by @yezizp2012 in #1769
• test(streaming): fix order assumption in extreme_null by @BugenZhao in #1770
• feat(streaming): migrate TopNExecutor to ExecutorV2 by @pleiadesian in #1737
• feat(streaming): migrate AppendOnlyTopNExecutor to ExecutorV2 by @pleiadesian in #1739
• chore(batch-scheduler): remove old scheduler impl and rename the file by @BowenXiao1999 in #1766
• feat(binder): align type cast-ability with pg by @xiangjinwu in #1759
• chore: bump rust-toolchain to 2022-04-09 by @skyzh in #1776
• chore: cleanup unimplemented by @hawkingrei in #1731
• feat(stream): implement HopWindowExecutor by @TennyZhuang in #1718
• chore: add missing license headers by @TennyZhuang in #1777
• feat(sql): support show sources by @neverchanje in #1775
• fix: Fix distributed query manager bug by @liurenjie1024 in #1778
• ci: add license checker by @TennyZhuang in #1780
• feat: q13 for distributed batch query by @liurenjie1024 in #1782
• ci: refine action names by @TennyZhuang in #1783
• fix(streaming): fix reporting & stopping of rearranged chain by @BugenZhao in #1556
• chore(ci): use bors try for contributors by @skyzh in #1784
• doc(source): doc for data source by @tabVersion in #1781
• chore(pgwire): remove risingwave_common as dep of pgwire by @BowenXiao1999 in #1786
• feat: scheduling splits when creating a materialized view by @shanicky in #1788
• refactor(stream): refine AggExecutor and Executor by @TennyZhuang in #1795
• fix(ci): checkout code before license check by @skyzh in #1798
• chore(cell_based_table): restore some unit tests with cell_based interface by @wcy-fdu in #1792
• refactor(meta): support DAG fragment graph by @skyzh in #1789
• fix: fill source id before creating source in compute node by @hzxa21 in #1806
• chore: Add grouping to issue labels. by @liurenjie1024 in #1809
• fix(streaming): avoid violating the assumption of U+ after U- in hash join & add checker by @BugenZhao in #1811
• feat(stream): Introduce RowsIterV2 by @TennyZhuang in #1813
• feat(stream): migrate ProjectExecutor to ExecutorV2 by @WindowsXp-Beta in #1810
• fix(ss-bench): fix inaccurate throughput calculation by @Sunt-ing in #1815
• feat(meta): split stateful operators into different fragments by @skyzh in #1817
• feat(storage): sync shared buffer based on threshold by @StrikeW in #1671
• refactor(stream): switch to RowRefV2 by @TennyZhuang in #1818
• feat(storage): inject failure in object_store by @xxhZs in #1564
• refactor(stream): remove Executor::clear_cache by @TennyZhuang in #1820
• feat: add sub_fields in field to support create mv conclude struct column by @cykbls01 in #1796
• refactor(stream): refine TopNExecutorBase by @TennyZhuang in #1822
• fix(meta): fix missing source info during `CREATE MATERI...

v0.1.5

Features

• feat(frontend): support window table function (#1396 by @TennyZhuang)
• feat(failover): Recover rebooted compute nodes with notification and snapshot (#1500 by @zbzbw)
• feat(frontend): remove duplicated exprs in agg calls. (#1492 by @likg227)
• feat: use entry size as weight in block and meta cache, export cache capacity config (#1512 by @MrCroxx)
• feat(cell_based_table): add IO interfaces for cell based table (#1312 by @wcy-fdu)
• feat: support ROUND, NOT LIKE and EXTRACT (#1498 by @neverchanje)
• feat(CI): introduce cargo doc check (#1533 by @lmatz)
• feat: Introducing distributed scheduler. (#1448 by @liurenjie1024)
• feat(streaming): rearranged chain executor (#1528 by @BugenZhao)
• feat(expr): migrate expr to separate crate (#1547 by @skyzh)
• feat(streaming): implement v2 executor for merge (#1472 by @BowenXiao1999)
• feat(stream): migrate MaterializeExecutor to ExecutorV2 (#1539 by @zbzbw)
• feat(binder): bind correlated columns (#1497 by @xxchan)
• feat(batch): support non_equi condition in batch hash join in backend (#1305 by @yuhao-su)
• feat(frontend): support TPC-H Q7 Q13 (#1566 by @skyzh)
• feat(streaming): migrate receiver executor to v2 (#1559 by @BowenXiao1999)
• feat(streaming): Make RemoteInput async stream based (#1571 by @BowenXiao1999)
• feat: Move Cargo.toml to root (#1580 by @liurenjie1024)
• feat: support cast type to the type of itself (#1577 by @neverchanje)
• feat: sync source when recovery and some bug fix (#1578 by @yezizp2012)
• feat(expr): support timestamp/interval ops (#1596 by @TennyZhuang)
• feat(pg-wire): add error handle for cancel request + introduce error type for pgwire crates (#1603 by @BowenXiao1999)
• feat(streaming): migrate agg executors to ExecutorV2 (#1610 by @pleiadesian)
• feat: update downstream actor info when drop mv (#1618 by @yezizp2012)
• feat(frontend): support mv on source (#1623 by @st1page)
• feat(frontend): show command (#1545 by @cykbls01)
• feat(streaming): batch query executor v2 (#1619 by @BugenZhao)
• feat(frontend): add boolean constant folding (#1614 by @Enter-tainer)
• feat: make downstream update after create mv transactional (#1638 by @yezizp2012)
• feat: handle finish actor report for compute node recovery (#1646 by @yezizp2012)
• feat(expr): support interval * int (#1663 by @TennyZhuang)
• feat(sqlparser): support CREATE MATERIALIZED SOURCE and related drop commands. (#1679 by @neverchanje)
• feat(source): build connector source when meta calls (#1660 by @tabVersion)
• feat(risedev): support kafka and zookeeper (#1690 by @skyzh)
• feat(compaction): use atomic counter to trigger trace info (#1683 by @soundOfDestiny)

Fixes

• fix(frontend): join rewrite column mapping (#1510 by @skyzh)
• fix(doc): broken doc links (#1515 by @lmatz)
• fix(doc): eliminate all the warnings of cargo doc --document-private-items (#1519 by @lmatz)
• fix(ci): re-enable java checks (#1531 by @skyzh)
• fix(binder): skip hidden columns from column aliases (#1537 by @xiangjinwu)
• fix(streaming): use chain v1 for workaround (#1541 by @BugenZhao)
• fix(storage): remove async trait from rocksdb and tikv (#1542 by @lmatz)
• fix(frontend): convert func name to lowercase (#1560 by @skyzh)
• fix(storage): mark orphan SST before vacuum. (#1583 by @zwang28)
• fix(parser): cycle dependency between test runner and parser (#1595 by @skyzh)
• fix(frontend): fix window_start type (#1601 by @TennyZhuang)
• fix(batch): Enable distributed query by default (#1579 by @liurenjie1024)
• fix: Restore distributed ci-3node (#1615 by @liurenjie1024)
• fix: Close session when UnExpectedEof happens. (#1627 by @liurenjie1024)
• fix: Ser/De dummy data chunk should keep cardinality. (#1631 by @liurenjie1024)
• fix(streaming): remove is_stop_mutation (#1634 by @BugenZhao)
• fix(frontend): allow AnyShard for column indices (#1653 by @skyzh)
• fix: Batch distributed execution should support batch sort merge exchange. (#1672 by @liurenjie1024)
• fix(docs): wrong syntax for markdown links (#1685 by @skyzh)
• fix: fix snapshot_tests and shared buffer seek for reverse iterator (#1684 by @hzxa21)

Refactors

• refactor(pgwire): Match on char to avoid utf8 convert (#1506 by @Xuanwo)
• refactor(storage): use concrete value in value meta instead of bytes (#1501 by @xx01cyx)
• refactor(stream): remove async_trait from dispatcher (#1489 by @lmatz)
• refactor: Remove/combine some metrics. (#1534 by @twocode)
• refactor(storage): set apart value meta and user value in HummockValue (#1552 by @xx01cyx)
• refactor: extract boolean env var parse (#1553 by @BugenZhao)
• refactor(expr): simplify gen_binary_expr_atm (#1568 by @TennyZhuang)
• refactor(batch): return Err when polling finished executor (#1544 by @Enter-tainer)
• refactor: remove char type (#1555 by @neverchanje)
• refactor(streaming): clearer logic in merge v2 (#1605 by @BugenZhao)
• refactor(stream): SimpleExecutor::map_chunk => map_filter_chunk (#1611 by @TennyZhuang)
• refactor: use enum-as-inner to generate as_xxx functions (#1644 by @BugenZhao)
• refactor: Break dependencies between risingwave_meta and risingwave_storage (#1608 by @hzxa21)
• refactor: reduce duplicated code on create source and create table (#1665 by @neverchanje)
• refactor(expr): simplify type_infer (#1674 by @TennyZhuang)
• refactor(storage): add storage error type (#1667 by @BugenZhao)
• refactor: S3FileReader adapts to the new SourceReader trait (#1641 by @pangzhenzhou)
• refactor: simplify FrontendMetaClient (#1686 by @hzxa21)

Tests

• test: Introducing ci-3node tests. (#1650 by @liurenjie1024)
• test(compaction): print compaction status periodly (#1675 by @soundOfDestiny)

Others

• chore: remove s3 bench (#1514 by @MrCroxx)
• chore(frontend): port more tests (#1518 by @skyzh)
• chore(frontend): remove unstable pg connection test (#1525 by @BowenXiao1999)
• chore(doc): let cargo doc fails on warning due to broken_intra_doc_links (#1524 by @lmatz)
• chore: rename java -> legacy (#1526 by @skyzh)
• chore(typo-fix): fix all typos in current repo (#1522 by @BowenXiao1999)
• chore: remove unused deps, bump deps, remove expr from source (#1549 by @skyzh)
• chore: remove more unused tt in macros (#1573 by @TennyZhuang)
• chore: bump dependencies and fix renaming issues (#1584 by @skyzh)
• chore: bump prost to 0.10, disable rustls in aws-sdk (#1585 by @skyzh)
• chore: remove src/risedev (#1586 by @TennyZhuang)
• chore: update docker related files (#1593 by @KeXiangWang)
• chore: using TableId instead when drop materialized view (#1602 by @yezizp2012)
• chore: remove unused file. (#1607 by @zwang28)
• chore(compaction): add some compaction metrics into grafana (#1538 by @soundOfDestiny)
• chore: fix e2e command in doc. (#1626 by @zwang28)
• chore(object-store): use enum instead of trait objects for ObjectStore (#1629 by @BowenXiao1999)
• chore(stream): FilterExecutor uses BitmapBuilder (#1622 by @TennyZhuang)
• chore: add tracking issue to NotImplementedError (#1639 by @TennyZhuang)
• chore: compress debug info (#1640 by @skyzh)
• chore(doc): psql not need the db name (#1651 by @BowenXiao1999)
• chore(doc): fix the FLUSH in cluster start up. (#1657 by @BowenXiao1999)
• chore(doc): fix typo in readme (#1659 by @BugenZhao)
• chore: deprecate rocksdb and tikv (#1543 by @skyzh)
• chore: fix some documentation (#1662 by @twocode)
• chore(doc): tweak readme (#1673 by @yingjunwu)
• chore(stream): remove unused async_trait (#1676 by @TennyZhuang)

Uncategorized

• docs: Remove empty docs for s3 (#1504 by @Xuanwo)
• docs: move benchmark tool docs (#1513 by @fuyufjh)
• docs: add mv-on-mv (#1505 by @TennyZhuang)
• docs: add docs for data model and encoding (#1535 by @fuyufjh)
• docs: unify storage overview docs (#1546 by @hzxa21)
• chore: $macro should be ident instead of tt (#1569 by @TennyZhuang)
• hummock: remove some macro in manager (#1567 by @Little-Wallace)
• docs: revise the streaming engine overview (#1574 by @wyhyhyhyh)
• chore: rename rust -> src (#1551 by @skyzh)
• docs: link to user docs (#1594 by @skyzh)
• perf(shared buffer): divide sync task to kr splits to sync shared buf… (#1496 by @soundOfDestiny)
• docs: add getting started guide (#1625 by @skyzh)
• docs: add issue templates and ToCs (#1628 by @skyzh)
• docs: refine src/README.md (#1647 by @TennyZhuang)
• docs: add readme for docker folder (#1649 by @skyzh)
• docs: fix description of types (#1658 by @xiangjinwu)
• ci: disable batch 3 node test (#1664 by @skyzh)
• ci: enable 3-node streaming (#1656 by @skyzh)
• storage: do not fetch all tables during every query. (#1558 by @Little-Wallace)
• minor: allow passing arguments to risedev test (#1691 by @hzxa21)
• ci: add docker build job (#1680 by @neverchanje)
• doc: Minor doc updates (#1688 by @hengm3467)
• release: bump to v0.1.5 (#1678 by @skyzh)

v0.1.4

Features

• feat(ci): add tar packaging in release workflow (#1449 by @skyzh)
• feat(meta): Gracefully shutdown actors during compute node failover (#1428 by @zbzbw)
• feat: replace proto sstable meta with self managed struct (#1447 by @MrCroxx)
• feat: use arc for sstable meta cache (#1462 by @MrCroxx)
• feat(frontend): support round function (#1446 by @neverchanje)
• feat(frontend): support TPC-H Q1 Q5 (#1460 by @skyzh)
• feat(streaming): introduce async-stream based ChainExecutorV2 (#1469 by @BugenZhao)
• feat(binder): support table alias (#1480 by @xiangjinwu)
• feat: flush after write, also fixed some avg problems (#1485 by @neverchanje)
• feat(storage): support value meta in storage (#1471 by @xx01cyx)
• feat: improve display format of literals (#1494 by @fuyufjh)

Fixes

• fix(meta): fix fragmenter upstream actors setup (#1451 by @yezizp2012)
• fix: fix vacuuming SSTables in aborted epochs (#1454 by @hzxa21)
• fix(doc): doc under stream crate (#1461 by @lmatz)
• fix: move profile config from package to workspace (#1483 by @MrCroxx)
• fix(doc): use the right path for doc links (#1478 by @lmatz)

Refactors

• refactor(get): seek and filter tables by level (#1372 by @Little-Wallace)
• refactor(connector): remove assign_split from SourceReader (#1477 by @tabVersion)
• refactor(compaction): separate select and validate logic in get_compa… (#1160 by @soundOfDestiny)
• refactor(optimizer): remove unused input required (#1434 by @st1page)

Tests

• test(streaming): add unit tests for chain v2 (#1491 by @BugenZhao)

Others

• chore: refine to_rw_result_with (#1470 by @yezizp2012)
• chore: misc refine in cluster manager (#1482 by @yezizp2012)

Uncategorized

• docs: instruct to download single binary (#1450 by @skyzh)
• ci: use taiki-e action to install cargo-llvm-cov and nextest (#1464 by @MrCroxx)
• bench: add micro bench for block iter (#1468 by @MrCroxx)
• release: v0.1.4 (#1499 by @TennyZhuang)

v0.1.4-alpha

Features

• feat: add barrier latency monitor (#553 by @wcy-fdu)
• feat: Propagate the CreateMview mutation barrier to init executor epoch (#511 by @hzxa21)
• feat(stream): fetch hash agg state in parallel (#568 by @pleiadesian)
• feat(bummock): introduce indexing storage (#573 by @twocode)
• feat(stream): add reset for stream executor (#557 by @yezizp2012)
• feat: Introducing new subquery decorreclator (#594 by @liurenjie1024)
• feat: add more metrics for StateStore (#555 by @zehaowei)
• feat: Introduce join push expression rule. (#603 by @liurenjie1024)
• feat: Introduce an auto-discovery for S3 Bucket files for Filesystem connector (#608 by @pangzhenzhou)
• feat: Introducing SimplifyFilterConditionRule (#614 by @liurenjie1024)
• feat: Support async checkpoint with hummock shared buffer (#602 by @hzxa21)
• feat(meta): add CompactorManager (#556 by @zwang28)
• feat: Introducing SimplifyFilterConditionRuleTest (#637 by @liurenjie1024)
• feat(meta): introduce consistent hash logic (#626 by @xx01cyx)
• feat(frontend): pull common factors from OR's operands in join (#664 by @lmatz)
• feat: support shared buffer reset (#629) (#659 by @hzxa21)
• feat: add scan metrics (#662 by @zehaowei)
• feat: Introducing JoinConditionTypeCoerceRule (#663 by @liurenjie1024)
• feat: refine the storage configurations on compute node. (#676 by @twocode)
• feat: support catalog update (#567 by @HuaHuaY)
• feat(planner): Introducing RewriteSubQueryRule (#684 by @liurenjie1024)
• feat(frontend): bind project (#615 by @likg227)
• feat(meta): support etcd as MetaStore backend (#681 by @TennyZhuang)
• feat: add offset for source message (#679 by @shanicky)
• feat(optimizer): column pruning for filter and scan (#693 by @xxchan)
• feat(risedev): support etcd meta store backend in risedev (#707 by @TennyZhuang)
• feat(optimizer): Introducing subquery removal rule. (#713 by @liurenjie1024)
• feat(frontend): LogicalFilter (#685 by @mczhuang)
• feat(compaction): stat sst upload cnt during compaction (#699 by @soundOfDestiny)
• feat: support binding functions and unary exprs (#694 by @neverchanje)
• feat(frontend): add execution context to replace session impl (#714 by @BowenXiao1999)
• feat(optimizer): implement column pruning for value, project, agg (#710 by @xxchan)
• feat: asynchronous shared buffer sync (#722 by @BugenZhao)
• feat: Array parsing support (#604 by @nanderstabel)
• feat(risedev): load previous components during configure (#750 by @TennyZhuang)
• feat: New subquery optimizer program. (#752 by @liurenjie1024)
• feat(storage): support replicate batch (aka remote write) (#718 by @skyzh)
• feat(compaction): compact idle levels with high priority (#739 by @soundOfDestiny)
• feat(hummock): vacuum tracked SSTs and metadata. (#725 by @zwang28)
• feat(optimizer): implement column pruning for topn & join (#733 by @xxchan)
• feat(planner): integrate with PlanRoot (#726 by @xiangjinwu)
• feat: report failed actors in barrier manager (#759 by @BugenZhao)
• feat(ss-bench): support calibrating metric parameter (#740 by @Sunt-ing)
• feat(ctl): support list Hummock version (#758 by @skyzh)
• feat(ctl): support list key-value pairs (#782 by @skyzh)
• feat(optimizer): plan node base (#748 by @st1page)
• feat: support all-in-one binary (#796 by @skyzh)
• feat(join): add semi/anti join support (#644 by @BowenXiao1999)
• feat(compaction): add more metrics into compaction (#771 by @soundOfDestiny)
• feat(risedev): support all-in-one binary (#799 by @skyzh)
• feat(compaction): add read/write amount metrics for compaction (#807 by @soundOfDestiny)
• feat(frontend): use new subquery rewriter in stream planner (#809 by @lmatz)
• feat: Use version to synchronize catalog (#749 by @HuaHuaY)
• feat(risedev): warn on no_proxy (#814 by @skyzh)
• feat(streaming): implement basic logic of lookup executor (#819 by @skyzh)
• feat(frontend): derive primary key for anti and semi join (#816 by @lmatz)
• feat(optimizer): Add filter join rule (#808 by @xxchan)
• feat(streaming): implement lookup row from storage (#822 by @skyzh)
• feat: add single_value agg function (#824 by @lmatz)
• feat(frontend): make expr in explain output concise (#802 by @xiangjinwu)
• feat(catalog): add descriptor for cellbased table (#815 by @st1page)
• feat: Convert GRPC results to Row (#812 by @cykbls01)
• feat(planner/optimizer): introduce query context in plan node + id assign for each plan node (#821 by @BowenXiao1999)
• feat: add notification for catalog-v2 (#850 by @yezizp2012)
• feat(risectl): move hummock to subcommand (#855 by @skyzh)
• feat(cmd): add zero-configuration playground to all-in-one binary (#853 by @TennyZhuang)
• feat(streaming): add unit tests for lookup executor (#851 by @skyzh)
• feat(risedev): create .bin and link risingwave (#857 by @skyzh)
• feat(meta): enable heartbeat detection. (#830 by @zwang28)
• feat: add catalog service v2 proto definition (#867 by @yezizp2012)
• feat(meta): distinguish and assign responsibilities for different parallel units (simple dispatch and hash dispatch) (#846 by @xx01cyx)
• feat(storage): support read epoch for in-memory state backend (#874 by @skyzh)
• feat(planner): plan inner join (#876 by @TennyZhuang)
• feat(frontend): support BatchInsert (#879 by @skyzh)
• feat(batch): introduce delete executor in compute node (#883 by @BugenZhao)
• feat(optimizer): implement BatchValues (#888 by @TennyZhuang)
• feat(planner): create LogicalAgg (#843 by @likg227)
• feat(scheduler): exchange node rewrite in serialization (#525 by @BowenXiao1999)
• feat: transform single_value into a two-phase aggregation (#892 by @lmatz)
• feat(storage): support hummock in-memory mode (#910 by @skyzh)
• feat(frontend): create query handler (#907 by @cykbls01)
• feat(risedev): add risedev p (#916 by @skyzh)
• feat(binder): bind & plan DELETE (#912 by @BugenZhao)
• feat(frontend): bind & plan order by (#908 by @xiangjinwu)
• feat: suppport testing batch plan in plan test runner (#915 by @neverchanje)
• feat(frontend): support apply test plan (#926 by @skyzh)
• feat: use inner message (#932 by @shanicky)
• feat(optimizer): support BatchDelete (#934 by @BugenZhao)
• feat(frontend): support stream scan plan (#938 by @skyzh)
• feat(optimzier): col_prune for logical insert (#933 by @st1page)
• feat(optimizer): turn on HeuristicOptimizer (#942 by @xxchan)
• feat(handler): get/drop hummock snapshot version in RPC (#936 by @BowenXiao1999)
• feat(risedev): use hummock in-memory mode by default (#954 by @skyzh)
• feat(frontend): support HashJoin with non-equal conditions (#949 by @fuyufjh)
• feat(frontend): add no-op create mv handler (#960 by @skyzh)
• feat: send notification failed then retry (#925 by @HuaHuaY)
• feat(meta): Implement create and drop database/schema service v2 (#965 by @zbzbw)
• feat(streaming): add single value aggregation for streaming (#914 by @lmatz)
• feat: impl ToStreamProst for stream exchange (#967 by @BowenXiao1999)
• feat: support DELETE with the Java frontend (#962 by @BugenZhao)
• feat(meta): alter streaming schedule strategy (#940 by @xx01cyx)
• feat(frontend): support filter and projection stream serialization (#976 by @skyzh)
• feat(compaction): metric by frequence and #sst side, compaction doc (#829 by @soundOfDestiny)
• feat(frontend): support explain create mv (#978 by @skyzh)
• feat(meta): Implement create/drop MV service v2 (#983 by @zbzbw)
• feat(hummock): vacuum orphan hummock data (#818 by @zwang28)
• feat: write telemetry break down. (#987 by @twocode)
• feat(frontend): get pg_field_descs from boudstatement (#950 by @cykbls01)
• feat(frontend): support FLUSH (#996 by @TennyZhuang)
• feat(hummock): support write key conflict detection under debug mode (#968 by @wenym1)
• feat(risedev): run any dev command (#998 by @skyzh)
• feat: add local planner test for stream hash join (#1001 by @BowenXiao1999)
• feat(frontend): insert & delete handler (#1011 by @BugenZhao)
• feat(storage): store min epoch watermark to hummock version (#1010 by @StrikeW)
• feat(frontend): add virtual StreamTableScan node (#1024 by @skyzh)
• feat(frontend): make explained plan be dist (#1004 by @BowenXiao1999)
• feat: impl batch operators to pb (#986 by @neverchanje)
• feat(binder): support subqurey in FROM (#992 by @xxchan)
• feat(optimizer): add FilterProjectRule (#945 by @xxchan)
• feat: update downstream actor ids when create MoM (#1041 by @yezizp2012)
• feat(meta): add consistent hash mapping into hash dispatcher (#1030 by @xx01cyx)
• feat(ci): use nextest (#1048 by @skyzh)
• feat(frontend): BatchAgg and StreamAgg (#1026 by @likg227)
• feat(frontend): impl ToBatchProst for BatchSort (#1045 by @lmatz)
• feat(streaming): use single client for exchange (#1051 by @skyzh)
• feat(meta): implement create & drop source for catalog v2 (#1043 by @BugenZhao)
• feat: check ref count for drop source (#1057 by @yezizp2012)
• feat(frontend): add StreamMaterialize node (#1033 by @skyzh)
• feat(meta): implement create & drop materialized source for catalog v2 (#1065 by @BugenZhao)
• feat(streaming): prepare to support multiple dispatchers (#1064 by @skyzh)
• feat(frontend): bind functions (#734 by @mczhuang)
• feat(ci): use all-in-one binary (#1067 by @skyzh)
• feat(streaming): adopt consistent hash dispatch in streaming (#1056 by @xx01cyx)
• feat(meta): handling duplicated mv creation in create mv service v2 (#1066 by @zbzbw)
• feat(dashboard): integrate new dashboard ui with risedev (#531 by @mikechesterwang)
• feat(frontend): Rewrite avg to sum/count. (#1075 by @likg227)
• feat(risedev): add build dashboard config (#1086 by @skyzh)
• feat: read break down (#1094 by @twocode)
• feat(meta): handling duplicated source creation in catalog service v2 (#1101 by @zbzbw)
• feat(frontend): parallelize test (#1091 by @skyzh)
• feat(frontend): add stream proto test (#1105 by @skyzh)
• feat(frontend): support to_protobuf for streaming agg (#1116 by @skyzh)
• feat(storage): replace MViewTable with CellBasedTable and add relational interfaces (#1046 by @wcy-fdu)
• fea...

v0.1.3

Features

• feat(bench): support various workload types (#5 by @Sunt-ing)
• feat(frontend): introduce planner (#44 by @xiangjinwu)
• feat(bench): support getseq (#47 by @Sunt-ing)
• feat(meta): support parallel materialize (#58 by @TennyZhuang)
• feat(bench): add prepocess and mimic RocksDB db_bench (#85 by @Sunt-ing)
• feat(streaming): add & test cache clearing for more executors (#55 by @BugenZhao)
• feat(connector): kinesisSplitReader (#57 by @tabVersion)
• feat(mview): support barrier from meta (#88 by @MrCroxx)
• feat(expr): add NegExpr (#63 by @likg227)
• feat(optimizer): use fixedbitset instead of bit-set (#114 by @st1page)
• feat(batch): add aggregation with distinct (#98 by @lmatz)
• feat(mview): mv on mv support parallel upstreams (#117 by @MrCroxx)
• feat(planner): add batch scan plan node definition (#81 by @BowenXiao1999)
• feat(fragmenter): introduce batch plan fragmenter (#65 by @BowenXiao1999)
• feat(optimizer): get inputs col index (#163 by @st1page)
• feat(dashboard): resolve chain node of mv on mv (#162 by @BugenZhao)
• feat: introduce config in batch env and use chunk_size in config (#157 by @fuyufjh)
• feat(stream): add stateless LocalSimpleAggExecutor in CN (#164 by @TennyZhuang)
• feat(Optimizer): logical topn and limit plannode (#167 by @st1page)
• feat: add metrics for hummock get latency (#166 by @wcy-fdu)
• feat(storage): add block cache (#168 by @skyzh)
• feat(type): remove prec and scale in Decimal (#175 by @likg227)
• feat: add lower expr (#171 by @xx01cyx)
• feat(frontend): Add drop_table in handler (#180 by @mczhuang)
• feat(mview): support epoch-aware snapshot read for chain node (#197 by @MrCroxx)
• feat(frontend): implement prune_col for Limit (#205 by @TennyZhuang)
• feat: use TABLE_V2 by default (#123 by @BugenZhao)
• feat: add ascii expr (#172 by @xx01cyx)
• feat(stream): hash dispatcher: support multi columns (#222 by @fuyufjh)
• feat(binder): derive column types for values. (#186 by @likg227)
• feat(optimizer): add property satisfy method (#226 by @st1page)
• feat: impl hummock compaction task RPCs. (#246 by @zwang28)
• feat: implement scan/ingest_batch stat for in-mem storage (#236 by @Sunt-ing)
• feat: introduce globally unique id for fragment and display on dashboard (#252 by @yezizp2012)
• feat: add MockHummockMetaClient that uses HummockManager. (#249 by @zwang28)
• feat(compaction): use meta client and local version manager instead o… (#225 by @soundOfDestiny)
• feat(common): add search expression (#235 by @lmatz)
• feat: Disable search operator (#259 by @liurenjie1024)
• feat: Batch add tpch q12 (#256 by @liurenjie1024)
• feat(stream): support parallel source (#232 by @fuyufjh)
• feat: add range scan count in grafana dashboards (#280 by @wcy-fdu)
• feat: Batch tpch q15 (#273 by @liurenjie1024)
• feat(dashboard): resolve chain node and fragment id (#283 by @mikechesterwang)
• feat(binder): bind & plan base table scan (#174 by @xiangjinwu)
• feat(dashboard): support multiple nodes (#299 by @skyzh)
• feat: release a worker node's hummock resources when it is deleted. (#292 by @zwang28)
• feat(connector): kinesis enumerator (#12 by @tabVersion)
• feat(connector): kinesis state support (#102 by @tabVersion)
• feat(dashboard): support mv query on dashboard (#310 by @yezizp2012)
• feat(ss-bench): support statistics flag (#128 by @Sunt-ing)
• feat: add more info to identity string of executors (#300 by @lmatz)
• feat(binder): bind & plan insert (#302 by @xiangjinwu)
• feat(meta): extract inner nodes from chain node (#307 by @MrCroxx)
• feat(frontend): get compute nodes's address from meta server when java frontend starts (#323 by @HuaHuaY)
• feat(scheduler): introduce augment (exchange source info, parallelism) phase (#243 by @BowenXiao1999)
• feat(catalog): add hidden row_id column in frontend (#309 by @BowenXiao1999)
• feat(optimizer): add plan root (#254 by @st1page)
• feat: add grpc metrics for hummock (#306 by @wcy-fdu)
• feat(optimizer): mapping rewrite method (#331 by @st1page)
• feat(batch): distributed table_v2 insertion & scanning (#334 by @BugenZhao)
• feat(dashboard): support multi-worker-node (#340 by @mikechesterwang)
• feat(streaming): inject more info into the identity string of stream executors (#344 by @lmatz)
• feat(batch): temporarily add min/max for bool required by current frontend for tpch (#362 by @xiangjinwu)
• feat(filesystem source): Define the Filesystem source interface. (#335 by @pangzhenzhou)
• feat: Add batch tpch q4 (#369 by @liurenjie1024)
• feat(streaming): remote channel building for mv on mv (#352 by @MrCroxx)
• feat(dashboard): filter mv & search and locate actor (#378 by @mikechesterwang)
• feat(risedev): print command in risedev log (#382 by @skyzh)
• feat(batch): Add tpch q22. (#388 by @liurenjie1024)
• feat(optimizer): condition && join predicate (#367 by @st1page)
• feat(meta): add reference count for tables, check when create/drop tables (#364 by @xx01cyx)
• feat(ci): enable 3-node streaming e2e (#405 by @MrCroxx)
• feat(hummock): add aws-s3 dashboards for hummock monitor (#413 by @wcy-fdu)
• feat(dashboard): clearer view for compute nodes (#420 by @mikechesterwang)
• feat(util): Support value encoding and memcomparable encoding for decimal (#419 by @likg227)
• feat(risedev): add frontend-node rust (#390 by @BowenXiao1999)
• feat: java frontend passes epoch to cn (#406 by @zwang28)
• feat: add in expression (#411 by @lmatz)
• feat(meta): add gRPC metrics (#436 by @skyzh)
• feat(streaming): support LRU for streaming hash join (#337 by @yuhao-su)
• feat: add meta grpc monitor in grafana dashboards (#448 by @wcy-fdu)
• feat(ss-bench): support displaying throughput (#449 by @Sunt-ing)
• feat: support parsing row type (#463 by @neverchanje)
• feat(ci): run risedev e2e on EC2 (#468 by @skyzh)
• feat(optimizer): project with mapping (#471 by @st1page)
• feat: zehao/modify rocksdb (#479 by @zehaowei)
• feat(ss-bench): Implement deleterandom operation for ss-bench (#482 by @Sunt-ing)
• feat(streaming): remove output for broadcast dispatcher (#499 by @BugenZhao)
• feat: introduce struct type (#485 by @neverchanje)
• feat(ss-bench): add random seed option and optimize algorithm (#500 by @Sunt-ing)
• feat: introduce NotificationService in meta. (#434 by @HuaHuaY)
• feat: drop mv on mv (#506 by @BugenZhao)
• feat: implement struct array's layout (#451 by @neverchanje)
• feat(meta): collect from creating actors (#512 by @BugenZhao)
• feat(ss-bench): support --scans option (#503 by @Sunt-ing)
• feat(expr): add builtin function TUMBLE_START (#507 by @TennyZhuang)
• feat: hummock wait epoch (#465 by @zwang28)
• feat(meta): add state field to worker node (#518 by @zwang28)
• feat(connector): kinesis support role arn and external id (#435 by @tabVersion)
• feat(meta): support instant flush in barrier manager (#524 by @BugenZhao)
• feat(proto): add hidden column in Column Desc (#530 by @st1page)

Fixes

• fix(streaming): hash join test with non-equi condition (#6 by @yuhao-su)
• fix(streaming): separate key and row data types in top n (#7 by @lmatz)
• fix(meta): incorrect range_lookup_key_range implementation (#46 by @zwang28)
• fix(riselab): add back tracing option (#49 by @skyzh)
• fix(streaming): correct vec capacity in get_hash_values (#52 by @yuhao-su)
• fix(batch): filter tricks itself into fetching child's input when there is none (#48 by @lmatz)
• fix(riselab): do not enable all components on --default (#83 by @BugenZhao)
• fix: add more tests for MetaStore (#84 by @zwang28)
• fix(riselab): minio not initialized (#97 by @skyzh)
• fix(batch): use shuffle aggregation for distinct aggregation (#125 by @lmatz)
• fix(frontend): use original string for BigDecimal instead of parseDouble (#129 by @lmatz)
• fix(batch): incorrect schema for RowSeqScan executor (#134 by @BugenZhao)
• fix(streaming): ignore notifier send error of local barrier manager (#152 by @BugenZhao)
• fix(streaming): shared executor keyspace (#156 by @yezizp2012)
• fix(mview): fix dispatcher updates when sharing upstream mview (#183 by @MrCroxx)
• fix(batch): COUNT(*) from mview table (#182 by @BugenZhao)
• fix(tracing): barrier aggregation tracing (#187 by @skyzh)
• fix(storage): mview scan will miss keys (#184 by @skyzh)
• fix: PG protocol frontend text serialization failed. (#219 by @liurenjie1024)
• fix: set reasonable intervals for state store stats (#229 by @Sunt-ing)
• fix(hummock): correct thread dependency implementation (#242 by @Sunt-ing)
• fix(storage): return error instead of panic in simple manager (#248 by @skyzh)
• fix(storage): do not open port for prometheus test (#250 by @skyzh)
• fix(streaming): allow only stateless aggregator to be parallelized (#241 by @TennyZhuang)
• fix: fix MockHummockMetaClient (#260 by @zwang28)
• fix(frontend): occasional table v2 create error (#267 by @BugenZhao)
• fix: disable source e2e tests temporarily (#287 by @fuyufjh)
• fix(dashboard): mv on mv with multiple nodes support (#305 by @BugenZhao)
• fix: ignore the failed case in source e2e test (#298 by @fuyufjh)
• fix: ignore the failed case in source e2e test (#313 by @MrCroxx)
• fix: fix uneeded async func def (#315 by @yezizp2012)
• fix(dashboard): fix performance issue (#317 by @skyzh)
• fix(meta): fix inconsistency when delete table fragments fail in metastore (#348 by @yezizp2012)
• fix(hummock): add full key to multi builder initially while disallowing split (#349 by @BugenZhao)
• fix(stream): LocalSimpleAgg should not output Chunk while no inputs (#354 by @TennyZhuang)
• fix: enable block cache for hummock+s3 state store (#355 by @wcy-fdu)
• fix(streaming): simple dispatcher should not use 0 proto (#356 by @skyzh)
• fix: MetaStore transaction should expose cf as parameter. (#358 by @zwang28)
• fix(dashboard): restore actor addr display (#368 by @MrCroxx)
• fix(doc): remove unused dependency (#370 by @BowenXiao1999)
• fix(storage): fix TiKV state store (#350 by @hzxa21)
• fix: fix tikv statestore scanning with None limit (#395 by @wcy-fdu)
  ...

v0.1.2

• no changes

v0.1.1

• no changes