Skip to content

Commit

Permalink
Update datafusion to v40 (major) (#455)
Browse files Browse the repository at this point in the history
[![Mend
Renovate](https://app.renovatebot.com/images/banner.svg)](https://renovatebot.com)

This PR contains the following updates:

| Package | Type | Update | Change |
|---|---|---|---|
| [datafusion](https://datafusion.apache.org)
([source](https://togithub.com/apache/datafusion)) |
workspace.dependencies | major | `39.0.0` -> `40.0.0` |
| [datafusion-common](https://datafusion.apache.org)
([source](https://togithub.com/apache/datafusion)) |
workspace.dependencies | major | `39.0.0` -> `40.0.0` |
| [datafusion-execution](https://datafusion.apache.org)
([source](https://togithub.com/apache/datafusion)) |
workspace.dependencies | major | `39.0.0` -> `40.0.0` |
| [datafusion-expr](https://datafusion.apache.org)
([source](https://togithub.com/apache/datafusion)) |
workspace.dependencies | major | `39.0.0` -> `40.0.0` |
| [datafusion-physical-expr](https://datafusion.apache.org)
([source](https://togithub.com/apache/datafusion)) |
workspace.dependencies | major | `39.0.0` -> `40.0.0` |
| [datafusion-physical-plan](https://datafusion.apache.org)
([source](https://togithub.com/apache/datafusion)) |
workspace.dependencies | major | `39.0.0` -> `40.0.0` |

---

### Release Notes

<details>
<summary>apache/datafusion (datafusion)</summary>

###
[`v40.0.0`](https://togithub.com/apache/datafusion/compare/39.0.0...40.0.0)

[Compare
Source](https://togithub.com/apache/datafusion/compare/39.0.0...40.0.0)

</details>

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about these
updates again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Mend
Renovate](https://www.mend.io/free-developer-tools/renovate/). View
repository job log
[here](https://developer.mend.io/github/spiraldb/vortex).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40MjUuMSIsInVwZGF0ZWRJblZlciI6IjM3LjQyNS4xIiwidGFyZ2V0QnJhbmNoIjoiZGV2ZWxvcCIsImxhYmVscyI6W119-->

---------

Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: Robert Kruszewski <[email protected]>
  • Loading branch information
renovate[bot] and robert3005 authored Jul 16, 2024
1 parent 79482e0 commit a9ee529
Show file tree
Hide file tree
Showing 5 changed files with 52 additions and 36 deletions.
58 changes: 30 additions & 28 deletions Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

12 changes: 6 additions & 6 deletions Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -53,12 +53,12 @@ criterion = { version = "0.5.1", features = ["html_reports"] }
croaring = "2.0.0"
csv = "1.3.0"
object_store = "0.10.1"
datafusion = "39.0.0"
datafusion-common = "39.0.0"
datafusion-execution = "39.0.0"
datafusion-expr = "39.0.0"
datafusion-physical-expr = "39.0.0"
datafusion-physical-plan = "39.0.0"
datafusion = "40.0.0"
datafusion-common = "40.0.0"
datafusion-execution = "40.0.0"
datafusion-expr = "40.0.0"
datafusion-physical-expr = "40.0.0"
datafusion-physical-plan = "40.0.0"
divan = "0.1.14"
duckdb = "1.0.0"
enum-iterator = "2.0.0"
Expand Down
3 changes: 2 additions & 1 deletion bench-vortex/benches/datafusion_benchmark.rs
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,9 @@ use criterion::{black_box, criterion_group, criterion_main, BenchmarkGroup, Crit
use datafusion::common::Result as DFResult;
use datafusion::datasource::{MemTable, TableProvider};
use datafusion::execution::memory_pool::human_readable_size;
use datafusion::functions_aggregate::count::count_distinct;
use datafusion::logical_expr::lit;
use datafusion::prelude::{col, count_distinct, DataFrame, SessionContext};
use datafusion::prelude::{col, DataFrame, SessionContext};
use lazy_static::lazy_static;
use vortex::compress::CompressionStrategy;
use vortex::encoding::EncodingRef;
Expand Down
7 changes: 6 additions & 1 deletion vortex-datafusion/src/lib.rs
Original file line number Diff line number Diff line change
Expand Up @@ -455,6 +455,10 @@ impl RecordBatchStream for VortexRecordBatchStream {
}

impl ExecutionPlan for VortexScanExec {
fn name(&self) -> &str {
VortexScanExec::static_name()
}

fn as_any(&self) -> &dyn Any {
self
}
Expand Down Expand Up @@ -495,8 +499,9 @@ impl ExecutionPlan for VortexScanExec {
mod test {
use arrow_array::types::Int64Type;
use datafusion::arrow::array::AsArray;
use datafusion::functions_aggregate::count::count_distinct;
use datafusion::prelude::SessionContext;
use datafusion_expr::{col, count_distinct, lit};
use datafusion_expr::{col, lit};
use vortex::array::primitive::PrimitiveArray;
use vortex::array::struct_::StructArray;
use vortex::array::varbin::VarBinArray;
Expand Down
8 changes: 8 additions & 0 deletions vortex-datafusion/src/plans.rs
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,10 @@ impl DisplayAs for RowSelectorExec {
}

impl ExecutionPlan for RowSelectorExec {
fn name(&self) -> &str {
RowSelectorExec::static_name()
}

fn as_any(&self) -> &dyn Any {
self
}
Expand Down Expand Up @@ -278,6 +282,10 @@ impl DisplayAs for TakeRowsExec {
}

impl ExecutionPlan for TakeRowsExec {
fn name(&self) -> &str {
TakeRowsExec::static_name()
}

fn as_any(&self) -> &dyn Any {
self
}
Expand Down

0 comments on commit a9ee529

Please sign in to comment.