Code

Streaming Writes implementation#305

Code

Merged

kylebarron merged 7 commits intokylebarron:mainkylebarron/parquet-wasm:mainfrom H-Plus-Time:streaming-writesH-Plus-Time/parquet-wasm:streaming-writesCopy head branch name to clipboardJul 29, 2024

+222-2

Commits

Commits on Jun 18, 2024

• Reworked/adapted streaming writes implementation. TODO: copy over tests

  H-Plus-Time

  committed
  238d365

  Copy full SHA for 238d365

• streaming write tests

  H-Plus-Time

  committed
  6927ffe

  Copy full SHA for 6927ffe

• cargo fmt, address clippy recommendations

  H-Plus-Time

  committed
  dd672fe

  Copy full SHA for dd672fe

Commits on Jul 5, 2024

• Eliminate majority of unwraps, distinguish better between various error cases in transform_parquet_stream. TODO: eliminate un-handled result returns (writer.write, sender.send, writer.close).

  H-Plus-Time

  committed
  87c9e3f

  Copy full SHA for 87c9e3f

• Obey clippy

  H-Plus-Time

  committed
  b27ddec

  Copy full SHA for b27ddec

Commits on Jul 27, 2024

• Flesh out transformParquetStream docstring, include a few examples focussed on useful streaming flows.

  H-Plus-Time

  committed
  7c87452

  Copy full SHA for 7c87452

• Obey the linter

  H-Plus-Time

  committed
  2930f11

  Copy full SHA for 2930f11