Pinned Loading

1. uber/petastorm uber/petastorm Public

   Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch…

   Python 1.8k 284

2. apache/arrow apache/arrow Public

   Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

   C++ 14.6k 3.6k

3. spotify/scio spotify/scio Public

   A Scala API for Apache Beam and Google Cloud Dataflow.

   Scala 2.6k 513

4. apache/beam apache/beam Public

   Apache Beam is a unified programming model for Batch and Streaming data processing.

   Java 7.9k 4.3k

5. apache/parquet-java apache/parquet-java Public

   Apache Parquet Java

   Java 2.6k 1.4k

6. spotify/simple-bigtable spotify/simple-bigtable Public

   Java 36 20