-
Notifications
You must be signed in to change notification settings - Fork 43
FAQ
Most GPU-enabled software treats the GPU as an implementation detail to be hidden from their external interfaces. This is a sensible choice when only one project in a data science pipeline is GPU-accelerated, but it becomes less and less efficient as more applications and libraries in the pipeline gain GPU-accelerated implementations. The GOAI members recognized this difficulty, and are collaborating to create an open spec and set of tools for data exchange between libraries and applications without needing to move data off the GPU.
Currently, GDF is using the Apache Arrow format for exchanging data between GPU libraries. We intend to follow the Arrow spec unless we encounter a significant drawback to doing so, in which case we will document our difference from the spec and the justification for it.
Right now GDF is very experimental and the features in libGDF and PyGDF are evolving rapidly. GDF will be of greatest interest to developers, but we hope to have beta functionality ready for early adopter users before Sept 2017.