Skip to content

Home

Jump to bottom
jeremywinters edited this page Apr 16, 2017 · 4 revisions
sneaql raccoon

Sneaking Interactivity into Static SQL Statements

Purpose

To enable conditional functionality in otherwise static SQL scripts in order to facilitate the following:

  • Automated SQL testing
  • Data integrity testing in production
  • Idempotent preconditions in SQL scripts
  • Simple parameterization

Origins

Full 360 has been building data warehouses in AWS since 2007. At first we used flow based ETL tools for data integration, but we always ended up running into the limitations of functionality and cloud/devops friendliness.

We soon moved on to building data ingestion processes with ruby, and eventually jruby (because of easy JDBC driver support) running in Docker containers. SneaQL is the distillation of our best practices using jruby and templatized SQL when interacting with columnar databases.

Home

FAQ

Tutorials and Use Cases

Installation

JDBC Drivers

Command Tags

Variables and Expressions

Transforms

Recordsets

Configuration

Command Line Interface

Environment Variables

Docker

Security

Extending SneaQL

Clone this wiki locally