Skip to content

jiayu/avro-pig-converter

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 

Repository files navigation

avro-pig-converter

About the project

This was oringinally from a project I was working on with one of my client. We stored some data in avro format as metadata of the sequence file. When we read the metadata in Pig, we wanted to find a way to easily convert this metadata into tuple. As they were part of the sequence file, we could not use org.apache.pig.piggybank.storage.avro.AvroStorage from the piggybank. As a result, I started this project.

For now, there is only one way conversion which is from Avro to Pig.

TO-DOs

  1. Remove SPEL dependency
  2. Add a sample project
  3. Add Pig to Avro conversion

Contact

If you find this interesting or you want to contribute, email me at [email protected]

About

Converting avro objects into pig tuples

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages