Skip to content
This repository has been archived by the owner on Dec 17, 2021. It is now read-only.

Support S3/etc output instead of disk-based output #197

Open
konklone opened this issue Feb 25, 2018 · 0 comments
Open

Support S3/etc output instead of disk-based output #197

konklone opened this issue Feb 25, 2018 · 0 comments

Comments

@konklone
Copy link
Contributor

It would be a very handy feature to drop data output to S3 instead of to disk. This would enable easy searching/indexing of output in something like Amazon Athena, while also requiring a lot less infrastructure/disk/constraints to run domain-scan itself.

Since the abstraction difference between S3 and disk is pretty slim, it would also be likely worth it to add in enough adapter-ish code to easily support being extended to other non-disk destinations, such as Google Cloud Storage.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant