Airgoodies is a project that contains various APIs to interact with external services inside Apache Airflow using
minimum configuration (see airgoodies.{module}.variables.json for each module).
Current version matrix:
| Airgoodies Version | Apache Airflow Version | Python Version | Project tag |
|---|---|---|---|
| 0.0.4 | 2.7.2 | 3.11 | v0.0.4 |
| 0.0.3 | 2.7.2 | 3.11 | v0.0.3 |
| 0.0.2 | 2.7.2 | 3.11 | v0.0.2 |
| 0.0.1-alpha | 2.7.2 | 3.11 | v0.0.1-alpha |
Provided goodies for version 0.0.4:
| Module | Description | Dependency Versions |
|---|---|---|
| airgoodies.command | API for dynamic task configuration through YAML | pyyaml==6.0.1 |
| airgoodies.aws | API for easy interaction with AWS | pandas==2.1.1 apache-airflow-providers-amazon===8.7.1 |
| airgoodies.mongo | API for easy interaction with MongoDB | pymongo==4.5.0 |
| airgoodies.xcom | API for managing variables through XCom | None |
Add the following requirement in your requirements.txt
# requirements.txt
airgoodies=0.0.4
For the official documentation, see here
For an example of how to use this project, see here
To build the project:
$ python3 setup.py sdist bdist_wheelThis project is available under the MIT License.
Stavros Grigoriou (stav121)