Skip to content

Latest commit

 

History

History
38 lines (31 loc) · 1017 Bytes

TODO.md

File metadata and controls

38 lines (31 loc) · 1017 Bytes

TODO

UI

  • User login / security
  • Tree view: remove dummy root node
  • Backfill wizard

Write unittests

  • For each existing operator

Command line

  • airflow task_state dag_id task_id YYYY-MM-DD

More Operators!

  • HIVE
  • BaseDataTransferOperator
  • File2MySqlOperator
  • PythonOperator
  • DagTaskSensor for cross dag dependencies
  • PIG

Macros

  • Previous execution timestamp
  • ...

Backend

  • Add decorator to timeout imports on master process lib
  • Clear should kill running jobs
  • Mysql port should carry through (using default now)

Misc

  • Write an hypervisor, looks for dead jobs without a heartbeat and kills
  • Authentication with Flask-Login and Flask-Principal
  • email_on_retry
  • Naming for the DatabaseConnection model was shortsighted, the same model can be used for any external connections (FTP, samba, ...), rename the model to Connection.

Wishlist

  • Support for cron like synthax (0 * * * ) using croniter library