Myriad is a mesos framework designed for scaling a YARN cluster on Mesos. Myriad can expand or shrink the resources managed by a YARN cluster in response to events as per configured rules and policies.
The name Myriad means, countless or extremely great number. In context of the project, it allows one to expand overall resources managed by Mesos, even when the cluster under mesos management runs other cluster managers like YARN.
Please note: Myriad is a work in progress, and should not be used in production at this point.
- How Myriad works
- Developing Myriad
- Local vagrant setup guide
- Myriad REST API
- Auto-scaling YARN cluster
- Mesos, YARN and cgroups
Myriad is a work in progress, please keep checking this section for updates.
- Custom Executor for managing NodeManager
- Support multi-tenancy for node-managers
- Support unique constraint to let only one node-manager run on a slave
- Configuration store for storing rules and policies for clusters managed by Myriad
- NodeManager Profiles
- High Availability mode for framework
- Framework checkpointing
- Framework re-conciliation