Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add runtime management interface #2

Open
wants to merge 7 commits into
base: main
Choose a base branch
from

Conversation

kaori-seasons
Copy link
Owner

@kaori-seasons kaori-seasons commented Aug 8, 2023

refer to runtime management

Design doc
h4h4h56

b4gb4b

purpose of change

    1. When a user starts a task, each task executes the logic of dispatching events to different targets. Why is k8s introduced? The purpose of introducing k8s is to ensure that the tasks run by each tenant in a multi-tenant scenario can achieve Resources are recycled during low peak hours and filled up during peak hours.
    1. Since a task itself includes delivery from one event source to multiple destinations, each destination may be WeChat, DingTalk. The data channels laid are different rocketmq Cluster. Therefore, it is necessary to apply for the corresponding resources for the total number of tasks that need to be delivered by different rocketmq clusters.
    1. This resource is a relatively large collection. How to design the master-worker architecture can ensure that different event sources pass through the specified rocketmq cluster and The total number of tasks is applied for the corresponding resources, and then dispatched to the corresponding worker execution thread
    1. How to perceive whether the task is being executed before and after the dispatch, and whether the dispatch status of the task that throws an exception during runtime execution should be terminated or retried
    1. If the task dispatch is successful, should the resources already applied be returned to avoid subsequent resource preemption? How to calculate the deduction of resource applications and how to reasonably allocate resources for different tenants

comtinue...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant