Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Examples on fire and forget models #7994

Open
ykethan opened this issue Sep 24, 2024 · 0 comments
Open

Examples on fire and forget models #7994

ykethan opened this issue Sep 24, 2024 · 0 comments

Comments

@ykethan
Copy link
Member

ykethan commented Sep 24, 2024

Is your feature request related to a problem? Please describe.
Issue: aws-amplify/amplify-backend#2026 (comment)

The Fire and Forget model seems to have limited applications from a first glance... Jobs taking longer than 30 secs would benefit from a mechanism to poll/monitor progress and completion, I think...

My need right now is to recursively poll an FTP server for file paths carrying specific prefixes, build a list of file paths that need to be download then transfer the download requests to Fargate tasks on ECS to copy the file on S3. Surveying the FTP server takes some time (usually less than 30 seconds but depending on latency sometime up to a minute or so...). The files can be pretty massive, ranging from a few Gb close to a fraction of Tb, hence passing the copy request to Fargate.

Thanks for any suggestions. Adding more patterns to the docs could prove helpful!

Describe the solution you'd like
examples providing this pattern

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant