Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add a flux command for waiting a specific time #495

Open
fsteeg opened this issue Aug 10, 2023 · 2 comments · May be fixed by #559
Open

Add a flux command for waiting a specific time #495

fsteeg opened this issue Aug 10, 2023 · 2 comments · May be fixed by #559
Assignees
@fsteeg

Comments

@fsteeg
Copy link
Member

fsteeg commented Aug 10, 2023

Use case is a workflow where we use open-http to POST records to an API. When working with large input data, we'd like to wait a short amount of time between each post to avoid creating too much load on the server. While this could be done with an additional option for open-http, perhaps a generic wait command, with the option to set the time would be the best approach?
@blackwinter
Copy link
Member

Does wait imply waiting for something? (Like wait-for-inputs for instance.)

Maybe sleep would be better? (Could also be a Fix function; see Catmandu.)

@TobiasNx
Copy link
Contributor

TobiasNx commented Sep 23, 2024 •
edited
Loading

I would upvote this. It became relevant to me too when trying to scrape a website with to many requests but without getting banned but getting shortly blocked for the frequency of the requests.

TobiasNx added a commit that referenced this issue Sep 24, 2024
@TobiasNx
Add draft for object sleeper #495
26ea5b4
TobiasNx added a commit that referenced this issue Sep 24, 2024
@TobiasNx
Add draft for object sleeper #495
a9b3982
TobiasNx added a commit that referenced this issue Oct 17, 2024
@TobiasNx
Adjust ObjectSleeper.java #495
489a74d
@TobiasNx TobiasNx linked a pull request Oct 17, 2024 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@fsteeg fsteeg

Labels
None yet
Projects
Metafacture
Status: Review
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add new flux command sleep #495 metafacture/metafacture-core
3 participants
@blackwinter @fsteeg @TobiasNx