Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug-1911367: Remove processor heartbeat and process metrics #6776

Merged
merged 1 commit into from
Oct 31, 2024

Conversation

willkg
Copy link
Contributor

@willkg willkg commented Oct 31, 2024

This removes processor heartbeat (and the scaffolding for that heartbeat) which generated process metrics for the processor container. We don't need those anymore--the problem those were added to help us understand is long gone now.

This removes processor heartbeat (and the scaffolding for that
heartbeat) which generated process metrics for the processor container.
We don't need those anymore--the problem those were added to help us
understand is long gone now.
@willkg willkg requested a review from a team as a code owner October 31, 2024 02:18
@@ -76,7 +64,6 @@ def __init__(
idle_delay=7,
quit_on_empty_queue=False,
job_source_iterator=default_iterator,
heartbeat_func=default_heartbeat,
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Socorro still has this TaskManager and ThreadedTaskManager which is the last remnants for how socorro service processes were structured a long long time ago.

In this PR, I removed the heartbeat function from the processor app as well as the scaffolding for heartbeats for any app that uses the task managers figuring we don't need that anymore. (We can always re-add it if we do need it.)

@@ -109,7 +94,7 @@ def _get_iterator(self):
job_source_iterator can be one of a few things:

* a class that can be instantiated and iterated over
* a function that returns an interator
* a function that returns an iterator
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I set up pre-commit and it's now fixing typos.

)

except Exception as exc:
sentry_sdk.capture_exception(exc)
Copy link
Contributor Author

@willkg willkg Oct 31, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Buh-bye!

One nice thing about removing this code is that when you have the processor running in a local dev environment, it's constantly producing output to the console even when it's just sitting around which was kind of annoying and now it won't be anymore.

@willkg willkg added this pull request to the merge queue Oct 31, 2024
@willkg
Copy link
Contributor Author

willkg commented Oct 31, 2024

Thank you!

This change will be very nice because it'll result in a lot less console output from the processor.

Merged via the queue into main with commit fd89e5f Oct 31, 2024
1 check passed
@willkg willkg deleted the willkg-bug-1911367-hb-monitoring branch October 31, 2024 15:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants