Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

glitches in monitoring and CLI output #235

Open
pwittich opened this issue Sep 5, 2024 · 0 comments
Open

glitches in monitoring and CLI output #235

pwittich opened this issue Sep 5, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@pwittich
Copy link
Contributor

pwittich commented Sep 5, 2024

Describe the bug
When looking at the grafana of apollo204 I see occasional glitches on certain quantities that are reported.

fpga_temp_glitches
I can also see this on the CLI. see e.g. below on F2_3. These are read out in rapid succession.

% fpga
FPGA monitors
READ_TEMPERATURE_1
 F1_0: 62.00     F1_1: 59.00
 F1_2: 61.50     F1_3: 57.00
 F2_0: 62.50     F2_1: 58.50
 F2_2: 60.00     F2_3: 52.50
% fpga
FPGA monitors
READ_TEMPERATURE_1
 F1_0: 62.00     F1_1: 59.50
 F1_2: 61.00     F1_3: 57.50
 F2_0: 60.50     F2_1: 59.50
 F2_2: 58.50     F2_3: 00.00
% fpga
FPGA monitors
READ_TEMPERATURE_1
 F1_0: 62.50     F1_1: 59.50
 F1_2: 60.00     F1_3: 57.00
 F2_0: 61.00     F2_1: 58.50
 F2_2: 59.50     F2_3: 54.00

This doesn't appear to happen on all quantities (e.g., the ADC from the MCU quantities don't have this issue. (These are internal quantities read out from on-device peripherals.) The received optical power doesn't have this issue (this is read out via I2C from the FF devices), while the firefly temperatures have it on one particular temperature (!!), F1_P1_TX12, which is zero most of the time except occasionaly glitches to a reasonable value.

The ones with issue appear to be the ones with the SMBUS readout, i.e., the FPGAs and the LGA80D power supplies.

@pwittich pwittich added the bug Something isn't working label Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant