Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing iir params in status frame. #40

Open
msilvafe opened this issue Jun 20, 2024 · 4 comments
Open

Missing iir params in status frame. #40

msilvafe opened this issue Jun 20, 2024 · 4 comments
Assignees

Comments

@msilvafe
Copy link

We found when processing data at level3 that some wafers within some obs (according to @amaurea ~5% of satp3 data he used to map) is missing the iir_params information. Some examples are:

  1. obsid: obs_1717850846_satp3_1111111 wafers: mv5, mv23
  2. obsid: obs_1717908165_satp3_1111111 wafers: mv23

I looked at obs_1717908165_satp3_1111111 and confirmed that iir_params are present on all other wafers just missing on mv23. Then I went to the level2 data and confirmed it didn't exist there or in the status frame however fscale and enabled parameters related to the iir filter were present. So this seems like a failure where that info from pysmurf doesn't make it into the status frame.

Screenshot 2024-06-20 at 3 05 26 PM

@mhasself
Copy link
Member

Can you easily check the TOD to see if the PSD shows the expected roll-off? It would be nice to confirm that, although the parameters are missing, the filter was both configured as usual and enabled.

@msilvafe
Copy link
Author

Can you easily check the TOD to see if the PSD shows the expected roll-off? It would be nice to confirm that, although the parameters are missing, the filter was both configured as usual and enabled.

Yes the readout filter is still on based on the PSD:
image

@jlashner
Copy link
Collaborator

Hey @msilvafe, any chance there's a record of obs_ids that have failed preprocessing on satp1 due to this problem? If there is a cache of failed obs-ids that would be helpful for me to try to figure out under what conditions this was happening.

@mmccrackan
Copy link

@jlashner. The error did not seem to occur at all on the satp1 site-pipeline run that I just ran, only on the satp3 run. Here are the list of obs_ids from satp3 just in case.
iir_param_obs_id.txt

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants