Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add WFC3 notebook 'calwf3_with_v1.0_PCTE.ipynb' #100

Merged
merged 18 commits into from
Nov 17, 2023

Conversation

dulude
Copy link
Collaborator

@dulude dulude commented Oct 5, 2023

Relevant Tickets


This notebook checklist has been made available to us by the Notebooks For All team.
Its purpose is to serve as a guide for both the notebook author and the technical reviewer highlighting critical aspects to consider when striving to develop an accessible and effective notebook.

The First Cell

  • The title of the notebook in a first-level heading (eg. <h1> or # in markdown).
  • A brief description of the notebook.
  • A table of contents in an ordered list (1., 2., etc. in Markdown).
  • The author(s) and affiliation(s) (if relevant).
  • The date first published.
  • The date last edited (if relevant).
  • A link to the notebook's source(s) (if relevant).

The Rest of the Cells

  • There is only one H1 (# in Markdown) used in the notebook.
  • The notebook uses other heading tags in order (meaning it does not skip numbers).

Text

  • All link text is descriptive. It tells users where they will be taken if they open the link.
  • All acronyms are defined at least the first time they are used.
  • Field-specific/specialized terms are used when needed, but not excessively.

Code

  • Code sections are introduced and explained before they appear in the notebook. This can be fulfilled with a heading in a prior Markdown cell, a sentence preceding it, or a code comment in the code section.
  • Code has explanatory comments (if relevant). This is most important for long sections of code.
  • If the author has control over the syntax highlighting theme in the notebook, that theme has enough color contrast to be legible.
  • Code and code explanations focus on one task at a time. Unless comparison is the point of the notebook, only one method for completing the task is described at a time.

Images

  • All images (jpg, png, svgs) have an image description. This could be

    • Alt text (an alt property)
    • Empty alt text for decorative images/images meant to be skipped (an alt attribute with no value)
    • Captions
    • If no other options will work, the image is decribed in surrounding paragraphs.
  • Any text present in images exists in a text form outside of the image (this can be alt text, captions, or surrounding text.)

Visualizations

  • All visualizations have an image description. Review the previous section, Images, for more information on how to add it.

  • Visualization descriptions include

    • The type of visualization (like bar chart, scatter plot, etc.)
    • Title
    • Axis labels and range
    • Key or legend
    • An explanation of the visualization's significance to the notebook (like the trend, an outlier in the data, what the author learned from it, etc.)
  • All visualizations and their parts have enough color contrast (color contrast checker) to be legible. Remember that transparent colors have lower contrast than their opaque versions.

  • All visualizations convey information with more visual cues than color coding. Use text labels, patterns, or icons alongside color to achieve this.

  • All visualizations have an additional way for notebook readers to access the information. Linking to the original data, including a table of the data in the same notebook, or sonifying the plot are all options.

@dulude dulude added the WFC3 Wide Field Camera 3 label Oct 5, 2023
@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

This notebook relies on an old version of `hstcal` and therefore an old version of `calwf3`. Every `hstcal` version > 2.5.0 and every corresponding `calwf3` version > 3.5.2 will employ the v2.0 PCTE correction. Since this notebook's purpose is to demonstrate how to use the v1.0 PCTE correction, we must ensure `hstcal` version 2.5.0 is installed and used. I don't believe this version (2.5.0) is offered on conda-forge.
changing environment creation command to use the `requirements.txt` file
pinning the packages to the versions in my environment where the notebook runs successfully
removing version pins and adding `crds`
adding `crds bestref` to pull ref files and `crds sync` to pull necessary archived files
remove astropy sigma clip stats since it isn't used
@bjkuhn
Copy link
Contributor

bjkuhn commented Nov 15, 2023

hi @haticekaratay thank you for your help. I've finished working on this notebook and don't know how to fix whatever is going on with the pre-requirements.sh file. Can you please advise? Thank you!

@@ -21,23 +21,25 @@
"- Compare v1.0 and v2.0 products. \n",
Copy link
Collaborator

@haticekaratay haticekaratay Nov 17, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for your work. I have a suggestion to increase code readability: consider using more descriptive variable names instead of 'cl_inputs' and 'cl'.


Reply via ReviewNB

@@ -21,23 +21,25 @@
"- Compare v1.0 and v2.0 products. \n",
Copy link
Collaborator

@haticekaratay haticekaratay Nov 17, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These variable names also can be updated with more descriptive.


Reply via ReviewNB

@@ -21,23 +21,25 @@
"- Compare v1.0 and v2.0 products. \n",
Copy link
Collaborator

@haticekaratay haticekaratay Nov 17, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The CI runs the execution twice, resulting in the error shown in the log here : https://github.com/spacetelescope/hst_notebooks/actions/runs/6883163300/job/18723158842?pr=100#step:8:621

The error occurs because the file `idv404axq_flt.fits' already exists. To prevent this, you can run calibration only if the file doesn't exist from the previous run.

if not os.path.exists('idv404axq_flt.fits'):
    calwf3('idv404axq_raw.fits')

Additionaly, there might also be a flag you can pass to this method in calwf3 to overwrite if file exists. It's something you can look into from the docs. Thanks!


Reply via ReviewNB

@haticekaratay
Copy link
Collaborator

hi @haticekaratay thank you for your help. I've finished working on this notebook and don't know how to fix whatever is going on with the pre-requirements.sh file. Can you please advise? Thank you!

Hi @bjkuhn,

Thank you for your work. I wanted to let you know that the error message you received for the pre-requirements.sh file is not related to this specific notebook. I have already informed @dulude about this issue.

However, I have also identified some other reasons why the execution steps are failing, which I listed in the review. If you are able to update the notebook accordingly, this should resolve the issue.

Thanks again for your efforts.

made better variable names and added logic to check if the FLT file already exists
Copy link
Collaborator

@haticekaratay haticekaratay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @bjkuhn, for updating the notebook as suggested in the review. We also resolved the issue in the CI related to the pre-requirements.sh step in the actions.

@haticekaratay haticekaratay merged commit 31cbf7c into main Nov 17, 2023
7 checks passed
@mgough-970 mgough-970 deleted the add_wfc3_calwf3_v1.0_cte_notebook branch December 6, 2023 16:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
WFC3 Wide Field Camera 3
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants