HSTCAL 2.2.0rc2 Release Notes

HSTCAL Version 2.2.0rc2

The following updates, specified in separate sections for each instrument, have been included with this release. This release is presented as HSTDP-2018.3 milestones

HSTCAL package updates

• Regression testing has been implemented via pytest and Jenkins.
• The CFITSIO library is no longer built as a static library incorporated into the HSTCAL executables.

HSTIO

HSTDP-2018.3 Milestones

• HSTIO updates to Version 2.7.
• Functionality has been added to determine the number of HST IMSETS in a FITS file in a robust fashion PR#330.

ACS

HSTDP-2018.3 Milestones, Data Changes

• CALACS updates to Version 10.1.0 due to updates in the ACSCCD and ACS2D algorithms.

• The dark correction, DARKCORR step of the ACS2D algorithm, has been modified to work directly on the full 2D data rather than on a line-by-line basis PR#315.

• The bias shift correction, BLEVCORR step of the ACSCCD algorithm, has been upgraded to accommodate the new supported subarrays which have both physical and virtual overscan PR#312. This is the same algorithm which applies to full frame data.

• Forward model functionality was implemented which exploits the existing CTE code and usage (Generation 2 only). Instead of correcting the CTE trails, the forward model functionality simulates (adds) the trails PR#313. This functionality should be accessed via the new ACSTOOLS function, acscteforwardmodel.py

• Updated ACS library routine, getacskeys, updated to call the new HSTIO function which robustly determines the number of IMSETS in a FITS file PR#330.

• Affects old data

• Users should re-retrieve affected datasets from the archive

• Updated reference files delivered by science team

STIS

• CALSTIS remains at Version 3.4.2 for this release.

• Affects old data

• Users should re-retrieve affected datasets from the archive

• Updated reference files delivered by science team

WFC3

• CALWF3 bumped to Version 3.5.0 for this release.

• Bug fixes to CTE correction inwf3cte.e

  • #366 - Fix out of bounds memory access: changes data.
  • #93 - Remove unessacary re-computation of cte correction due to over-subtracted tails: no change to data.

• Code tidy up to CTE correction inwf3cte.e

  • #367 - Remove unnecessary critical section.

• Affects old data
• Users should re-retrieve affected datasets from the archive
• Updated reference files delivered by science team

HSTCAL 2.2.0rc1 Release Notes

HSTCAL Version 2.2.0rc1

This is a tagged version of HSTCAL, but it was never actually released to DMS.

This release is an immediate update and counterpart to the HSTCAL 2.1.0 release which predominantly addressed ACS enhancements, supplemented by changes to WFC3 and HSTIO. This release contains only changes for WFC3. The HSTCAL Minor version designation has been increased as the CTE corrected data exhibits a change from previous output.

WFC3

• CALWF3 bumped to Version 3.5.0 for this release.

• Bug fixes to CTE correction inwf3cte.e

  • #366 - Fix out of bounds memory access: changes data.

• Code tidy up to CTE correction inwf3cte.e

  • #367 - Remove unnecessary critical section.

• Affects old data
• Users should re-retrieve affected datasets from the archive
• Updated reference files delivered by science team

HSTCAL 2.1.0 Release Notes

HSTCAL Version 2.1.0

The following updates, specified in separate sections for each instrument, have been included with this release. This release is presented as HSTDP-2018.3 milestones

HSTCAL package updates

• The CFITSIO library is no longer built as a static library incorporated into the HSTCAL executables.

HSTIO

HSTDP-2018.3 Milestones

• HSTIO updates to Version 2.7.
• Functionality has been added to determine the number of HST IMSETS in a FITS file in a robust fashion PR#330.

ACS

HSTDP-2018.3 Milestones, Data Changes

• CALACS updates to Version 10.1.0 due to updates in the ACSCCD and ACS2D algorithms.

• The dark correction, DARKCORR step of the ACS2D algorithm, has been modified to work directly on the full 2D data rather than on a line-by-line basis PR#315.

• The bias shift correction, BLEVCORR step of the ACSCCD algorithm, has been upgraded to accommodate the new supported subarrays which have both physical and virtual overscan PR#312. This is the same algorithm which applies to full frame data.

• Forward model functionality was implemented which exploits the existing CTE code and usage (Generation 2 only). Instead of correcting the CTE trails, the forward model functionality simulates (adds) the trails PR#313. This functionality should be accessed via the new ACSTOOLS function, acscteforwardmodel.py

• Updated ACS library routine, getacskeys, updated to call the new HSTIO function which robustly determines the number of IMSETS in a FITS file PR#330.

• Affects old data

• Users should re-retrieve affected datasets from the archive

• Updated reference files delivered by science team

STIS

• CALSTIS remains at Version 3.4.2 for this release.

• Affects old data

• Users should re-retrieve affected datasets from the archive

• Updated reference files delivered by science team

WFC3

• CALWF3 remains at Version 3.4.2 for this release (version should have been bumped to 3.4.3).

• In appropriate out of bounds memory access fixed with no change to output data in wf3cte.c.PR#93.

• Affects old data

• Users should re-retrieve affected datasets from the archive

• Updated reference files delivered by science team

HSTCAL 2.0.0 Release Notes

HSTCAL Version 2.0.0

The following updates, specified in separate sections for each instrument, have been included with this release. This release is presented as HSTDP-2018.1 milestones.

HSTCAL package updates

• The separate trailer file support routines used by ACS, WFC3, and STIS were consolidated into a single file, and are now part of libhstcallib.a.

HSTIO

HSTDP-2018.1 Milestones

• Improvements in robustness and maintainability have been made to the infrastructure software (HSTIO) and libraries which are the foundation for the pipelines.

ACS

HSTDP-2018.1 Milestones, Data Changes

• CALACS updates to Version 10.0.0 due to the modifications imposed by the upgraded ACSREJ algorithm.

• An updated ACSREJ algorithm was implemented where all calculations are now done in electrons versus DN. The threshold computation uses the ERR arrays to account for post-flash noise PR#2.

• CALACS now uses the amp-dependent read noise as the threshold to determine if a pixel has enough signal-to-noise ratio such that a reasonable correction can be applied PR#258.

• A bug fix has been implemented which is only applicable for RAWs with PCTECORR=PERFORM for ASNs used for cosmic ray rejection. In this case the CR rejected output (CRJ) previously used the wrong dark; it used the CTE-corrected dark. This has been addressed, and the CRJ product is now correct utilizing the non-CTE corrected dark PR#273.

• All BIAS files are now processed by CALACS to use only read noise (vs Poisson) for the computation of the ERR array as the date discriminant (pre- and post-SM4) has been removed PR#288.

• The C interface to the ACSREJ standalone component of CALACS was modified for clarity. The "newbias" option was renamed "readnoise_only". The functionality associated with this option remains the same.

• Affects old data

• Users should re-retrieve affected datasets from the archive

• Updated reference files delivered by science team

STIS

HSTDP-2018.1 Milestones

• calstis version 3.4.2

• Bugs were addressed: memory leak, added --help option, ensure printing of syntax usage when necessary

• Affects old data

• Users should re-retrieve affected datasets from the archive

• Updated reference files delivered by science team

WFC3

HSTDP-2018.1 Milestones

• CALWF3 updates to Version 3.4.2 for this release.

• A number of code robustness improvements (address memory leaks, fix detected bugs) were implemented.

• Affects old data

• Users should re-retrieve affected datasets from the archive

• Updated reference files delivered by science team

HSTCAL 1.3.0 Release Notes

HSTCAL Version 1.3.0

The following updates have been included with this release.

ACS

• CALACS updates to version 9.2.0 with this release.

• New BLEVCORR algorithm that uses new OSCNTAB, which now correctly calculates bias level for AMP B and D in subarrays.

• New SINKCORR step to apply new SNKCFILE in order to flag sink pixels. See ACS ISR 2017-01.

• New pixel based PCTECORR algorithm implemented (CTE_NAME= 'PixelCTE 2017').

  • The code defaults to this new algorithm, however, the old one can still be executed using the command line option --ctegen <1|2>. Note: The correct accompanying PCTETAB file must also be used.
  • The user can now override the PCTETAB file used (normally specified in the image header) with the command line option --pctetab <file path>.
  • The number of threads used for computing the PCTECORR can now be specified with the command line option --nthreads <N>. Note: OPENMP is required for N > 1.

• Fixed uninitialized variable in prinfo.c.

• Corrected --version reporting and added -r to report version string that was previously reported by --version.

• Affects old data.

• Users should re-retrieve affected datasets from the archive.

• Updated reference files delivered by science team.

Notes

• Due to the quick succession of this release from 1.2.0, please refer to the following release notes for other recent updates.

HSTCAL 1.3.0rc6 Release Notes

HSTCAL Version 1.3.0rc6

The following updates have been included with this release.

ACS

• CALACS updates to version 9.2.0 with this release.

• New BLEVCORR algorithm that uses new OSCNTAB, which now correctly calculates bias level for AMP B and D in subarrays.

• New SINKCORR step to apply new SNKCFILE in order to flag sink pixels. See ACS ISR 2017-01.

• New pixel based PCTECORR algorithm implemented (CTE_NAME= 'PixelCTE 2017').

  • The code defaults to this new algorithm, however, the old one can still be executed using the command line option --ctegen <1|2>. Note: The correct accompanying PCTETAB file must also be used.
  • The user can now override the PCTETAB file used (normally specified in the image header) with the command line option --pctetab <file path>.
  • The number of threads used for computing the PCTECORR can now be specified with the command line option --nthreads <N>. Note: OPENMP is required for N > 1.

• Fixed uninitialized variable in prinfo.c.

• Corrected --version reporting and added -r to report version string that was previously reported by --version.

• Affects old data.

• Users should re-retrieve affected datasets from the archive.

• Updated reference files delivered by science team.

Notes

• Due to the quick succession of this release from 1.2.0, please refer to the following release notes for other recent updates.

HSTCAL 1.3.0rc5 Release Notes

HSTCAL Version 1.3.0rc5

The following updates have been included with this release.

ACS

• CALACS updates to version 9.2.0 with this release.

• New BLEVCORR algorithm that uses new OSCNTAB, which now correctly calculates bias level for AMP B and D in subarrays.

• New SINKCORR step to apply new SNKCFILE in order to flag sink pixels. See ACS ISR 2017-01.

• New pixel based PCTECORR algorithm implemented (CTE_NAME= 'PixelCTE 2017').

  • The code defaults to this new algorithm, however, the old one can still be executed using the command line option --ctegen <1|2>. Note: The correct accompanying PCTETAB file must also be used.
  • The user can now override the PCTETAB file used (normally specified in the image header) with the command line option --pctetab <file path>.
  • The number of threads used for computing the PCTECORR can now be specified with the command line option --nthreads <N>. Note: OPENMP is required for N > 1.

• Fixed uninitialized variable in prinfo.c.

• Corrected --version reporting and added -r to report version string that was previously reported by --version.

• Affects old data.

• Users should re-retrieve affected datasets from the archive.

• Updated reference files delivered by science team.

Notes

• Due to the quick succession of this release from 1.2.0, please refer to the following release notes for other recent updates.

HSTCAL 1.3.0rc4 Release Notes

HSTCAL Version 1.3.0rc4

The following updates have been included with this release.

ACS

• CALACS updates to version 9.2.0 with this release.

• New BLEVCORR algorithm that uses new OSCNTAB, which now correctly calculates bias level for AMP B and D in subarrays.

• New SINKCORR step to apply new SNKCFILE in order to flag sink pixels. See ACS ISR 2017-01.

• New pixel based PCTECORR algorithm implemented (CTE_NAME= 'PixelCTE 2017').

  • The code defaults to this new algorithm, however, the old one can still be executed using the command line option --ctegen <1|2>. Note: The correct accompanying PCTETAB file must also be used.
  • The user can now override the PCTETAB file used (normally specified in the image header) with the command line option --pctetab <file path>.
  • The number of threads used for computing the PCTECORR can now be specified with the command line option --nthreads <N>. Note: OPENMP is required for N > 1.

• Fixed uninitialized variable in prinfo.c.

• Corrected --version reporting and added -r to report version string that was previously reported by --version.

• Affects old data.

• Users should re-retrieve affected datasets from the archive.

• Updated reference files delivered by science team.

Notes

• Due to the quick succession of this release from 1.2.0, please refer to the following release notes for other recent updates.

HSTCAL 1.3.0rc3 Release Notes

HSTCAL Version 1.3.0rc3

The following updates have been included with this release.

ACS

• CALACS updates to version 9.2.0 with this release.

• New BLEVCORR algorithm that uses new OSCNTAB, which now correctly calculates bias level for AMP B and D in subarrays.

• New SINKCORR step to apply new SNKCFILE in order to flag sink pixels. See ACS ISR 2017-01.

• New pixel based PCTECORR algorithm implemented (CTE_NAME= 'PixelCTE 2017').

  • The code defaults to this new algorithm, however, the old one can still be executed using the command line option --ctegen <1|2>. Note: The correct accompanying PCTETAB file must also be used.
  • The user can now override the PCTETAB file used (normally specified in the image header) with the command line option --pctetab <file path>.
  • The number of threads used for computing the PCTECORR can now be specified with the command line option --nthreads <N>. Note: OPENMP is required for N > 1.

• Fixed uninitialized variable in prinfo.c.

• Corrected --version reporting and added -r to report version string that was previously reported by --version.

• Affects old data.

• Users should re-retrieve affected datasets from the archive.

• Updated reference files delivered by science team.

Notes

• Due to the quick succession of this release from 1.2.0, please refer to the following release notes for other recent updates.

HSTCAL 1.3.0rc2 Release Notes

HSTCAL Version 1.3.0rc2

The following updates have been included with this release.

ACS

• CALACS updates to version 9.2.0 with this release.

• New BLEVCORR algorithm that uses new OSCNTAB, which now correctly calculates bias level for AMP B and D in subarrays.

• New SINKCORR step to apply new SNKCFILE in order to flag sink pixels. See ACS ISR 2017-01.

• New pixel based PCTECORR algorithm implemented (CTE_NAME= 'PixelCTE 2017').

  • The code defaults to this new algorithm, however, the old one can still be executed using the command line option --ctegen <1|2>. Note: The correct accompanying PCTETAB file must also be used.
  • The user can now override the PCTETAB file used (normally specified in the image header) with the command line option --pctetab <file path>.
  • The number of threads used for computing the PCTECORR can now be specified with the command line option --nthreads <N>. Note: OPENMP is required for N > 1.

• Fixed uninitialized variable in prinfo.c.

• Corrected --version reporting and added -r to report version string that was previously reported by --version.

• Affects old data.

• Users should re-retrieve affected datasets from the archive.

• Updated reference files delivered by science team.

Notes

• Due to the quick succession of this release from 1.2.0, please refer to the following release notes for other recent updates.