Romancal 0.17.0 (25Q1_B16)

What's Changed

• rcal-906 Allow asn product name to be the output product name by @ddavis-stsci in #1394
• use towncrier to handle changelog entries by @zacharyburnett in #1375
• rcal-890 Update Docs for B15 by @ddavis-stsci in #1396
• RCAL-900: fix numpy 2.0 issues with bitflags in resample by @mcara in #1383
• drop support for ols ramp fitting by @braingram in #1398
• TST: Use photutils nightly wheel by @pllim in #1363
• [SCSB-174] move DMS requirement <-> test correlations from @metrics_logger decorators to romancal/tests/dms_requirement_tests.json by @zacharyburnett in #1399
• unpin pytest by @braingram in #1409
• add CI check that CHANGES.rst is not modified by @braingram in #1412
• Rcal 910 Add target option to the asn_from_list command by @ddavis-stsci in #1411
• RCAL-896: update TweakRegStep to use common code from stcal by @mairanteodoro in #1395
• remove default values from docs by @braingram in #1419
• [CI] rename changelog check job to be more explicit on its purpose by @zacharyburnett in #1422
• update pull request checklist by @zacharyburnett in #1336
• RCAL-895: allow updating source catalog with tweaked WCS when running ELP by @mairanteodoro in #1373
• set rad and roman_datamodels to dev by @braingram in #1424
• fix artifactory_repos for pytest 8 by @braingram in #1427
• remove MultilineLogger, split logs with \n into multiple messages by @braingram in #1377
• Update Outlier Detection to use stcal by @braingram in #1357
• Work around NotImplemented Quantity.tofile by @braingram in #1436
• Split long regtests into reusable fixtures and smaller named tests by @braingram in #1426
• Fix files left over by testing by @WilliamJamieson in #1446
• add missing rtdata.output assignments to repointed tests by @braingram in #1453
• Put okify results in unique subdirectories to avoid file overwrites by @braingram in #1456
• rcal-920 script to create associations based on skycells by @ddavis-stsci in #1437
• RCAL-913 Resolve numpy 2 issues by @WilliamJamieson in #1447
• remove display_version from docs config by @zacharyburnett in #1463
• RCAL-911 & 932: remove units from MOS and ELP pipelines. by @mairanteodoro in #1445
• Manual Pre-commit update by @WilliamJamieson in #1462
• remove lib.dms by @braingram in #1433
• vendorize and fix crds workflow by @braingram in #1467
• rcal-936 Update skycell_asn docs and add skycell_asn as a script at install time by @ddavis-stsci in #1471
• Group models by obs_id for steps that use grouping by @braingram in #1448
• RCAL-941: Update romancal to use new L1/L2 schema. by @mairanteodoro in #1473
• Point back to RAD/RDM main branches. by @mairanteodoro in #1478
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1470
• Misc small fixes and tweaks by @WilliamJamieson in #1480
• move run results directory on Artifactory to regression-tests/runs/ by @zacharyburnett in #1475
• RCAL-937: update s_region after running TweakRegStep. by @mairanteodoro in #1484
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1491
• rcal-935 Check for correct skycell name in mosaic product by @ddavis-stsci in #1498
• Replace create_s_region with stcal's compute_s_region_keyword. by @mairanteodoro in #1493
• update okify for new directory structure by @braingram in #1500
• Reduce the number of tests for supported catalog formats. by @mairanteodoro in #1496
• Fix bug when checking for "target" in model.asn by @mairanteodoro in #1502
• remove logging manipulation during create_gridded_psf_model by @braingram in #1503
• add class aliases for steps by @braingram in #1509
• Fix crds keywords by @schlafly in #1510
• Restore flux units to source catalog table by @larrybradley in #1512
• Improve unit handling by @larrybradley in #1514
• rcal-949 Update file naming and asn header coords by @ddavis-stsci in #1505
• Copy input datamodel in source_catalog step by @larrybradley in #1457
• RCAL-943: Add a step for creating multiband source catalogs by @larrybradley in #1485
• pin roman_datamodels>=0.22.0 and stcal>=1.10.0, and remove rad pin by @zacharyburnett in #1520
• metadata for release 0.17.0 by @zacharyburnett in #1521

Full Changelog: 0.16.3...0.17.0

Romancal 0.16.3 (24Q4_B15)

What's Changed

• only load patch table when needed by @braingram in #1367
• Populate segmentation model metadata for exposures and mosaics. by @schlafly in #1391

Full Changelog: 0.16.2...0.16.3

Romancal 0.16.2 (24Q4_B15)

What's Changed

• Add a default suffix to ELP by @nden in #1378

Full Changelog: 0.16.1...0.16.2

Romancal 0.16.1 (24Q4_B15)

What's Changed

• release metadata for 0.16.1 + update stpipe to use ModelLibrary + stcal to use outlier detection functions by @zacharyburnett in #1364

Full Changelog: 0.16.0...0.16.1

Romancal 0.16.0 (24Q4_B15)

rad 0.21.0

• Add schema for sky background
• Update schema for TVAC and FPS data

roman_datamodels 0.21.0

• Update models for sky background
• Updates for TVAC data
• Updates to improve memory usage

romancal 0.16.0

• Updates to the source catalog step
• Update tweakreg step to use source catalog
• Updates to the skymatch step
• Replace ModelContainer with ModelLibrary
• Update code to use ModelLibrary
• Updates to improve memory management

full changelog...

• remove clean_up_after_test by @braingram in #1245
• rcal-845_dsd rename highlevelpipeline to mosaicpipeline by @ddavis-stsci in #1249
• Update python from 3.9 to 311 in JenkinsfileRT_dev by @ddavis-stsci in #1251
• apply minor fixes for sonarqube by @zacharyburnett in #1250
• Refactor DQInitStep to use the RampModel method of creating ramps by @stscieisenhamer in #1258
• rcal-846 Add mosaic info to the science products RTD page by @ddavis-stsci in #1262
• add codecov_token secret to CI workflow by @zacharyburnett in #1265
• rcal-850 Addition of catalog step to mosaic pipeline by @ddavis-stsci in #1266
• Fix bug when setting meta.background in SkyMatchStep. by @mairanteodoro in #1233
• RCAL-828: add PSF bits to source catalog. by @mairanteodoro in #1243
• Fix comparison operator. by @mairanteodoro in #1269
• Rcal 854 Tweakreg step listed as skipped when run & refactor exposure pipeline by @ddavis-stsci in #1271
• pin numpy <2 by @braingram in #1275
• use resample many_to_many in outlier detection by @braingram in #1260
• replace deprecated stpipe configobj with astropy by @braingram in #1267
• RCAL-777: allow Step._datamodels_open to open association files by @braingram in #1270
• Do not set conda version in Jenkinsfile(s) by @jhunkeler in #1286
• rcal-859 Update okify script to use GA directories on artifactory by @ddavis-stsci in #1282
• add upper pin for photutils by @braingram in #1291
• unpin webbpsf by @braingram in #1288
• Rcal 860 Allow roman datamodel as input to the exposure pipeline by @ddavis-stsci in #1296
• Fix issue in constructing skycell WCS. by @schlafly in #1297
• Fix psf tests by @larrybradley in #1293
• Update exposure_pipeline.py by @mairanteodoro in #1298
• remove executable bits from non-script files by @braingram in #1299
• show logs on failed tests by @braingram in #1307
• remove pytest asdf plugin configuration for non-existant schemas by @braingram in #1305
• Remove unnecessary global variable and unit tests. by @mairanteodoro in #1314
• replace usages of copy_arrays with memmap by @zacharyburnett in #1316
• Replace ModelContainer with ModelLibrary by @braingram in #1241
• delete unreachable code by @braingram in #1322
• Pin stcal for development by @ddavis-stsci in #1326
• RCAL-830: update tweakreg to use source catalog by @mairanteodoro in #1276
• provide formatter to log_records by @braingram in #1327
• use reusable workflow from WebbPSF repository to download and cache data by @zacharyburnett in #1311
• Bump actions/labeler from 4 to 5 by @dependabot in #1231
• use monkeypatch in patch_match tests to avoid global state change by @braingram in #1319
• update labeler to v5 by @zacharyburnett in #1333
• remove creation of stray fits file by @braingram in #1338
• remove stcal upper pin by @braingram in #1340
• increase asdf minimum required version by @braingram in #1343
• Remove uses of lazy_load=False, update step input handling by @braingram in #1342
• rcal-827 Add reg test for DMS373 by @ddavis-stsci in #1348
• uncomment and use get_asn by @braingram in #1320
• RCAL-885: Updated Sky Background for Schema by @PaulHuwe in #1351
• Update absolute separation default. by @schlafly in #1352
• [SCSB-169] add user input to specify CRDS_CONTEXT by @zacharyburnett in #1361
• make crs bigger for new pars file for jump unit tests by @braingram in #1356
• RCAL-858: Create a regtest for sky match. by @mairanteodoro in #1358
• fix number of context planes by @braingram in #1355
• Populate sky metadata with zero if matching is not possible. by @schlafly in #1360

Full Changelog: 0.15.2...0.16.0

Romancal 0.15.2

What's Changed

• pin stcal>=1.7.3,<1.8.0
• metadata updates for release 0.15.2 by @zacharyburnett in #1324

Full Changelog: 0.15.1...0.15.2

Romancal 0.15.1

• roman_datamodels bug fixes
• Improved support for TVAC/FPS schemas

New Contributors

• @dependabot made their first contribution in #1230

Full Changelog: 0.15.0...0.15.1

Romancal 0.15.0 (DMS build 24Q3_B14)

RAD v 0.19.4, cumulative changes since v0.19.0

• Changed image units from e/s to DN/s.
• Add flux step schema
• Add L2 and L3 catalog schema
• Add L2 and L3 segmentation map schema

Roman Datamodels v 0.19.2, cumulative changes since v0.19.0

• Move dqflags to roman_datamodels from romancal
• Updates for FPS and TVAC schemas
• Add Bit Mask to Resample
• Add 'basic' schema to 'wfi_mosaic'
• Change image units from e/s to DN/s
• Improve handling of individual image metadata.

Romancal v 0.15.0

• The high-level processing pipeline can now resample images onto skycells
• New capability to compute skycells matching input images
• Allow DQ flags to be specified by the user in resample step
• Populate the l3 product individual_image_meta block, which tracks the metadata from input L2 images.
• Include the input L2 file names on disk in the meta.resample information
• Populate level 3 WCS keywords
• Include logs in L3 products
• Move dqflags to roman_datamodels
• Make PSF fitting the default in source detection, and improve PSF fitting.
• Resampling now populates weight maps and context images.
• Improve outlier detection.
• Add a flux calibration step to the mosaic pipeline.
• Add new a new SourceCatalog step with Webb heritage.
• Add a new test of astrometric accuracy.

General

• Updates to read-the-docs
• Updates for unit and regression tests

New Contributors

• @larrybradley made their first contribution in #1186

Full Changelog: 0.14.0...0.15.0

Romancal 0.14.0 (DMS build 24Q2_B13)

RAD v 0.19.0

• The Level 3 Mosaic schema was updated to include new metadata
• Add a wcs tag to schemas so the WCS object is now validated
• Removed unused variance schema

Roman Datamodels v 0.19.0

• Updates for metadata of the Level 3 Mosaics model
• The WCS object is now required for Level 2 and Level 3 models
• Updates to have meta.model_type to reflect current model

Romancal v 0.14.0

Level 2 products

• Activate apodized FFT interpolation in RefPix
• Accept dq array from SDF in the case of telemetry data dropouts
• Border pixels arrays are now copies and not views into the full data array. This avoids the increase of file size as with the view the original 3D data array was copied in the Level 2 products.

Level 3 products

• Update resample step to handle the L3 metadata

General

• Updates to read-the-docs
• Updates for unit and regression tests

Changelog

• Rcal 727 Add High Level Pipeline documentation, various updates by @ddavis-stsci in #1043
• RCAL-509: Update jump step docs by @WilliamJamieson in #1035
• add documentation for static preview script by @zacharyburnett in #1046
• Hotfix for regression tests broken by filename changes by @WilliamJamieson in #1050
• remove LFS tracking from .gitattributes by @zacharyburnett in #1051
• Add docs for outlier detection step. by @mairanteodoro in #1042
• Rcal 300 Updates to check for CRDS return value for each ELPP step by @ddavis-stsci in #1055
• Add unit tests and outlier module refactoring. by @mairanteodoro in #1058
• Rcal 738 Process data with at least 16 resultants (SOC-1069 & SOC-1070) by @ddavis-stsci in #1059
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1018
• drop sphinx-asdf requirement by @braingram in #1063
• Rcal 740 Add Data Products documentation to RTD by @ddavis-stsci in #1064
• Update to outlier detection docs. by @mairanteodoro in #1062
• fix compare_asdf model difference by @braingram in #1066
• Provide a default WCS for ramp fitting. by @schlafly in #1072
• switch jenkins runs to use roman-serverless for crds by @braingram in #946
• Rcal-622 Add the ability to copy resultantdq from SDF to a rampmodel by @ddavis-stsci in #1085
• RCAL-704 Update resample step to handle the L3 meta data by @stscieisenhamer in #1057
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1069
• Add python 3.12 devdeps testing by @WilliamJamieson in #886
• Update tweakwcs dependency by @schlafly in #1086
• RCAL-724: Add additional information to compare_asdf diff reports. by @WilliamJamieson in #1044
• Turn on the apodized FFT interpolation by @WilliamJamieson in #1017
• update requirements-sdp.txt instructions to include the sdp extra by @zacharyburnett in #1097
• Make copies of border pixel arrays when building L2 image. by @schlafly in #1098
• Fix a few incorrect dtypes used in tests by @WilliamJamieson in #1090
• metadata updates for release 0.14.0 by @jhunkeler in #1103

New Contributors

• @jhunkeler made their first contribution in #1103

Full Changelog: 0.13.0...0.14.0

Romancal 0.13.0 (DMS build 24Q1_B12)

• Ramp fitting supports uneven ramps
• Jump detection algorithm updated
• Combine jump detection and ramp fitting steps
• Support for data with truncated MA tables
• Added skymatch, outlier detection and resample steps
• Refined source catalogs in the tweakreg step
• Updates to the saturation step
• Code for the High Level Pipeline

What's Changed

• Add dev optional dependency by @WilliamJamieson in #835
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #833
• Cleanup the requirements-dev by @WilliamJamieson in #843
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #845
• Make it so we can manually trigger the CI by @WilliamJamieson in #844
• Fix get_crds_parameters for ModelContainer by @WilliamJamieson in #846
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #849
• RCAL-511 Inititial implementation of the Uneven Ramp fitting by @stscieisenhamer in #779
• Fix RTD build by @WilliamJamieson in #853
• fix opening mode for references to be read-only by @stscieisenhamer in #854
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #855
• PSF fitting methods by @bmorris3 in #794
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #860
• PSF fitting random seed fix by @bmorris3 in #862
• Remove style check from CI by @WilliamJamieson in #864
• Add NumPy ruff rule set checking by @WilliamJamieson in #863
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #873
• RCAL-643 Update roman CI/CD to use CRDS local cache by @ddavis-stsci in #857
• fix caching and outputs by @zacharyburnett in #871
• reorganize tests, make devdeps testing optional, and unpin latest Python testing by @zacharyburnett in #874
• fix optional workflow triggers by @zacharyburnett in #876
• add checkbox for regression tests to the pull request template by @zacharyburnett in #878
• Fix for failing regression tests from PSF fitting methods by @bmorris3 in #872
• use deepdiff instead of asdf.commands.diff for output and truth file comparisons by @braingram in #868
• Adjust ramps for gain, a la JWST's GainScaleStep. by @schlafly in #804
• Adjust saturation threshold depending on the read pattern by @schlafly in #836
• split requirements-dev.txt into first and third party dev dependencies by @zacharyburnett in #840
• RCAL-646 Update to install asn_from_list by @ddavis-stsci in #884
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #889
• RCAL-647 Update pipeline to include refpix step as default by @ddavis-stsci in #890
• New ramp fitting default by @schlafly in #877
• rcal-681 Update reg tests for new algorithms by @ddavis-stsci in #911
• add astropy Table support to compare_asdf by @braingram in #915
• update compare_asdf to use tolerance in more comparisons by @braingram in #917
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #921
• update url for webbpsf data in github actions CI by @braingram in #920
• use PyPI upload workflow from OpenAstronomy by @zacharyburnett in #887
• RCAL-641 Add FOV association generation by @ddavis-stsci in #931
• TweakReg regression test fix. by @mairanteodoro in #919
• add instructions for downloading WebbPSF data by @zacharyburnett in #937
• add .git to dev dependency specifications by @zacharyburnett in #932
• improve WebbPSF data caching in GitHub CI by @braingram in #923
• add webbpsf and poppy to dev requirements by @braingram in #940
• RCAL-693: Removed err array from dark tests. by @PaulHuwe in #938
• use ndarray comparison options in wcs comparison by @braingram in #941
• Rcal 504 develop the resample step by @mairanteodoro in #787
• Fix regression test artifact upload by @braingram in #950
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #930
• Filter catalog sources that are outside of the bounding box by @mcara in #947
• Update Cas22 ramp fitting to integrate with the jump detection changes in stcal by @WilliamJamieson in #933
• RCAL-513 Update uneven ramp fitting documentation by @stscieisenhamer in #944
• RCAL-644 Remove checks on CI in production code by @stscieisenhamer in #955
• Skip webbpsf tests by default by @WilliamJamieson in #958
• rcal-697 Update exposure pipeline to add tweakreg step by @ddavis-stsci in #960
• retrieve CRDS contexts in CI with a reusable workflow by @zacharyburnett in #954
• Bugfix webbpsf marker by @WilliamJamieson in #961
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #963
• RCAL-670: additional check for data quality test. by @mairanteodoro in #964
• Generate L3 exposure times from resampled exposure time images by @schlafly in #959
• rcal-700 Update exposure pipeline to correct cal_step and suffixes by @ddavis-stsci in #971
• RCAL-629: static preview generation script by @zacharyburnett in #953
• fixed asn_from_list script by @zacharyburnett in #972
• don't run tests on romancal/scripts by @zacharyburnett in #975
• Protect imports in script better by @WilliamJamieson in #977
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #974
• Source detection step option to fit model PSFs by @bmorris3 in #841
• use webbpsf data from grp in jenkins runs by @braingram in #918
• Update crds rad and roman_datamodels versions by @ddavis-stsci in #986
• RCAL-707 Update elp to replace list as input to tweakreg by @ddavis-stsci in #985
• fix issue where the path of the WebbPSF cache was not the same as the restore cache in the subsequent workflow by @zacharyburnett in #988
• fix tests_devdeps.yml workflow by @zacharyburnett in #989
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #990
• Structured array source detection catalogs by @bmorris3 in #987
• Source detection+PSF docs updates by @bmorris3 in #984
• RDM-3431: add mosaic astrometric frame test by @mairanteodoro in #993
• Remove quote indent from main header in README by @bmorris3 in #992
• minor fix for data hash in cache key by @zacharyburnett in #999
• RCAL-699: Add regression testing for new jump detection and make new jump detection default to on by @WilliamJamieson in #991
• Rcal 713 Update pyproject.toml to use stcal 1.5.0 or greater and add ref_file.crds.sw_version to the ignore list by @ddavis-stsci in #1003
• Fix issue with source catalog in TweakRe...