Releases: spacetelescope/romancal
Romancal 0.13.0 (DMS build 24Q1_B12)
- Ramp fitting supports uneven ramps
- Jump detection algorithm updated
- Combine jump detection and ramp fitting steps
- Support for data with truncated MA tables
- Added skymatch, outlier detection and resample steps
- Refined source catalogs in the tweakreg step
- Updates to the saturation step
- Code for the High Level Pipeline
What's Changed
- Add dev optional dependency by @WilliamJamieson in #835
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #833
- Cleanup the requirements-dev by @WilliamJamieson in #843
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #845
- Make it so we can manually trigger the CI by @WilliamJamieson in #844
- Fix
get_crds_parameters
forModelContainer
by @WilliamJamieson in #846 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #849
- RCAL-511 Inititial implementation of the Uneven Ramp fitting by @stscieisenhamer in #779
- Fix RTD build by @WilliamJamieson in #853
- fix opening mode for references to be read-only by @stscieisenhamer in #854
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #855
- PSF fitting methods by @bmorris3 in #794
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #860
- PSF fitting random seed fix by @bmorris3 in #862
- Remove style check from CI by @WilliamJamieson in #864
- Add NumPy ruff rule set checking by @WilliamJamieson in #863
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #873
- RCAL-643 Update roman CI/CD to use CRDS local cache by @ddavis-stsci in #857
- fix caching and outputs by @zacharyburnett in #871
- reorganize tests, make devdeps testing optional, and unpin latest Python testing by @zacharyburnett in #874
- fix optional workflow triggers by @zacharyburnett in #876
- add checkbox for regression tests to the pull request template by @zacharyburnett in #878
- Fix for failing regression tests from PSF fitting methods by @bmorris3 in #872
- use
deepdiff
instead ofasdf.commands.diff
for output and truth file comparisons by @braingram in #868 - Adjust ramps for gain, a la JWST's GainScaleStep. by @schlafly in #804
- Adjust saturation threshold depending on the read pattern by @schlafly in #836
- split
requirements-dev.txt
into first and third party dev dependencies by @zacharyburnett in #840 - RCAL-646 Update to install asn_from_list by @ddavis-stsci in #884
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #889
- RCAL-647 Update pipeline to include refpix step as default by @ddavis-stsci in #890
- New ramp fitting default by @schlafly in #877
- rcal-681 Update reg tests for new algorithms by @ddavis-stsci in #911
- add astropy Table support to compare_asdf by @braingram in #915
- update compare_asdf to use tolerance in more comparisons by @braingram in #917
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #921
- update url for webbpsf data in github actions CI by @braingram in #920
- use PyPI upload workflow from OpenAstronomy by @zacharyburnett in #887
- RCAL-641 Add FOV association generation by @ddavis-stsci in #931
- TweakReg regression test fix. by @mairanteodoro in #919
- add instructions for downloading WebbPSF data by @zacharyburnett in #937
- add
.git
to dev dependency specifications by @zacharyburnett in #932 - improve WebbPSF data caching in GitHub CI by @braingram in #923
- add webbpsf and poppy to dev requirements by @braingram in #940
- RCAL-693: Removed err array from dark tests. by @PaulHuwe in #938
- use ndarray comparison options in wcs comparison by @braingram in #941
- Rcal 504 develop the resample step by @mairanteodoro in #787
- Fix regression test artifact upload by @braingram in #950
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #930
- Filter catalog sources that are outside of the bounding box by @mcara in #947
- Update Cas22 ramp fitting to integrate with the jump detection changes in stcal by @WilliamJamieson in #933
- RCAL-513 Update uneven ramp fitting documentation by @stscieisenhamer in #944
- RCAL-644 Remove checks on CI in production code by @stscieisenhamer in #955
- Skip webbpsf tests by default by @WilliamJamieson in #958
- rcal-697 Update exposure pipeline to add tweakreg step by @ddavis-stsci in #960
- retrieve CRDS contexts in CI with a reusable workflow by @zacharyburnett in #954
- Bugfix webbpsf marker by @WilliamJamieson in #961
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #963
- RCAL-670: additional check for data quality test. by @mairanteodoro in #964
- Generate L3 exposure times from resampled exposure time images by @schlafly in #959
- rcal-700 Update exposure pipeline to correct cal_step and suffixes by @ddavis-stsci in #971
- RCAL-629: static preview generation script by @zacharyburnett in #953
- fixed
asn_from_list
script by @zacharyburnett in #972 - don't run tests on
romancal/scripts
by @zacharyburnett in #975 - Protect imports in script better by @WilliamJamieson in #977
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #974
- Source detection step option to fit model PSFs by @bmorris3 in #841
- use webbpsf data from grp in jenkins runs by @braingram in #918
- Update crds rad and roman_datamodels versions by @ddavis-stsci in #986
- RCAL-707 Update elp to replace list as input to tweakreg by @ddavis-stsci in #985
- fix issue where the path of the WebbPSF cache was not the same as the restore cache in the subsequent workflow by @zacharyburnett in #988
- fix
tests_devdeps.yml
workflow by @zacharyburnett in #989 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #990
- Structured array source detection catalogs by @bmorris3 in #987
- Source detection+PSF docs updates by @bmorris3 in #984
- RDM-3431: add mosaic astrometric frame test by @mairanteodoro in #993
- Remove quote indent from main header in README by @bmorris3 in #992
- minor fix for data hash in cache key by @zacharyburnett in #999
- RCAL-699: Add regression testing for new jump detection and make new jump detection default to on by @WilliamJamieson in #991
- Rcal 713 Update pyproject.toml to use stcal 1.5.0 or greater and add ref_file.crds.sw_version to the ignore list by @ddavis-stsci in #1003
- Fix issue with source catalog in TweakRe...
Romancal 0.12.0 (DMS build 23Q4_B11)
This release includes updates for association processing in the pipeline, added the reference pixel step, and some improvements in memory usage. It also includes updates for roman_datamodels
for additional unit checking. The input data files now include updated quantities and the CRDS context is now at roman_0051
.
What's Changed
- Update the CI by @WilliamJamieson in #706
- More CI updates by @WilliamJamieson in #709
- Fix returned result from SourceDetectionStep. by @mairanteodoro in #700
- Documentation update for rtd and the contrib by @sosey in #674
- Initial sky matching implementation by @bmorris3 in #687
- Move skymatch changelog entry to correct version by @WilliamJamieson in #713
- Replace
add_ref_common
withmk_ref_common
by @WilliamJamieson in #712 - Add ModelContainer to romancal.datamodels. by @mairanteodoro in #710
- RCAL-590: add fit results to datamodel's meta. by @mairanteodoro in #714
- Update reference pixel docs. by @schlafly in #716
- Add a
pip list
step after the overrides are injected by @WilliamJamieson in #711 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #715
- add
sdpdeps
toxenv by @zacharyburnett in #708 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #718
- Move
is_assocation
toromancal
by @WilliamJamieson in #719 - Fix typo in S_REGION string. by @mairanteodoro in #720
- Updates for maker_utils API changes by @WilliamJamieson in #717
- revert astropy prerelease wheel spec and use nightly Scipy wheel index by @zacharyburnett in #696
- Add regression test for TweakReg. by @mairanteodoro in #707
- update jump detection for stcal changes by @braingram in #723
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #722
- RCAL-604 update ramp fitting unit test for stcal 1.4.0 by @ddavis-stsci in #725
- RCAL-432 Update info string to use the same syntax by @ddavis-stsci in #721
- Increase code coverage for TweakReg. by @mairanteodoro in #724
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #766
- Remove myst parser from docs config by @WilliamJamieson in #773
- Add jquery sphinx to fix doc search by @WilliamJamieson in #768
- Register skymatch with stpipe by @WilliamJamieson in #770
- Use same changelog workflow as the rest of the roman repositories by @WilliamJamieson in #772
- Remove AWS install option by @WilliamJamieson in #767
- Update asdf dependency by @WilliamJamieson in #777
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #776
- remove unused extras by @zacharyburnett in #784
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #782
- Make test randomness deterministic by @WilliamJamieson in #771
- Try to avoid copying data models. by @schlafly in #774
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #788
- update build instructions in README by @zacharyburnett in #790
- RCAL-485, RCAL-558: Implement the reference pixel correction by @WilliamJamieson in #704
- BOT: Changelog check has moved by @pllim in #792
- Actually use the
astropy
nightly wheel. by @WilliamJamieson in #795 - rcal-606 Have source detection and tweakreg skip spectral data by @ddavis-stsci in #798
- RCAL-617 Update readme for release 11 (23Q3_B10) & placeholders for 12 (23Q4_B11) by @ddavis-stsci in #799
- pin
numpy
to>=1.22
by @zacharyburnett in #800 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #801
- Remove numpy 2.0 hack by @WilliamJamieson in #797
- pin
sphinx_rtd_theme
to newer version by @zacharyburnett in #803 - Use CRDS public server by @nden in #805
- Rcal 596 Add association processing to the pipeline code by @ddavis-stsci in #802
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #806
- RCAL-631 Update saturation logic for spectral data by @ddavis-stsci in #824
- Remove usage of
pkg_resources
by @WilliamJamieson in #829 - Rcal 624 regtest updates for B11, rad & roman_datamodels pin by @ddavis-stsci in #834
- rcal-627 Add metrics logger to regtests by @ddavis-stsci in #831
- metadata for 0.12.0 release by @zacharyburnett in #839
New Contributors
- @sosey made their first contribution in #674
- @schlafly made their first contribution in #716
- @pllim made their first contribution in #792
Full Changelog: 0.11.0...0.12.0
Romancal 0.11.0 (DMS build 23Q3_B10)
Summary
This release includes updates to support python 3.11, the tweakreg and source catalog steps, initial associations for survey data, the data files now include updated quantities, the CRDS context is now at roman_0047
, and we’ve updated and added documentation for the pipeline steps.
What's Changed
- move pytest markers to pyproject.toml by @braingram in #647
- cache packages in CI workflow by @zacharyburnett in #618
- use
ruff
in place offlake8
by @zacharyburnett in #570 - Bug fix: make sure ASDF is not closed prematurely. by @mairanteodoro in #651
- Clean up and small refactoring. by @mairanteodoro in #652
- Raise exception whenever tweakreg_catalog is missing. by @mairanteodoro in #653
- RCAL-486: Update Maker Utlity Imports by @PaulHuwe in #654
- remove upper pins from dependencies by @zacharyburnett in #656
- Start using code formatters by @WilliamJamieson in #645
- refactor toxenvs, use OpenAstronomy workflows, and move MacOS jobs to schedule by @zacharyburnett in #612
- RCAL-482 by @WilliamJamieson in #658
- RCAL-467: Implement tests for Roman's TweakReg and ModelContainer. by @mairanteodoro in #655
- run tests on minimum dependencies by @zacharyburnett in #664
- Adding source detection step by @cshanahan1 in #608
- Bugfix for source_detection's test_outputs by @WilliamJamieson in #665
- RCAL-481: Remove use of pytest-openfiles by @WilliamJamieson in #666
- add seed for random noise/gaussian generation in tests by @cshanahan1 in #668
- import
tomli
astomllib
fordocs
builds before Python 3.11 by @zacharyburnett in #657 - Fix source detection object instantiation. by @PaulHuwe in #669
- add code owners file by @zacharyburnett in #670
- use built-in concurrency configuration for duplicate workflows by @zacharyburnett in #672
- TweakReg: update method to fetch catalog data. by @mairanteodoro in #671
- Remove
codecov
test dependency by @WilliamJamieson in #677 - TweakReg: update to use VO instead of astroquery. by @mairanteodoro in #678
- Update installation command for macOS system. by @mairanteodoro in #679
- RCAL-490 by @WilliamJamieson in #676
- TweakReg: doc updates. by @mairanteodoro in #673
- SCSB-63 inject dependency overrides after build by @zacharyburnett in #680
- remove stdatamodels ValidationWarning from test by @braingram in #682
- fix output catalog attribute by @cshanahan1 in #684
- override package dependencies with requirements file when requested by @zacharyburnett in #685
- explicitly call binary path in codecov upload by @zacharyburnett in #683
- Rcal-476 Add GBTDS associations for Full, Pass, and segment by @ddavis-stsci in #661
- enable step summary for pytest results by @zacharyburnett in #691
- set source detection cal_step to complete by @cshanahan1 in #690
- Add epoch parameter to fetch catalog data. by @mairanteodoro in #686
- TweakReg: handle new source_detection attribute. by @mairanteodoro in #681
- drop support for Python 3.8 by @zacharyburnett in #694
- test against nightly builds of
astropy
,scipy
, andnumpy
by @zacharyburnett in #695 - Upgrade romancal python to python-3.11, update crds context by @ddavis-stsci in #693
- Compatibility fix in tweakreg test for rdm#164 by @bmorris3 in #697
- Added simple outlier detection step. by @PaulHuwe in #689
- RCAL-561: improve error-handling for TweakReg when fetching data from VO API service. by @mairanteodoro in #698
- RCAL-567 Update unit tests to add tmpdir for test files by @ddavis-stsci in #702
- RCAL-548 Include dq flag for GW_AFFECTED_DATA by @ddavis-stsci in #699
- Update CRDS context for 23Q3_B10 by @ddavis-stsci in #703
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #662
- Update roman crds server to test so that the latest updates are used by @ddavis-stsci in #705
New Contributors
- @braingram made their first contribution in #647
- @bmorris3 made their first contribution in #697
- @pre-commit-ci made their first contribution in #662
Full Changelog: 0.10.0...0.11.0
Romancal v 0.10.0 (DMS Build 9)
What's Changed
- open for post-0.9.0 development by @nden in #603
- Rcal-402 Add Flags for science data affected by guide window reads by @ddavis-stsci in #599
- use
tox
and set up CRDS caching when server is accessible by @zacharyburnett in #551 - move build configuration into
pyproject.toml
by @zacharyburnett in #512 - rename
toxenv
s to be more explicit by @zacharyburnett in #605 - change duplicate
numpy120
tonumpy122
by @zacharyburnett in #604 - add
freetds
to packages to providesqlfront.h
for buildingpymssql
by @zacharyburnett in #607 - changes for
tox>=4.0
release by @zacharyburnett in #610 - consolidate CI jobs into
include:
in initial test matrix by @zacharyburnett in #611 - RCAL-431 Update suffix and CRDS context by @ddavis-stsci in #609
- Rcal 406 science array quantities by @PaulHuwe in #613
- Revert "Rcal 406 science array quantities" by @PaulHuwe in #614
- add Datadog CI agent by @zacharyburnett in #615
- [hotfix] fix CI on PRs from forks by @zacharyburnett in #617
- fix deprecation warnings ahead of Pytest 8.0 by @zacharyburnett in #597
- move scripts into subpackage to make them entry points by @zacharyburnett in #620
- fix branch filter to trigger on release branches by @zacharyburnett in #619
- update
conda
in Jenkins environment by @zacharyburnett in #621 - add environment variables to Datadog run by @zacharyburnett in #623
- RCAL-460 Update default CR rejections in jump_step by @ddavis-stsci in #625
- RCAL-440 Add support for Reference File Quantities by @PaulHuwe in #624
- Rcal 406 science array quantities by @PaulHuwe in #616
- Start using pre-commit by @WilliamJamieson in #622
- RCAL-471 Update crds context and output units for the linearity step by @ddavis-stsci in #646
- Rcal 444 Initial association code with asn_from_list and some basic rules by @ddavis-stsci in #642
- RCAL-451: Implement TweakRegStep. by @mairanteodoro in #643
- RCAL-479 Test for PSF keywords (DMS-136) by @ddavis-stsci in #648
Full Changelog: 0.9.0...0.10.0
Romancal v 0.9.0 (DMS Build 8)
- Additional changes to Roman's RTD page content [#600]
- New Roman's RTD page layout [#596]
- pin numpy to >=1.20 [#592]
- jump
- Changes for new keywords (currently unused by Roman) to control snowball and shower flagging in jump detection. [#593]
- photom
- Updates so that the default suffix is used for spectroscopic data. [#594]
- Change photom step to forcibly set the photometric keywords to None for spectroscopic data. [#591]
Romancal release 0.8.1 to support DMS build 22Q4_B7 (build 0.7) for Sept 15
What's Changed
- pin
asdf
to newest patch version to fix dependency for newestjsonschema
release by @zacharyburnett in #562 - pin
roman_datamodels
to newest feature release by @zacharyburnett in #563
Full Changelog: 0.8.0...0.8.1
Romancal release 0.8.0 to support DMS build 22Q4_B7 (build 0.7) for Sept 15
What's Changed
- Clean up file generated when running tests by @WilliamJamieson in #509
- Rcal 346 spec photom by @PaulHuwe in #513
- Add distortion transform to assign_wcs by @WilliamJamieson in #510
- RCAL-330: Change Reference Datamodel Storage Type in Steps by @PaulHuwe in #514
- RCAL-349: Update RomanCal For Error Dimensionality Fix by @PaulHuwe in #520
- RCAL-309: Ramp Fit Multiprocessing IndexError by @PaulHuwe in #523
- rcal-310 Update code to update suffixes, update regtests for the new names by @ddavis-stsci in #521
- update pull request template to be more explicit by @zacharyburnett in #527
- RCAL-341: Update Flat field code and tests to use N/A from CRDS by @PaulHuwe in #528
- Rcal 295 compute s region by @mairanteodoro in #539
- copy changelog workflow from
asdf
by @zacharyburnett in #522 - Docs update on the distortion file. by @mairanteodoro in #542
- Make add_s_region private and reformat docstring. by @mairanteodoro in #543
- release
numpy
requirement by @zacharyburnett in #544 - use GitHub Actions to cache environments and use dependent CI workflow structure by @zacharyburnett in #511
- RCAL-353: Saturation effects in the rcal pipeline by @PaulHuwe in #541
- freeze action versions by @zacharyburnett in #546
- RCAL-368 Changed optical element W146 to F146. by @PaulHuwe in #552
- update
stpipe
requirement to>=0.4.1
by @zacharyburnett in #545 - RCAL-332 populate meta.ref_file by @cshanahan1 in #492
- automatically add labels to pull requests based on changed files by @zacharyburnett in #550
- fix input file by @cshanahan1 in #553
- update version of roman_datamodels by @nden in #555
- Unpin stpipe version in development requirements by @ddavis-stsci in #556
- fix
flake8
warnings by @zacharyburnett in #557 - Update CRDS Context by @ddavis-stsci in #559
- Fix photom test by @ddavis-stsci in #560
- fix README badge, remove redundant section by @zacharyburnett in #561
- Add tests for SOC-587. by @mairanteodoro in #549
New Contributors
- @WilliamJamieson made their first contribution in #509
- @mairanteodoro made their first contribution in #539
Full Changelog: 0.7.1...0.8.0
Romancal release 0.7.1 to support DMS build 22Q3_B6 (build 0.6) for June 15, 2022
What's Changed
- Prepare main branch for further development by @ddavis-stsci in #454
- Rcal-304 Add JenkinsfileRT_dev and requirements-dev.txt in preperation for SPB creating a develop Jenkins Job by @ddavis-stsci in #451
- RCAL-289 Updates for DMS release 0.5 by @ddavis-stsci in #457
- add mask model by @cshanahan1 in #438
- GH464 Update reqirements-dev.txt by @ddavis-stsci in #465
- 464 update requirements dev for rad by @ddavis-stsci in #466
- Rcal 46 Initial documentation for error propagation by @ddavis-stsci in #476
- RCAL-112: Update photom step for WFI data by @PaulHuwe in #469
- RCAL-327 Allow Nan's in linearity ref file remove romanad from setup. by @ddavis-stsci in #484
- RCAL-322: Tests for SOC-588 (Absolute photometric calibration) by @PaulHuwe in #479
- new param for saturation, continute to not flag adjacent pixels for now by @cshanahan1 in #483
- rcal-329 Removal of copy commands that are not required by @ddavis-stsci in #487
- RCAL-324: Update documentation for photom step by @PaulHuwe in #488
- Update CRDS context to roman_0031.pmap by @ddavis-stsci in #491
- RCAL-318: Update the reference file document for reftype "distortion" by @PaulHuwe in #493
- Update crds context to 0032 by @ddavis-stsci in #494
- Update okify script to work with Roman artifactory data by @ddavis-stsci in #495
- RCAL-315 Updates for regression tests, current input files and data m… by @ddavis-stsci in #496
- RCAL-339 Update photom step to skip spectroscopic data by @ddavis-stsci in #498
- Pin b06 requirements by @ddavis-stsci in #499
- Updates for further development by @ddavis-stsci in #501
- JP-374: ZEROFRAME processing to STCAL changed function signatures. by @kmacdonald-stsci in #500
- Rcal-340 Updates to flat field code to handle no flat for grism data & remove skip by @ddavis-stsci in #504
- JP-2581: enable multiprocessing for jump by @cshanahan1 in #503
- Account for possible zero frame in linearity by @nden in #506
- Updates for stcal by @ddavis-stsci in #507
- prepare main branch for
0.7.1
release by @zacharyburnett in #508
New Contributors
- @zacharyburnett made their first contribution in #508
Full Changelog: 0.6.0...0.7.1
Romancal release 0.7.0 to support DMS build 22Q3_B6 (build 0.6) for June 15, 2022
Romancal release 0.7.0 includes support for MA table numbers, added the photom step for imaging data, updated the linearity correction, and made improvements for memory management.
Romancal release 0.6.0 to support DMS build 0.5 for March 15, 2022
This release includes support for new roman datamodels, reference pixel schemas, and the exposure level pipeline.