Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[Unreleased]

[2.4.1] - 2024-09-18

##$ What’s Changed

Divergence by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/79
Update some imager plots

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.4.0…v2.4.1

[2.4.0] - 2024-09-03

What’s Changed

Mostly bits to help out a filesystem being sad

Threadlock cutout writes to prevent dumb errors on Lustre (and maybe elsewhere?)
Copy holography file to a $MEMDIR if it exists
Allow validation plots to fail gracefully

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.11…v2.4.0

[2.3.11] - 2024-07-15

What’s Changed

Fix l,m calculation for tile offsets (including rotation)

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.10…v2.3.11

[2.3.10] - 2024-07-13

What’s Changed

Improve stability with persist_result=True and dirs_exist_ok=True

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.9…v2.3.10

[2.3.9] - 2024-07-11

What’s Changed

Switch to dynamic versioning

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.8…v2.3.9

[2.3.8] - 2024-07-10

What’s Changed

Add flow diagram by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/75
Split Stokes I and QU imaging tasks by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/76

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.7…v2.3.8

[2.3.7] - 2024-07-09

What’s Changed

Check ionex by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/74

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.6…v2.3.7

[2.3.6] - 2024-06-25

What’s Changed

Add field offsets by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/72
Added field/tile seperation calculation and columns
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/AlecThomson/arrakis/pull/65
Added an auto-purge to temp-image files in imager

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.5…v2.3.6

[2.3.5] - 2024-06-21

What’s Changed

Added tarball verification
Tweaks to petrichor config
Retry cutout failues
Reduce validation plot resolution
Fail if commonbeam is NaN (i.e. whole beam will be blanked)
Use threadpool for beamcon
Catch the failure of Voronoi binning
Fixes to database queries and related structuring
Catch failure of a validation plot

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.4…v2.3.5

[2.3.4] - 2024-05-13

What’s Changed

Polar by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/71

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.3…v2.3.4

[2.3.3] - 2024-05-10

What’s Changed

Reduce number of tasks by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/70

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.2…v2.3.3

[2.3.2] - 2024-05-09

What’s Changed

Queries by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/69

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.1…v2.3.2

[2.3.1] - 2024-05-08

What’s Changed

Validate image by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/68
Adds and improves validation plots
Fixes LINMOS rotation parameters

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.3.0…v2.3.1

[2.3.0] - 2024-05-07

What’s Changed

Add validation stage to pipeline, including plot artifacts
Add LINMOS rotation for rotated fields
Fixes WSClean argument handling and clean thresholds
Submit by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/66
Validate by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/67

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.2.2…v2.3.0

[2.2.2] - 2024-04-18

What’s Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/AlecThomson/arrakis/pull/61
Image fewer than 36 beams by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/64

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.2.1…v2.2.2

[2.2.1] - 2024-04-17

What’s Changed

Use sql by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/63
Allow PostgreSQL RACS database to be ingested in spice_init
Add helper scipt create_mongodb.py

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.8…v2.2.1

[2.2.0] - 2024-04-11

What’s Changed

Allow SBID to passed as an argument
- This will enable a ‘single field mode’
- Database queries / updates changes to support this
Unified ArgParse mode
- Much easier argument parsing
- Now reused amongst modules
Fixes to typing
- Much better use of pathlib.Path and pandas
SBID by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/62

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.7…v2.1.8

[2.1.7] - 2024-04-03

What’s Changed

Updated documentation.

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.6…v2.1.7

[2.1.6] - 2024-04-01

What’s Changed

Image docs by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/60

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.5…v2.1.6

[2.1.5] - 2024-03-27

What’s Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/AlecThomson/arrakis/pull/56
Tempdir by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/58
Clean by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/59

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.4…v2.1.5

[2.1.4] - 2024-03-20

What’s Changed

DR2 preparation improvements by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/57

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.3…v2.1.4

[2.1.3] - 2024-02-05

What’s Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/AlecThomson/arrakis/pull/54
Noise fix by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/55

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.2…v2.1.3

[2.1.2] - 2024-01-17

Hotfix updates.

Fixed

Base Python version bumped to 3.10 for docs
Enable -no-mf-weighting in WSClean
Ensure FixMS skipped is used in pipeline
Pass data in correct order to RM-Tools

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.1…v2.1.2

[2.1.1] - 2024-01-16

What’s Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/AlecThomson/arrakis/pull/48
Create dependabot.yml by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/50
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/AlecThomson/arrakis/pull/51
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/AlecThomson/arrakis/pull/52
In-memory cutouts by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/53

New Contributors

@pre-commit-ci made their first contribution in https://github.com/AlecThomson/arrakis/pull/48

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.1.0…v2.1.1

[2.1.0] - 2023-12-14

What’s Changed

Fix weights by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/46
described the scalability of prefect/postgres by @tjgalvin in https://github.com/AlecThomson/arrakis/pull/44
Migrate the whole shebang to Prefect by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/49

Full Changelog: https://github.com/AlecThomson/arrakis/compare/v2.0.0…v2.1.0

Added

Full prefect flows and tasks
More prefect documentation

Fixed

Incorrect image weighting for LINMOS

Removed

dask delayed etc.

[2.0.0] - 2023-10-16

Added

pre-commit hooks for autoformatting checks
imager script for sweet imaging
prefect backbone

[1.0.0] - 2023-06-15

Corresponds with DR1 paper.

What’s Changed

Dev by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/1
Simplify readme by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/2
Don’t need these by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/3
Clean up tests by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/4
Fix scripts and RM-synth by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/5
Merge dev by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/7
Dev by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/9
Remove RACS db by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/14
Arrakis by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/16
Fix RACS db pathing by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/15
Docs update by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/18
Dev by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/23
Dev by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/24
Dev by @AlecThomson in https://github.com/AlecThomson/arrakis/pull/25

Added

This changelog!
scripts/tar_cubelets.py and CLI hook
makecat.py: Added flag_blended_components to identify and flag blended components. Adds is_blended_flag, N_blended, blend_ratio to the catalogue.
Proper logging module

Fixed

columns_possum.py: Add new Stokes I fit flags and UCDs (plus others) and descriptions
scripts/casda_prepare.py: Refactor to make considated products and make CASDA happy
scripts/fix_dr1_cat.py: Added extra columns that needed to be fixed in DR1 e.g. sbid, start_time
Typing in various places

Changed

Renamed scripts/helloworld.py to scripts/hellow_mpi_world.py
makecat.py: Added compute_local_rm_flag function
rmsynth_oncuts.py Added new Stokes I fit flags
utils.py: Refactored Stokes I fitting to use dicts to track values
Use local installs of customised packages

Removed

submit/casda_pre_prep.sh
submit/casda_prep_test.sh
ASKAP RACS database as a submodule (changes how init_databse.py ingests data)

[0.2.0] - 2019-12-01

The before times…