CHANGELOG.md

Changelog

7.1.0 (2024-11-28)

Features

• set default current-date for collection_from_items script TDE-1298 (#1196) (e22bb66)

Bug Fixes

• Use client syntax for getting file contents (#1194) (ab83041)

7.0.0 (2024-11-27)

⚠ BREAKING CHANGES

• set update-dates on STAC item TDE-1298 (#1180)

Features

• defaults for current-datetime argument TDE-1298 (#1193) (fa003f8)
• keep Collection properties.created date when resupplying (#1160) (8af3e21)
• set update-dates on STAC item TDE-1298 (#1180) (9d95b02)

6.0.0 (2024-11-12)

⚠ BREAKING CHANGES

• add linz:slug to Collection TDE-1305 (#1152)

Features

• add linz:slug to Collection TDE-1305 (#1152) (df5a746)

Bug Fixes

• Avoid deprecated stage name "commit" (#1135) (e2d9e3d)

5.2.0 (2024-10-17)

Features

• add description field for assets in collection TDE-1294 (#1132) (4d6c030)

5.1.0 (2024-10-10)

Features

• allow forcing Collection title to not have suffix TDE-1289 (#1120) (7ca3c43)

5.0.2 (2024-10-09)

Bug Fixes

• capture area rounding TDE-1237 (#1116) (d055f49)
• providers should not be duplicated when having different roles TDE-1286 (#1115) (46303cb)

5.0.1 (2024-10-03)

Bug Fixes

• round footprints to 8 decimal places TDE-1237 (#1088) (fbb0930)

5.0.0 (2024-09-29)

⚠ BREAKING CHANGES

• dates from item TDE-1258 (#1099)
• Auto-fill GSD unit TDE-1211 (#1089)

Features

• Add topo-imagery version information to STAC TDE-1265 (#1080) (2039606)
• Auto-fill GSD unit TDE-1211 (#1089) (df257c9)
• dates from item TDE-1258 (#1099) (8aabe64)

4.11.2 (2024-09-24)

Bug Fixes

• Use GeoJSON media type for item links TDE-1254 (#1086) (57dd0a8)

4.11.1 (2024-09-19)

Bug Fixes

• Don't attempt to install project inside virtualenv (#1074) (dd989d0)
• start_datetime and end_datetime must be init if derived_from TDE-1258 (#1079) (f0c8a4e)

4.11.0 (2024-09-15)

Features

• add capture dates asset link to collection TDE-1256 (#1069) (d4b391a)

4.10.0 (2024-09-12)

Features

• add derived_from links to item TDE-1251 (#1043) (077f14f)
• determine start and end datetimes when item include derived TDE-1258 (#1052) (62d571a)
• make start_datetime and end_datetime optional when includeDerived is True TDE-1258 (#1065) (57f088c)
• More types (#989) (3f7cd57)

Bug Fixes

• capture area winding order TDE-1205 (#1008) (61be096)
• error on collection with no items TDE-1216 (#1000) (d351d85)

4.9.0 (2024-07-16)

Features

• Add Shapely type library TDE-1205 (#988) (f5e97e7)
• use new pull request template (#999) (9a6a0b2)

Bug Fixes

• concurrency file order TDE-1213 (#998) (37dcb8b)
• Treat item as dict TDE-1209 (#993) (384d0fc)

Reverts

• Pull Requests #993 and #985 (#997) (289880c)

4.8.0 (2024-06-09)

Features

• Add created/updated properties to collections TDE-1147 (#981) (00f4570)
• Set created/updated item properties TDE-1147 (#980) (37ee07f)

4.7.1 (2024-05-27)

Bug Fixes

• Make build compatible with new GDAL container TDE-1179 (#977) (f377d61)

Reverts

• "fix: Make build compatible with new GDAL container TDE-1179 (#971)" (#975) (3990bf9)

4.7.0 (2024-05-23)

Features

• timestamps when created TDE-1147 (#956) (2828f14)

Bug Fixes

• add draft lifecycle tag TDE-1161 (#964) (64040d8)
• Make build compatible with new GDAL container TDE-1179 (#971) (719d96e)
• should use unique file names when copying files to standardise TDE-1186 (#974) (8b783dc)

4.6.0 (2024-05-07)

Features

• add checksum to item links in collections TDE-1138 (#953) (afea8f0)
• add option to create footprints (#959) (ea5c98b)

Bug Fixes

• Make compatible with latest moto (#949) (5902df0)
• Use correct types for S3 client (#954) (2c96c13)

4.5.0 (2024-03-24)

Features

• Use subtests for multi-assert tests (#896) (eb92bd2)

Bug Fixes

• Treat "no data" value as a decimal number TDE-1077 (#893) (a9b4a84)
• update gdal version to 3.8.4 to fix footprints bug TDE-1106 (#923) (7a3367e)
• Use integer coordinates TDE-1077 (#895) (b381bb6)
• wrong vsis3 path logged (#906) (f491eb1)

Documentation

• Document default "no data" value TDE-1077 (#901) (d15919f)

4.4.0 (2024-03-06)

Features

• log capture-area generation duration TDE-1080 (#889) (5fd8f65)

Bug Fixes

• footprint should exists if tiff already exists (#890) (9868072)

4.3.0 (2024-03-06)

Features

• simplify footprint geometry tde-1080 (#891) (a932a17)

4.2.4 (2024-02-27)

Bug Fixes

• handle percent-encoded urls TDE-1054 (#881) (eacc453)

4.2.3 (2024-02-27)

Bug Fixes

• update wording for release (#878) (dcc7972)

4.2.2 (2024-02-26)

Bug Fixes

• allow unlimited footprint points and increase buffer size for simplifying capture area json (#872) (c733f1e)

4.2.1 (2024-02-19)

Bug Fixes

• always ignore existing overviews TDE-1046 (#862) (900907f)

4.2.0 (2024-02-19)

Features

• save a copy of capture-area.geojson as an artifact for Argo Workflows TDE-1045 (#860) (a303c05)

4.1.0 (2024-02-14)

Features

• add capture-area.geojson to the STAC Collection TDE-965 (#758) (75df081)

Bug Fixes

• gdal should try reading file before getting credentials TDE-929 (#852) (83c9a68)

Documentation

• clarify readme (#854) (f0f742d)

4.0.1 (2024-02-12)

Bug Fixes

• handle 50k imagery filenames TDE-1014 (#845) (07a7af5)

4.0.0 (2024-02-08)

⚠ BREAKING CHANGES

• add new fields to the Collection TDE-985 (#765)

Features

• accept only hyphen named categories TDE-985 (#830) (26682c8)
• add new fields to the Collection TDE-985 (#765) (78016f6)

Bug Fixes

• Disable duplicate code test (#817) (cde875d)
• NoSuchFileError is stopping multiprocessing sidecar files TDE-1007 (#832) (dea3189)
• sidecars download permissions TDE-1007 (#806) (16b5b04)
• write_file was not handling exception correctly TDE-1007 (#836) (caa289b)

3.6.0 (2024-01-09)

Features

• Remove empty TIFFs after standardising TDE-964 (#767) (70d79b3)

3.5.2 (2023-12-21)

Bug Fixes

• minor changes to be consistent with current data (#790) (4892b6b)

3.5.1 (2023-12-19)

Bug Fixes

• typo in prod (#788) (275a665)

3.5.0 (2023-12-19)

Features

• Dependabot for Docker TDE-963 (#746) (250b82c)
• Pin Docker image TDE-958 (#744) (de8a129)
• title and description by arguments TDE-960 (#757) (dd3e282)

Documentation

• add explaination about collection provider tests (#764) (4e84901)

3.4.0 (2023-11-23)

Features

• force LERC overview max Z error threshold to 0.1 (10cm) TDE-873 (#740) (0924c13)
• lint GitHub Actions workflows TDE-919 (#720) (1d32588)
• Pin actions to hashes (#729) (e2343d5)

3.3.1 (2023-10-04)

Bug Fixes

• typo in readme (#682) (544d271)
• upgrade gdal to 3.7.2 for webp fix (#677) (bdb4802)

3.3.0 (2023-09-26)

Features

• script to convert ascii files TDE-814 (#595) (5875d53)

3.2.1 (2023-09-14)

Bug Fixes

• recreate webp overviews TDE-869 (#650) (c1f265a)

3.2.0 (2023-09-08)

Features

• provide content type to S3 objects TDE-859 (#642) (bbbd653)

Bug Fixes

• gdal should not create bigtiff TDE-805 (#632) (b33825f)
• re-standardising TileByteCounts error TDE-850 (#644) (c762202)
• storing count is not used TDE-842 (#633) (8cfc405)

3.1.0 (2023-08-29)

Features

• download files using multithreading TDE-822 (#580) (8ab269d)
• thumbnails creation TDE-839 (#616) (8e2028f)

3.0.1 (2023-08-10)

Bug Fixes

• gdalbuildvrt fails when coordinate system description is different TDE-818 (#596) (5758400)
• non-visual QA greyscale TDE-832 (#593) (afe25f3)
• standardised path is not logged when non_visual_qa_passed (#591) (0c19104)
• stats are not written when retiling TDE-829 (#599) (c4bf5f2)

Documentation

• comment to explain why extent is specified (#584) (1971bc2)

3.0.0 (2023-07-25)

⚠ BREAKING CHANGES

• standardise_validate should allow 1 output from multiple inputs TDE-784 (#557)

Features

• standardise_validate allows passing a json file as input TDE-823 (#564) (ebd3e8e)
• standardise_validate should allow 1 output from multiple inputs TDE-784 (#557) (d0ddbbb)

Bug Fixes

• AREA_OR_POINT should be forced to AREA for DEMs TDE-787 (#537) (3b92a21)

Reverts

• "revert: "chore: upgrade gdal from 3.6.1 to 3.7.0 (#479)" (#536)" (#544) (ca824f9)

2.2.1 (2023-07-12)

Bug Fixes

• create a new release please PR to fix bug (#548) (c809721)

2.2.0 (2023-07-12)

Features

• handle standardising paletted tiffs (#547) (aa6ce05)

Reverts

• "chore: upgrade gdal from 3.6.1 to 3.7.0 (#479)" (#536) (810b73c)

2.1.0 (2023-07-04)

Features

• add --producer-list to allow multiple producers TDE-781 (#531) (0a28d6f)
• add dem_lerc preset TDE-779 (#522) (3e7378d)

Bug Fixes

• handle already existing collection JSON (#532) (7a26bae)
• standardising_validate.py fails when scale is 'None' (#480) (17296f1)

Documentation

• add missing docstring (#487) (dd27c7c)
• update docstring for tile_index.py (#473) (38ef275)
• update README release please instructions (#496) (d7369e0)
• update README.md (#481) (79add3c)

2.0.0 (2023-04-18)

⚠ BREAKING CHANGES

• resume standardise validate TDE-710 (#444)

Features

• fs.exists() checks if path exists TDE-710 (#441) (f79bd7a)
• resume standardise validate TDE-710 (#444) (b4022a5)

Bug Fixes

• fs_local.write() fails when directory does not exist (#445) (935a041)
• fs_s3.read() exceptions are not caught properly (#432) (3a855d5)
• unescaped bracket (#426) (f579638)

1.3.0 (2023-03-29)

Features

• deploy containers to ecr TDE-689 (#408) (31c713c)

Bug Fixes

• add latest to tag (#416) (82645ec)
• add permissions (#414) (d05aa10)
• update permissions (#415) (71c3fe9)
• use multithreading for gdalwarp when creating COGS TDE-696 (#399) (061d3d6)

1.2.1 (2023-03-08)

Bug Fixes

• trailing char in local path is removed (#389) (604e591)

Documentation

• improve documentation about release process (#362) (d85653e)

1.2.0 (2023-03-01)

Features

• make scale optional (#372) (20218bd)
• take source and target epsg, if not the same transform TDE-699 (#375) (547ec88)

Bug Fixes

• be specific about nodata being None (#363) (8fe8211)
• remove no data value (255) ensure is not none (#360) (a1154e8)

1.1.0 (2023-02-15)

Features

• add multiple STAC licensors TDE-643 (#355) (001b9fc)

1.0.0 (2023-02-13)

⚠ BREAKING CHANGES

• stac providers TDE-623 (#348)

Features

• stac providers TDE-623 (#348) (9bc71a4)

0.4.1 (2023-02-09)

Features

• convert nodata to alpha TDE-625 (#342) (6710aea)

Bug Fixes

• gdal info reference wrong file (#347) (52a2ee7)
• log wrong vsis3 path non visual qa TDE-563 (#343) (388ae19)

0.4.0 (2023-02-07)

Features

• standardising 16bits TIFF TDE-628 (#333) (1a07683)

Bug Fixes

• non visual qa errors logged twice TDE-563 (#320) (41c4c98)

Documentation

• add versioning release section in readme (#334) (7ad502c)

0.3.0 (2023-01-19)

Features

• add gray_webp preset TDE-482 (#149) (396dc16)
• add standardising script (TDE-303) (#23) (fd60e53)
• allow Create Polygons script to run with multiple files (#48) (8372cc7)
• apply a cutline if supplied (#240) (13688d8)
• automatically refresh role assumptions (#106) (40e4b52)
• cog output (#60) (38ef527)
• create collection TDE-453 (#177) (20f5f34)
• create polygon script return temporary file path (#47) (34c210a)
• create stac items TDE-452 (#133) (47e966a)
• create_polygons destination can be a full s3 path (#15) (d276baa)
• enable list source TDE-411 (#36) (c676b20)
• File System Abstraction local/AWS TDE-407 (#69) (b4f035e)
• gdal concurrency TDE-457 (#96) (3f4a3be)
• initialise collection stac TDE-453 (#132) (8c542d5)
• log pretty formatted gdalinfo in non visual qa logs TDE-563 (#214) (58d4cd2)
• log standardised image gdal virtual path when non visual qa error TDE-563 (#239) (e121df8)
• log the gdal version when run standardising TDE-559 (#210) (d458732)
• logs hostname and execution time TDE-431 (#77) (abb6634)
• non visual qa log original tiff path TDE-563 (#241) (6320cc9)
• Non Visual QA script (TDE-309) (#40) (8411779)
• optimise cutline handling by only using the cutline if required (#258) (5000a65)
• rename tiff file if not aligned with its tile name TDE-497 (#209) (7e547d6)
• run standardising step on a list of files (TDE-412) (#35) (c119a56)
• standardise following by non visual QA check TDE-450 (#90) (ee8227d)
• switch between two gdal presets "lzw" or "webp" (#108) (9483f51)
• tde-421 remove destination arguments (#61) (ba69fea)
• update stac collection TDE-453 (#134) (9127002)
• upgrade to stable GDAL v3.6 TDE-565 (#217) (786b11e)
• use a fixed version of osgeo/gdal container TDE-555 (#204) (e6837ec)
• write processed file paths in tmp/file_list.json (#50) (5387093)

Bug Fixes

• --cutline is not required (#244) (9fcb901)
• a couple of bugs in get_session_credentials (#120) (d6372e7)
• accept preset arg standardise-validate (#119) (aa86be8)
• add 'certifi' lib to temporary fix poetry install issue TDE-451 (#88) (0dd3ea7)
• append to a temporary command list (#110) (6527603)
• argument source was not correctly set (#49) (44ff66f)
• boto3 sessions need to create resources not clients (#245) (3cee053)
• collection title escaped unicode TDE-594 (#288) (a679042)
• correct type imports (#261) (78e55eb)
• download sidecar files like tfw and prj (#246) (b8bb95a)
• Elastic Search is expecting an object in 'source' (#156) (8b9503b)
• force a alpha band on all imagery if a cutline is present (#264) (dab4565)
• GDAL error was not logged when command run fails (#52) (01d941e)
• geometry, bbox and asset type TDE-502 TDE-520 (#185) (0229df8)
• keep temporary files so they are pushed to the artifact bucket (#66) (86b8c3a)
• log gdal stderr instead of raising an exception TDE-557 (#203) (4032145)
• log Non Visual QA error report in a JSON format (#55) (ed4d623)
• make cutline value optional TDE-602 (#292) (cfa20cf)
• not logging source as a list of string (#116) (a871935)
• release-please.yml fails prettier (#307) (330fa04)
• retry upto 3 times when InvalidIdentityTokenException happens (#115) (e27f2d0)
• skip files which are not tiff (#53) (90396a6)
• skip non visual qa if no file has been standardised (#97) (25a85c1)
• specify and check bands TDE-533 (#196) (d4e512f)
• support 1 band palleted grey scale TDE-601 (#269) (d2327a0)
• suppress aux xml file creation (#121) (c674366)
• TDE-454 remove standardise from file name (#92) (099df34)
• tidy up geometry and bbox TDE-522 (#227) (02b06b5)
• use $AWS_ROLE_CONFIG_PATH to be consistent (#109) (d1fff0d)