CHANGELOG.md

Changelog

12.5.0 (2025-01-08)

Features

• S3 cross account policy templating (#696) (b85fb60)

Bug Fixes

• DBTP-1641 - Add missing postgres plans to validation schema (#710) (bacee31)
• fix for the bug introduced during merging a conflict in the previous PR (#707) (ab9f0ab)
• Update dependencies to fix flaky E2E test (#711) (3e4ac8a)

12.4.1 (2024-12-11)

Bug Fixes

• DBTP-1290 - fix red herring "Not a Git repository" error (#682) (bbc7dcd)
• DBTP-1509 Correct link to maintenance pages instructions (#686) (58aca89)
• DBTP-1605 adding new key for parameter (#690) (93a0a94)
• DBTP-1605 checking new param (#689) (b7ef4a4)

Documentation

• Correct entry in changelog (#674) (cb0832d)

12.4.0 (2024-12-06)

Features

• DBTP-1568 - Add s3 support for cross environment service access (#654) (7e1d75f)

Bug Fixes

• DBTP-1498 - Add option for database dump filename (#681) (d06ddcc)
• DBTP-1498 - Add validation for database copy pipeline (#683) (cda1e7b)

Documentation

• Document new dbt-platform-helper architecture (#669) (ae4862d)

12.3.0 (2024-12-03)

Features

• DBTP-1299 - Cross account database copy (#657) (7d35599)

Refactor

• Improving provider structure and exception handling" (#670) (331e8b8)

12.2.4 (2024-12-02)

Bug Fixes

• DBTP-1572 - Fix _validate_exension_supported_versions incorrectly raising an error when no version is supplied (#660) (2ce98bf)

12.2.3 (2024-11-29)

Bug Fixes

• DBTP-1524 Make subnet order from environment generate match CloudFormation exports (#665) (f0f561b)

12.2.2 (2024-11-26)

Bug Fixes

• Fixing json loads (#664) (46eddff)

12.2.1 (2024-11-26)

Miscellaneous Chores

• Don't install poetry in Dockerfile.debian (#655) (9ad8c67)

12.2.0 (2024-11-26)

Features

• DBTP-1395 Add validation for new slack alert channel Id that will be set in <application>-alb in platform-config file (#635) (729c082)
• DBTP-1568 - Add s3 support for external role access (#652) (02bebd6)

Bug Fixes

• DBTP-1577 Fix conduit (ecs) exec race condition (#656) (22eafa0)

12.1.0 (2024-11-21)

Features

• DBTP-1380 Get Opensearch/Redis versions from AWS API - Platform-tools changes/Caching of AWS API calls (#624) (72d0dd7)
• DBTP-1434 - CDN cache policy (#642) (8cc2c0c)

Reverts

• DBTP-1520 refactor conduit command (#647) (7b56c5e)

12.0.2 (2024-11-13)

Bug Fixes

• DBTP-1534 - Removed autocompletion for the version get-platform-helper-for-project (#631) (6da392b)

12.0.1 (2024-11-13)

Bug Fixes

• DBTP-1548 - Maintenance page listener rules can be based on both CIDR range or IP in EGRESS_IP ssm parameter (#625) (6712e9b)

12.0.0 (2024-11-11)

⚠ BREAKING CHANGES

• DBTP-1002 Remove support for 100% AWS Copilot version of DBT Platform (#621)

Upgrade path

We have moved the last application off the fully AWS Copilot version of the DBT Platform Tooling. So whilst this is technically a breaking change, no action should be required on your part to upgrade from the previous major version.

Features

• DBTP-1002 Remove support for 100% AWS Copilot version of DBT Platform (#621) (c7a223c)

11.4.0 (2024-11-08)

Features

• DBTP-1109 Fall back on profile_account_id when trying to match account id to profile name. (#626) (0694775)

Documentation

• DBTP-1511 Link to Codecov in unit tests section of README (#627) (3179945)

11.3.0 (2024-11-05)

Features

• DBTP-1431 Add validation for CDN timeout (#609) (66a21c6)

11.2.0 (2024-11-04)

Features

• DBTP-1071 Generate terraform config for environment pipeline (#611) (237fb35)

Documentation

• Call out the offline command fix in the changelog (#613) (e2a6396)

11.1.0 (2024-10-30)

Features

• DBTP-1159 Add validation for duplicate entries in platform-config.yml (#604) (d00e143)
• DBTP-1215 Improve error message when AWS profile not set (#607) (beb0e7f)
• Delete data dump from S3 after data load has been successful (#600) (410cd56)

Bug Fixes

• Fix issue with offline command resulting in 'CreateRule operation: Priority '100' is currently in use' error

Documentation

• Add a note about regression/integration testing to the README.md (#612) (d219356)

11.0.1 (2024-10-22)

Bug Fixes

• Update dependencies (#602) (a07050b)

11.0.0 (2024-10-16)

⚠ BREAKING CHANGES

• Implement a data copy command that copies data cross-VPC (#565)

NOTE: This removes the previous platform-helper database copy command. Instructions for use of the replacement dump and load commands can be found here: https://platform.readme.trade.gov.uk/reference/copy-a-database-between-environments/

Features

• DBTP-1110 support cdn configuration (#596) (fd73517)
• Implement a data copy command that copies data cross-VPC (#565) (d9037e5)

10.11.3 (2024-10-02)

Bug Fixes

• DBTP-1373 - Handle SchemaErrors from platform config validation gracefully (#584) (8324049)
• DBTP-1375 - platform helper version get-platform-helper-for-project no longer validates config (#575) (f62c25d)
• fix typo (#591) (8f48dd3)

10.11.2 (2024-09-26)

Bug Fixes

• DBTP-1382 Fix conduit session KMS access permissions (#583) (fc3051e)
• Restrict regression test alerts to toolspr environment (#581) (d40f50f)

10.11.1 (2024-09-24)

Bug Fixes

• DBTP-1392 Allow codebase pipelines to codestar-connections:GetConnectionToken (#579) (bef6864)

10.11.0 (2024-09-23)

Features

• copilot-bootstrap: enable pingdom health checks (#573) (e063c3b)
• dbtp 1202 add cdn (#562) (b825bdf)
• nginx-proxy: support proxying websocket connections (#571) (40fbc65)

Bug Fixes

• Add source ip rule to maintenance pages (#574) (1e6aa29)
• Addressing workflow bug in DBTP-1083 (#577) (2fb1705)
• DBTP-1282 allow for explicit settings of PUB_PATH_LIST (#561) (2c41170)
• ensure delete_listener_rule deletes multiple rules with same name (#578) (8b2665d)
• ensure online command removes all rule types (#576) (f36f22a)
• Small fix that allows you to generate environment config without chan… (#568) (8133855)

10.10.0 (2024-09-12)

Features

• DBTP 1162 support hosting static sites on s3 (#555) (4e47ea0)

10.9.1 (2024-09-11)

Bug Fixes

• DBTP-1331 Ensure environment generate retrieves correct certificate for load balancer (#556) (0830410)

10.9.0 (2024-09-10)

Features

• DBTP-1301 - provide cross account s3 to s3 data migration permissions (#540) (8e9cea5)

10.8.1 (2024-09-05)

Bug Fixes

• add medium-ha postgres plan (#551) (72bb681)

10.8.0 (2024-09-05)

Features

• DBTP-1001 Add optional deploy_repository_branch to the codebase pipeline config (#545) (e5c5235)
• DBTP-1346 Add special characters & urlencode password parameters to OpenSearch validation (#549) (1b069af)

10.7.4 (2024-08-29)

Bug Fixes

• Use tag-latest for ci-image-builder (#543) (a4340de)

10.7.3 (2024-08-28)

Bug Fixes

• DBTP-1323 Broken platform-helper codebase \* commands (#542) (fd0e185)
• S3 bucket KMS Key lookup when environments are in multiple AWS ac… (#536) (960557d)

10.7.2 (2024-08-22)

Bug Fixes

• Replace .platform-helper-version check in buildspec (#538) (6764c6c)

10.7.1 (2024-08-19)

Bug Fixes

• DBTP-1294 Allow any environment deployment by deploy codebuild job (#528) (3fad07a)

10.7.0 (2024-08-19)

Features

• Allow override of platform-helper version in regression pipeline (#527) (5241adf)

Bug Fixes

• add a policy to allow services to access global SSM parameters (#531) (6fb9795)

10.6.1 (2024-08-12)

Bug Fixes

• Add target environment override to smoke tests (#524) (5edc1c2)
• DBTP-1180 - list all latest images tagged as commits (#529) (12c3d5d)
• DBTP-1207 - align extensions module name (#530) (3511c42)

10.6.0 (2024-08-02)

Features

• DBTP-1151 Add submodules script to pre_build.sh template (#516) (e7ae76a)
• DBTP-1154 add the prometheus prod service policy by default (#509) (35f52f7)

Bug Fixes

• correct conduit log group name (#523) (acd233c)
• DBTP-1236 - Fix codebase deploy to multiple environments (#517) (be3ba7c)
• DBTP-1265 fix platform helper version file missing (#521) (04adf14)

10.5.0 (2024-07-30)

Features

• Add ability to override the terraform-platform-modules version in the platform-config.yml file. (#504) (4dbb314)
• DBTP-1137 Add parameter to environment pipeline to allow triggering of other pipeline (#515) (832b463)

Bug Fixes

• Add trailing new lines to some auto generated files (#512) (d5454ca)
• DBTP-1044 as a developer when i enable a maintenance page i should still be able to access the service (PT. 2) (#473) (8ce58b3)
• DBTP-1152 - slack notifications work when GitHub-Hookshot triggers build (#501) (71c1c20)

Documentation

• Correct introductory paragraph on the Platform Helper README.md (#513) (20285ac)
• Update regression tests documentation (#507) (5746e3a)

10.4.0 (2024-07-16)

Features

• DBTP-1109 - Add command to copy data (#488) (825a68b)
• DBTP-1133 Add option to specify terraform-platform-modules version on the platform-helper environment generate command (#503) (521a1fb)

Bug Fixes

• DBPT-1128 Connection Error when connecting to Redis via Conduit (#498) (330cc14)
• test_validation.py::test_validate_success runs against all resources in the fixture (#493) (1206b78)

10.3.0 (2024-07-10)

Features

• Added an 'account' parameter to the environment_pipelines config (#490) (b0ad4d1)

Bug Fixes

• Dbtp-1094 use platform-helper notify for Slack alert on publish to PyPi (#494) (dcb3482)
• DBTP-1148 platform-helper environment generate should exit it not logged in (#496) (4ae5e7b)

10.2.0 (2024-07-05)

Features

• DBTP-1116 - Support configuration of the RDS backup retention period (#491) (a431184)

10.1.0 (2024-07-04)

Features

• Add defaults to AWS config (#487) (ae66e93)
• DBTP-1040 - add support for s3 lifecycle policies (#485) (92c7dc8)

10.0.0 (2024-07-01)

⚠ BREAKING CHANGES

• Update to use terraform-platform-modules 4 (#482)

Features

• Update to use terraform-platform-modules 4 (#482) (1d91bc5)

9.0.1 (2024-06-28)

Bug Fixes

• DBTP-1093 - Add postgres version 16 to conduit image (#477) (7d8747a)
• DBTP-1504 - Fix unauthorised error in OpenSearch conduit CLI (#483) (1248ddd)

9.0.0 (2024-06-21)

⚠ BREAKING CHANGES

• Changed platform-helper to use the combined platform-config.yml file rather than individual config files. (#461)

Features

• Changed platform-helper to use the combined platform-config.yml file rather than individual config files. (#461) (b9bbef2)

Bug Fixes

• pipeline: codebase pipelines branch name may be undefined error (#474) (41de810)

8.8.0 (2024-06-17)

Features

• support developers bypassing maintenance pages (#453) (8cba322)

8.7.0 (2024-06-17)

Features

• DBTP-612 allow wildcard in branch names (#457) (9b9aaf2)

Bug Fixes

• add dmas-migration to available environment template options (#468) (6e98ca1)

Documentation

• Fix typo in README (#464) (3ce139f)

8.6.0 (2024-06-10)

Features

• Add prometheus-policy extension type (#456) (e2b37ab)

Bug Fixes

• DBTP-1053 - Fix opensearch conduit parameter path (#458) (b7e7b07)

8.5.0 (2024-05-31)

Features

• Add slack notification commands (#448) (ddd33fb)

Bug Fixes

• redis and opensearch parameters missing ENDPOINT suffix (#446) (99f1c3f)

8.4.1 (2024-05-23)

Bug Fixes

• platform-helper generate ALB bugfixes (#438) (3ba7471)

8.4.0 (2024-05-22)

Features

• Cleaning out pipelines config before regenerating (#439) (421b8f9)

Bug Fixes

• DBTP-909 - Remove CloudWatch log resource policy (#440) (0a3e167)
• Update get_s3_kms_alias_arns to check for environment name (#442) (36e41e6)

8.3.0 (2024-05-20)

Features

• DBTP-933 Add option to Platform-helper to manage .aws/config file (#428) (9b8e0a3)
• DBTP-969 Allow HTTPS GitHub clones (#432) (0b1085d)
• Validation usability improvements (#430) (ee80ed0)

Bug Fixes

• DBTP-989 Make platform-helper generate skip generating AWS Copilot environment pipelines for Terraformed applications (#431) (04b5092)

Documentation

• Mention releasing non-breaking changes before merging breaking changes (#437) (bee47b6)

8.2.1 (2024-05-07)

Bug Fixes

• env generate vpc name not found bug (#426) (2acf0fc)

8.2.0 (2024-05-03)

Features

• DBTP-860 Add a command to generate/update environment manifest files with VPC/ALB config (#412) (27f5f1f)

8.1.0 (2024-05-02)

Features

• DBTP-779 - Trigger documentation update on new release (#417) (22bb105)

Bug Fixes

• DBTP-953 Unable to set up conduit with admin user (#423) (1c86195)
• update Postgres addon type for Conduit (#422) (2b43960)
• Use fake file system for create command docs happy path test (#414) (bcb9878)

8.0.0 (2024-04-24)

⚠ BREAKING CHANGES

• DBTP-885 Rename addons.yml to extensions.yml (#413)
• DBTP-905 Remove unused bootstrap config files (#406)
• Update aws-cdk and aws-cdk-packages to fix CVE 5777 (#409)
• DBTP-905 Remove bootstrap commands and requirement for bootstrap.yml (#402)

Features

• set the ECS cluster name (#407) (8f6af32)

Bug Fixes

• DBTP-907 Platform helper generate version file (#403) (f386383)
• DPTP-923 Mock function that causes problems in generate tests (#411) (3eb57bf)
• Update aws-cdk and aws-cdk-packages to fix CVE 5777 (#409) (ed3fe10)

Miscellaneous Chores

• DBTP-885 Rename addons.yml to extensions.yml (#413) (ecdabd7)
• DBTP-905 Remove bootstrap commands and requirement for bootstrap.yml (#402) (08019eb)
• DBTP-905 Remove unused bootstrap config files (#406) (70e9aec)

7.0.0 (2024-04-15)

⚠ BREAKING CHANGES

• DBTP-859 Modify make-addons to support Terraform stack (#391)

Features

• DBTP-777 - Automate release version (#395) (ce28788)
• DBTP-859 Modify make-addons to support Terraform stack (#391) (b3eb9db)