Changelog

Don't set end date on invoice account address import on conflict #340
Feat/water 3212 remove doc versions #333
Update queries.js #338
Enable invoice account import #329
Release/wrls sprint 47 #328
Bugfix/ignore replaced cv when assembling 2pt agreements #327
Bug fix: Ignore replaced charge versions when importing agreements #326
Bugfix/importing licence purpose conditions #324
Bugfix/importing licence purpose conditions #323
Bugfix/importing licence purpose conditions #322
BUGFIX - import licence version purpose conditions #321
Modify billing volumes import query to include correct seaon #316
Add additional mapping to agreements to handle cases where there are … #319
Feat/water 3081 informing CM when there has been a NALD linked entities change #299
Bugfix - water 3136 - reduce calls to the DB and DB insert errors #315
WATER - 3136 - Import NALD licence version purpose conditions #313
Release/wrls sprint 46 #314
Fix query params in licence agreement import cleanup #311
Include flag for if TPT enabled at element level #310
Revert "Feat/water 3157 import tpt agreement purposes" #309
Water - 3041 - New connector to send Notify emails via water service #305
Release/wrls sprint 45 #304
Feat/water 3157 import tpt agreement purposes #300
WATER-3041 Job to track failed Import jobs #292
1.73.0 #294
Modify TPT agreement import end date #291
Release/wrls sprint 44 patch 1 #290
Release/wrls sprint 43 #286
1.71.0 #287
Update queries.js #282
Fix date mapping issue #285
Add feature flags to enable/disable import of invoice accounts and do… #281
Feat/water 3078 nald charging import #280
Add 390 to list of TPT purpose use codes #278
Feat/water 3032 import jobs status #276
Release/wrls sprint 41 #277
WATER-3036: Automatically flag expired/lapsed/revoked licences for supplementary billing #275
Remove transaction keys #274
Fix issue where invoice and credit note totals were not imported to b… #273
Pull the S3 import path from .env and config object #272
Remove logic to skip return import for older returns - causes bug 3019 #271
Feat/water 3035 import billing batch charge version years #270
Feat/water 3034 import billing volumes #268
Feat/water 3015 import transactions #266
Bugfix for water 2968 - licence versions upsert fixed #267
Import invoice licences #265
Import bill headers #264
Release/charging sprint 39 #262
Release/charging sprint 38 #260
feat/water-3041 d902c02
Fix tests 500320d
feat/water-3041 a7cd49d
feat/water-3041 9124141
Adjust import for 1 document per licence 33a2291
feat/water-3136 0abf8c1
feat/water-3136 e1d7f76
bugfix/water-3041 571b4e2
Additional tests, fix bug and code smell bafa04e
Initial work on TPT import query 7332bcf
Add additional mapping to agreements to handle cases where there are multiple elements with different date ranges a754b8a
Modify TPT agreement import to end on the earliest of EFF_END_DATE or the charge version EFF_END_DATE 9d9ab0e
Clean up agreements, remove duplicates in agreement mapping 07f4093
Modify season of imported TPT bill runs 4e2d7ab
bugfix/water-3041 447defd
Fixes a pesky little issue whereby invoice account address linkage records were not being created for companies without an agent 88972e8
feat/water-3136 59909a8
Add comments 6da6b56
Re-order functions d3cb2c6
Tweak TPT agreement import logic 7f7f196
Fix tests 8cceb29
Add TPT import queries to job handler, remove old implementation f6625b5
bugfix/water-3136 a741751
feat/water-3136 b5f8907
bugfix/importing-licence-purpose-conditions 8b5ac5f
Removing unnecessary conditional 726cce4
bugfix/importing-licence-purpose-conditions 660afde
bugfix/importing-licence-purpose-conditions 46388cd
feat/water-3041 10e04bd
feat/water-3041 93e077c
bugfix/water3136 7dadb68
Get S127 value from subquery 7f9512c
Tweak 99c9e61
bugfix/water-3136 7ec0468
Adding tweaks I requested in PR ee2f9d1
feat/water-3136 0a028b3
Populate hash for contacts when importing from NALD b152846
Update config.js 418d47c
Update the query for creating companies such that it populates hashes c0cae49
bugfix/importing-licence-purpose-conditions 7c1b548
Updates the address creation routine 70c5ae6
Review: remove useless function argument 76d4de8
bugfix/importing-licence-purpose-conditions 64fb810
Set last_hash when the import query is called for entities 2700321
Fixing a mismatch in the MD5 generation bde4d79
Undoing a recent [incorrect] change 5d7bacf
feat/water-3041 db63802
feat/water-3041 96c3189
Trigger CI 776d3e6
Add feature flags to enable/disable import of invoice accounts and document billing roles 2c7fefd
WIP b806b1c
Split charge data into 2 separate jobs, one which will be run on cron job, and the other to be run once on go live 9544430
Add query to import transactions 543132d
Remove outdated test b6fc56f
Add query to set transaction key, re-write transaction descriptions 5190307
Additional tests 7af099f
Fix broken tests b59f0ff
Remove unnecessary module/plugin 8500771
Additional tests eb30c8a
Removes caching 23b67ce
Use A1/A2 billable amounts, always include compensation charge if >0 d4292f1
Adds a couple of tests for the SQL queries 8fc9ae4
Create PG boss job for billing import 1255602
Test tweak f1b0fa4
Import water.billing_batch_charge_version_years b455d6e
Flags a licence for supplementary billing if revoked/expired/lapsed dates have changed. cc57078
Import billing volumes f9248e1
Modify query to include created 6e4cfc3
Make route definitions consistent across modules 943071d
Tweaks following PR aa24db2
Change to camel case as suggested in peer review 5bd5c0e
Further test tweaks 8a8d61d
Update jobs.js 5d4011b
async stub 8ea4d6d
Adds missing jobs 3e48491
Removing a teeny tiny code smell 05e29cd
Convert amounts to pence to match CM. Include billable days calc 651b588
Disable import of document billing roles from NALD 624457b
Removing minor code smells 1c01c86
Stub new functions 833de05
Fix issue where invoice and credit note totals were not imported to billing batches f44cf0a
Better comment 9e57a8d
Add missing invoice numbers 1bc419b
Only import bill headers with bill number, fix bug in compensation charge import 4936db9
Fix issue with S130 import 4c93340
Add additional notes 261eade
Fix code smells 6da86d6
Remove rogue comment / needless beforeEach a63c8d9
Fix code smell 0eccc61
Trigger CI 311ec58
typo 26e617c
Missed one 8e7ddc0
Add default value 4c74b33
Remove unnecessary param - SonarCloud code smell f9c63d2
Update jobs.js b1950af
Re-run CI 1072587
Set transaction S126 factor to null 198759c
bugfix/water-2968 3efa5f8

v1.61.0

4 February 2021

Add endpoint to import bill runs #263
Fix code smells 693cde2

v1.60.0

20 January 2021

WATER-2893 - Add EIUC and SUC to Json blob #256
Change var names to a more verbose explanation rather than acronyms bd70d2d
Update licence.js 28acebd

v1.59.0

6 January 2021

Reconfiguration #249
Change NODE_ENV test to qa #254
Update pg library #250
Update constants.js #236
Modifying the Cron job to run Mon-Fri fa06205
Update plugin.js f1d08e8
Modify tests 3e53b7d
Update config.js 5046252
Update ecosystem.config.json 8d16478
Update config.js 791e391
Setting instance count back to 'Max' as requested 2224436
Increase job check interval 53ce45b

v1.57.0

27 November 2020

Experimental/water 2954 #246
Experimental/water 2954 #245
Bugfix/charge version metadata import job #243
Adds Slack messages when the charge import job has been started/finished #242
Updates charge version import to populate local metadata table #240
Feat/water 2949 Import Charge Versions with SQL #241
Update 20201120135927-create-charge-versions-metadata-table-up.sql #239
Update 20201120135927-create-charge-versions-metadata-table-up.sql #238
Creates table via migration #237
Maps NALD charge versions to WRLS format #234
Feat/Edit Charge Version - Added licence Id to charge version #226
Add new CI config #233
Force NALD import to complete in test env regardless of etag value #232
Feat/water 2924 delete all batches #230
Restores the SQL approach to inserting Charge Versions 2d8964b
Simplify import of charging data to use concatenated external IDs 2e43fc1
Remove check integrity code f985ca2
Move charge version metadata to NALD import job b35b1fe
Adds new job and route for importing charge version metadata 67d9ad0
Fix tests 4f3f1ab
Fixes date handling issues f73ae90
Review comments, additional test case 7af33f4
Remove redundant queries 4ef10ca
Remove redundant code, fix code smell 972181a
Adjust import schedules so metadata runs first 98f370d
Fix tests ce562a1
Fixing numerous issues in query identified in PR 82ab590
Bugfix 1961c4a
Update charging.js 39e9645
Remove charge agreements table from integrity check 063c565
feat/2806 39c2c42
Update charging.js 17c38f7
Fix tests c9535f2
Various changes following discussion with James 64bde02
Update README.md 3ff502f
Review comments - better naming 9f1b6b6
Remove reference to water.billing_batch_charge_versions table 29233cb
Update charging.js 96e2536
Missing comma 7e77373
Remove console.log 4150ee9

v1.56.0

11 November 2020

Schedule licence/charging imports overnight in production #231
Extends import of returns headers from 3 to 6 years #229

v1.55.0

30 October 2020

Fix: Delete documents from CRM when deleted from NALD #223

v1.54.0

14 October 2020

Initial work to import licence returns contacts to CRM v2 structure #215
Fix: Document status to use all version increments #222
Ensure company addresses related to licence-holder roles are imported c699429
Map licence role end date, add tests 015b007
Fix/add tests f06e038
Add addresses discovered via licence roles to companies during import 7bc3f58
Fix code climate issue 3a51b53
Fix issue with test stub 4158b21

v1.53.1

2 October 2020

Fixes cleanup phase of charge version import #218
Bugfix/water 2875 sql query discrepancies #217
Remove newlines from return version import queries #216
Removed some unnecessary spaces and SQL terminators 7321a99
Fixes cleanup phase of charge version import taking foreign keys into account 27fb1c5
Update import-companies.js e4b8643
Add semi-colons to sql queries (review comments) 3e66c25
Fix lint issue 3c8e7dd

v1.53.0

1 October 2020

Handles water service changes to agreements #209
Fixes issue where licences with null ORIG_EFF_DATE could not be imported #208
Revert "Adds UNIQUE constraint on ALTER TABLE water.financial_agreement_types" 5655a40
Adds UNIQUE constraint on ALTER TABLE water.financial_agreement_types 8bdc843
Updates to handle changes in water service financial_agreement_types and licence_agreements tables 9b7e868

v1.52.0

16 September 2020

Import all data in all environments #206
Feat/water 2840 returns cycle due date #205
Extend deadline to 2020-10-16 for winter/all year return cycle #202
Extend deadline to 2020-10-16 for winter/all year return cycle 2020 due to coronavirus d518aef
Fix tests bb53751

v1.51.0

28 August 2020

Fixes query and cron issues in document roles import #201
Update charging.js #200
Bump @hapi/lab from 22.0.4 to 22.0.5 #189
Bump @hapi/code from 8.0.1 to 8.0.2 #190
Bump moment from 2.26.0 to 2.27.0 #181
Bump lodash from 4.17.19 to 4.17.20 #193
Bump sinon from 9.0.2 to 9.0.3 #192
Bump csv-stringify from 5.5.0 to 5.5.1 #191
Bump codecov from 3.7.0 to 3.7.1 #188
Bump eslint-plugin-import from 2.21.2 to 2.22.0 #183
Bump codecov from 3.6.5 to 3.7.0 #172
Chore(deps): Bump @envage/hapi-pg-rest-api from 4.1.2 to 4.2.0 #87
Added valid purposes combination import SQL script to the existing Ch… #196
Added valid purposes combination import SQL script to the existing Charging import workflow. e2e1d75
Fixes issues where: 1c6e4fa
Adding new line to keep Travis happy 4eb53d6

v1.50.0

21 August 2020

Sets NALD as default data source for addresses and contacts #195
Imports return requirements to tables in water service #194
Asserts 'nald' as the data source when making insert query into CRM_v2 database 5336373

v1.49.0

5 August 2020

v1.48.0

20 July 2020

Bump lodash from 4.17.15 to 4.17.19 #187
Don't import licences without a start date #185

v1.47.0

3 July 2020

Adds extra TPT purpose codes #184
Feat: Adds loss factor to purpose use #182
Populates agent_company_id on crm_v2.invoice_account_addresses #180
Tweak to name normaliser e4e2a01

v1.46.0

22 June 2020

Feat: Move caching to redis #179
Feat: Import licence versions #177
Codeclimate fixes 8327204
Adds an external id to the licence purposes 3de006b
Prevent scheduling of NALD import on travis 3b429a6
Add public namespace to gen_random_uuid calls 18bb35e
Remove a routes files from codeclimate checks 8e4b89f

v1.45.0

10 June 2020

v1.44.0

1 June 2020

Fix: Update charging import schedule - merging as CodeClimate CI currently not completing #175
Chore: Improve the naming in the job summary #174
Feat: Moves NALD import to import module #170
Fix issue where company_id/invoice_account_id are not upserted during… #169
Fix issue where company_id/invoice_account_id are not upserted #168
Fix: Update charging import schedule 51c4166
Fix issue where company_id/invoice_account_id are not upserted during charge import 2911ca5

v1.43.0

22 May 2020

Store CRM company ID and invoice account ID in water.charge_versions #165
Re-run Travis CI a4dd674

v1.42.0

24 April 2020

Update package-lock.json 2cd965c
Update package.json 23bedfb

v1.41.0

14 April 2020

v1.40.0

14 April 2020

Alter import jobs to run every other day on target environments. #158
Fix code climate issue 1d30bd6
Restart CI 6af8d5b
Alter import jobs to run every other day on target environments. Use PG boss plugin from water-abstraction-helpers. 8dbf388
Fix codeclimate error, set up plugin dependencies. 9e806cd
Fix linter error 2275314

v1.39.0

27 March 2020

v1.38.0

16 March 2020

Fix: Includes update package-lock with correct version of dotenv #154
Feat: Graceful shutdown for pg boss and pg pool #148

v1.37.0

28 February 2020

Bug fix/reallocate connections #147

v1.36.2

25 February 2020

Bug fix/update connection pool allocation #146
Fix: Reallocate database connections bec82a0

v1.36.1

25 February 2020

Import start, expired, lapsed and revoked dates & suspend_from_billing flag #144
Chore: Updates node version in .nvmrc #141
Chore: Updates node version in .nvmrc #139
Fix: Updates the connection pool allocations be3cf63

v1.36.0

31 January 2020

Chore: Pre work for upgrading to Node v12 #135
Chore: Update connection pool distribution #134
Feat: Import licences #131
Updates conflict index to remove region id 2534679

v1.35.0

7 January 2020

Feat: More graceful shutdown #128
Use db.createPool from water-abstraction-helpers #126
Fix: Remove increment from document external id #123
Fix: Wait for companies to be saved #122

v1.34.0

26 November 2019

Amend import process to import all companies before licences #120
Chore/security recommendations #117
Modifies ID columns in charge_agreements, charge_elements and charge_versions to uuid #118
WATER-2322: importing CRM v2 data from import tables #116
Remove section 127/130 agreements from charge elements #113
Re-organise code into extract/transform/load steps 6c99005
Remove existing CRM import code 041593c
Add tests for licence import load connectors cfa33ca
Import licence agreements. Add tests for handler functions c8f77b1
Initial work on mapping company data c9920df
Remove unwanted code, add tests of licence import extract functions 9a13fdb
Add tests for company mapping 0379cb0
Improve orchestration of import to do related companies of licence and then company. Disable import in production 8f8daa4
Add test for more complex licence with agreements 3af4aba
Add test for company loader 2cc10e8
Add test for licence import plugin de6c226
Add tests for importing companies 01ae2d4
Add tests for licence loader ae07c84
Add controller tests 41e8256
Additional tests for date mappers and PG Boss plugin c25d365
Add tests for job creators a697777
Add tests for invoice account/addresses 561a248
Additional tests for company-contact.js 0336c80
Add support for contact initials 1696fa4
Fix all licences query 73112e4
Fix linter errors db251e1
Remove charge element-level agreements which have been moved to licence level (S127, S130) d2e3ff5

v1.33.0

13 November 2019

Feat/crm v2 mapping #112
Initial work on mapping CRM data in JS b630bb5
Add two-part tariff and account agreements d1a8765
Add initial unit tests 93b1685
Move all database access code to connectors directory. 9cda0b9
Add tests for import connector 97623f3
Fix CodeClimate issues 276ba50
Add test for a licence with multiple versions 57c3624
Add tests for S130/S127 agreements 487230f
Add tests for date mappers b7a3747
Add test for mapping document billing roles d3d2646
Add tests for contact mapping b851138
Review comments b2ec979
Remove dead code, improve comments 4b98965
Remove invalid billing roles d154905
Ensure all DB calls are stubbed in unit test 38932ec
Bugfix 0b3fc6e

v1.32.0

30 October 2019

Feat: Renames ias account number #111

v1.31.0

15 October 2019

Chore: Adds linting back into tests #106
Feat/import licence holders #105
Fix issue with charge version query #104
Feat/water 2322 import ias accounts #102

v1.30.0

7 October 2019

Import versioned CRM documents with dates and status #98

v1.29.0

4 September 2019

Feat/water 2262 financial agreements #97
Feat: Adds purposes to charging import #95
Feat/water 2209 charge import #93
WATER-2209 de35554
Updates import queries to use explicit date conversions 76e2ccf
Adds the db:migrate task as a placeholder f22a4a6

v1.28.0

22 August 2019

Merge tag 'charging-sprint-1' into develop 0992597

v1.27.0

24 July 2019

v1.26.0

9 July 2019

Feat: Adds version number to status check output #88

v1.25.0

27 June 2019

v1.24.0

12 June 2019

Chore: Use port from config not environment #86

v1.23.0

29 May 2019

Chore: Update logger to latest version #85
Chore: Updates eslint and adds ignore file #80

v1.22.0

15 May 2019

v1.21.0

2 May 2019

Remove local logger #77

v1.20.1

23 April 2019

Only log error level messages in production #75

v1.19.0

2 April 2019

v1.18.0

19 March 2019

Chore: Corrects version number 72fbd01

v1.4.0

7 February 2019

Adds return_cycle_start date to return responses #50
Merge tag 'public_beta_1.16' into develop 41f7dd3

v1.3.0

23 January 2019

v1.2.0

12 December 2018

Feat: Use logger instead of request.log for errors #36
Use NPM module for hapi-pg-rest-api #34
Bump hapi from 17.5.4 to 17.8.1 #30
Bump eslint from 5.5.0 to 5.9.0 #23
Bump code from 5.2.0 to 5.2.4 #29
Feat: Tidy env variables #24
Feat: Align with develop standards #27
Fix: Use Sun - Sat weeks for NALD #25
Output under_query_comment as empty string if null #16
Feat: Adds proxy support for logging to Errbit #15
Add returns endpoint #14
Feat: Improve logging #13
Only filter lines if weekly #12
Filter any lines out of response which are outside the return cycle s… #11
Modify nald_date_from to give the first of the month containing the r… #10
For weekly returns, output nulls on non-Saturdays. For nil returns, … #9
Fix: Update airbrake js #8
Feat/water 1550 #7
Feat: Separate test tasks #6
Fix: Handle null quantities #4
Feat: Extra data for NALD export resources #3
Feature: Reduce /etl/versions payload #2
Feature: Get versions and lines for NALD #1
Adds basic project content 4a488f8
Update package.json 25be883
Filter any lines out of response which are outside the return cycle start/end dates b87f08b
Add unit test d983a8c
Adds testing resource fee0a7c
Adds temporary testing route 87c89ac
For weekly returns, output nulls on non-Saturdays. For nil returns, only output 0s for weeks with end date inside abstraction period. cb3f49c
Bumps up har-validator version b4f4b9c
Modify nald_date_from to give the first of the month containing the return start_date. This makes it easier for ETL to locate first form log. 1ec0fa5
Fix linter errors cbb9e01
Bump to 1.14 024a318
Fix: Fixes argument signature for getLines a19540c
Merge tag 'public_beta_1.11' into develop dc50a5a
Merge tag 'public_beta_1.9' into develop 73009f8
Merge tag 'public_beta_1.8' into develop 2252af3
first commit 513a8f5

Files

CHANGELOG.md

Latest commit

History

CHANGELOG.md

File metadata and controls

Changelog

v1.2.0