Release 0.7.0

Upgrading dp-kafka.
Upgrading go version.

Release 0.6.0

This release has following main changes:

• get datasets using dataset-api client
• Update container base to Ubuntu 20.04, fix audit
• Publish to content updated
• Fix goroutine blocking issue

Release 0.5.0

These are the changes in this release:

The following functionality has been removed so that the Search Data Finder no longer has a dependency on the Search Reindex API and so that the new Search Import Tracker can be used, instead of this, to update the Search Reindex API with information about search reindex jobs and their tasks. The Search Data Finder now has a single responsibility, which is to find data that needs to be indexed (or re-indexed) in search:

1. Call the PatchJob function of the Search Reindex client - removed

2. Call the PostTask function of the Search Reindex client - removed

3. Log the ETags that were returned by the PatchJob and PostTask functions. Also log the details of the new Task resource. - removed

Release 0.4.0

These are the changes in this release:

• After a reindex-requested message has been consumed, and the list of URLs has been received from zebedee, the event handler will now do the following things:

1. Call the PatchJob function, of the Search Reindex client, to update the new Job resource with the following values:

• state: "in-progress"
• total_search_documents: <number of URLs from zebedee e.g. 74028>

2. Call the PostTask function, of the Search Reindex client, to create a Task resource, associated with the new Job resource, for the task of adding the list of URLs, from zebedee, to the new Elastic Search index. The new Task will have the following values:

• number_of_documents: <number of URLs from zebedee e.g. 74028>
• task_name: "zebedee"

3. Log the ETags that were returned by the PatchJob and PostTask functions. Also log the details of the new Task resource.

• Some code, which had accidentally been deleted, to extend the amount of time given for zebedee to respond, has been reinstated.

Release 0.3.0

• Refactoring codebase in sync with other event driven services - PR #11 - @bpathak-ons
• Update content-updated schema to be aligned with zebedee and dp-search-data-extractor - PR #13 - @justinpjose
• Use dp-kafka v3 throughout API - PR #13 - @justinpjose
• Use dp-kafka/v3/avro - PR #13 - @justinpjose
• Register search reindex api checker - PR #14 - @nshumoogum

Release 0.2.0

• Extend to request a list of uris from Zebedee
• Produce events to content-updated topic in MSK

Release 0.1.0

These are the changes in this release:

• The Search Data Finder was initialised as an event-driven app using the project generation tool.
• The reindex-requested events (to be consumed) and content-updated events (to be produced) were added to the config.
• The healthcheck was updated to check for the reindex-requested consumer group.
• A bug was fixed in the nomad file so that the Search Data Finder could be deployed successfully in develop.
• Another bug was fixed so that kafka messages could be consumed. This bug came from the generation tool code (now being fixed).
• Reindex-requested messages can now be successfully consumed and logged to the console.