Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update udata to 6.0.2 #331

Closed
wants to merge 1 commit into from
Closed

Conversation

pyup-bot
Copy link
Collaborator

@pyup-bot pyup-bot commented Feb 6, 2023

This PR updates udata from 3.3.2 to 6.0.2.

Changelog

6.0.2

- Handle None values in dataset and resource extras endpoints [2805](https://github.com/opendatateam/udata/pull/2805)
- Fix default license being selected in form in optional select group [2809](https://github.com/opendatateam/udata/pull/2809)
- Fix only SHA1 checksum is accepted when uploading resources [2808](https://github.com/opendatateam/udata/pull/2808)
- Fix organization metrics count [2811](https://github.com/opendatateam/udata/pull/2811)
- Fix setuptools version used in CI [2813](https://github.com/opendatateam/udata/pull/2813)
- Add `udata harvest clean` command [2812](https://github.com/opendatateam/udata/pull/2812)

6.0.1

- Add python version requirement <3.10 [2798](https://github.com/opendatateam/udata/pull/2798)
- Fix date timezone and format for harvest previz [2799](https://github.com/opendatateam/udata/pull/2799)
- Add support for DCAT startDate and endDate in temporal coverage [2801](https://github.com/opendatateam/udata/pull/2801)
- New feature: Users can now change their email by themselves [2792](https://github.com/opendatateam/udata/pull/2792)

6.0.0

- :warning: Kafka removal [2783](https://github.com/opendatateam/udata/pull/2783)[#2794](https://github.com/opendatateam/udata/pull/2794):
- Resources events publication now uses webhooks
- Search indexation (at runtime and with index command) are now made through HTTP requests.
- If you use [udata-search-service](https://pypi.org/project/udata-search-service/), you need to upgrade to the >=2.0.0 version
- Add dedicated extras endpoints on resources and datasets [2779](https://github.com/opendatateam/udata/pull/2779)
- Enrich catalog with harvest infos [2789](https://github.com/opendatateam/udata/pull/2789)
- Add optionnal license select group custom setting for admin [2786](https://github.com/opendatateam/udata/pull/2786)
- Make index setup optional on init based on config [2797](https://github.com/opendatateam/udata/pull/2797)

5.0.2

- :warning: Upgrade to `Flask-Security-Too` version 4.0.0 [2772](https://github.com/opendatateam/udata/pull/2772):
- New User model attribute `fs_uniquifier`, migration needed.
- The `fs_uniquifier` is used to invalidate existing session in case of password reset.
- The user's `fs_uniquifier` is used instead of the `id` for auth mecanism including permissions.
- Exhaustive list of changes [here](https://flask-security-too.readthedocs.io/en/stable/changelog.html#version-4-0-0).
- Fix apiv2 swagger with harvest metadata and add apiv2 swagger tests [2782](https://github.com/opendatateam/udata/pull/2782)
- Improve frequency criterion in quality score [2771](https://github.com/opendatateam/udata/pull/2771)
- Add quality score to csv catalogs [2785](https://github.com/opendatateam/udata/pull/2785)
- Optimize DCAT harvesting on large multiple-paged catalogs, introduce `HARVEST_MAX_ITEMS` development setting [2781](https://github.com/opendatateam/udata/pull/2781)
- Add condition in security mail utils class to avoid mail sending according to config var [2788](https://github.com/opendatateam/udata/pull/2788)

5.0.1

- Fix resource harvest uri validation error [2780](https://github.com/opendatateam/udata/pull/2780)

5.0.0

- :warning: **Breaking change** Use dedicated dynamic harvest metadata for dataset and resources. A migration copies identifying fields from extras to this dedicated metadata field. Extras won't be used anymore for harvest-related information. udata-ckan, udata-ods and udata-front packages are impacted and should be upgraded accordingly [2762](https://github.com/opendatateam/udata/pull/2762)

4.1.3

- Fix image URLs for suggest endpoints [2761](https://github.com/opendatateam/udata/pull/2761)
- Switch from `Flask-restplus` to its fork `Flask-rest-x` [2770](https://github.com/opendatateam/udata/pull/2770)
- Clean inactive harvest datasets. :warning: a migration archives datasets linked to inactive harvest sources [2764](https://github.com/opendatateam/udata/pull/2764) [#2773](https://github.com/opendatateam/udata/pull/2773) [#2777](https://github.com/opendatateam/udata/pull/2777)
- Fix randomly failing suggest tests [2775](https://github.com/opendatateam/udata/pull/2775)
- Fix alt attribute not shown on image [2776](https://github.com/opendatateam/udata/pull/2776)

4.1.2

- Clean up event code [2751](https://github.com/opendatateam/udata/pull/2751)
- Replace mongo legacy image in CI [2754](https://github.com/opendatateam/udata/pull/2754)
- Fixes test `test_suggest_datasets_api` by modifying condition [2759](https://github.com/opendatateam/udata/pull/2759)
- Fix doc name duplicate on rdf endpoints [2763](https://github.com/opendatateam/udata/pull/2763)

4.1.1

- Quality score computation refactoring and now returning it in list datasets endpoint. Update was made in admin too. [2746](https://github.com/opendatateam/udata/pull/2746)
- :warning: Manifest logic was removed and udata does now work as standalone [2747](https://github.com/opendatateam/udata/pull/2747)
- Remove map related stuff [2749](https://github.com/opendatateam/udata/pull/2749)
- Add library udata_event_service to produce Kafka messages [2743](https://github.com/opendatateam/udata/pull/2743)

4.1.0

- Add html support for posts [2731](https://github.com/opendatateam/udata/pull/2731)
- Use mongo search if `SEARCH_SERVICE_API_URL` variable is not set [2728](https://github.com/opendatateam/udata/pull/2728)
- Improve resource extension detection [2729](https://github.com/opendatateam/udata/pull/2729/files)
- Remove resources in dataset search serialization [2730](https://github.com/opendatateam/udata/pull/2730)
- Add endpoint to directly get specific resource by rid [2732](https://github.com/opendatateam/udata/pull/2732).
- Publish kafka message when resource is created, modified or deleted [2733](https://github.com/opendatateam/udata/pull/2733)
- Clean documentation and code with respect to independent search service [2738](https://github.com/opendatateam/udata/pull/2738)
- Fix size argument in suggests endpoint and corresponding tests [2739](https://github.com/opendatateam/udata/pull/2739)
- Add udata instance name prefix and action suffix for kafka topics [2736](https://github.com/opendatateam/udata/pull/2736)
- Fix tokenisation by building an `AND` query (see comments in code) for mongo text search and pagination [2740](https://github.com/opendatateam/udata/pull/2740)

4.0.2

- Remove unused `_total_pages` search property [2726](https://github.com/opendatateam/udata/pull/2726)
- Use -followers as default suggest sort on datasets, reuses and orgas [2727](https://github.com/opendatateam/udata/pull/2727)
- Reintroduce user suggest with mongo contains [2725](https://github.com/opendatateam/udata/pull/2725)

4.0.1

- Removed `post_save` signal within `add_resource` and `update_resource` methods. [2720](https://github.com/opendatateam/udata/pull/2720)
- Refactor and update documentation with latest udata updates [2717](https://github.com/opendatateam/udata/pull/2717)
- Add harvest csv adapter for a catalog of harvesters [2722](https://github.com/opendatateam/udata/pull/2722)

4.0.0

Breaking change

Search refactor [2680](https://github.com/opendatateam/udata/pull/2680)
- :warning: Search changes [2692](https://github.com/opendatateam/udata/pull/2692):
- The search feature is not within udata anymore and queries a distant service.
- The search feature is now optional and is enabled by setting the `SEARCH_SERVICE_API_URL` setting.
- When search is not enabled, the search endpoints will return a `501 Not Implemented` error.
- The ModelAdapter, SearchQuery and SearchResult patterns were kept but heavily refactored.
- udata uses a Kafka producer to send documents to index to the search service.
- udata uses HTTP request to query the search service.
- :warning: API changes [2669](https://github.com/opendatateam/udata/pull/2669):
- List endpoints for organizations, datasets, reuses and users are now querying MongoDB instead of ElasticSearch.
- Those endpoints use MongoDB full text search when `q` argument is used. Some unused filters on this route were dropped.
- A new API parser was implemented to replace the search one.
- The previous ElasticSearch endpoints were moved to APIv2 with the following url pattern: `/{object}/search` (ex: `/datasets/search`).
- :warning: Suggest changes [2685](https://github.com/opendatateam/udata/pull/2685) and [#2696](https://github.com/opendatateam/udata/pull/2696):
- Current suggest implementation moved from an Elasticsearch index to a MongoDB query using the term `contains`.
- The user suggest was entirely removed, as its existence is now less relevant because of the full text search.

3.3.3

- Extend dcat properties support (frequency litteral, creation and modification date, landing page and abstract description) [2715](https://github.com/opendatateam/udata/pull/2715)
Links

@pyup-bot pyup-bot added the update label Feb 6, 2023
@pyup-bot pyup-bot mentioned this pull request Feb 6, 2023
@quaxsze
Copy link
Contributor

quaxsze commented Sep 28, 2023

Done in #337

@quaxsze quaxsze closed this Sep 28, 2023
@quaxsze quaxsze deleted the pyup/update-udata-3.3.2-to-6.0.2 branch September 28, 2023 13:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants