v1.10.0-M18

What's Changed

Features

• Introduce pit endpoint for Elasticsearch views by @imsdu in #5084
• Add the ability to link a file while generating the id by @imsdu in #5088
• Fix delegation + add the ability to tag at creation by @imsdu in #5091
• Add the ability to delegate creation by providing an id by @imsdu in #5092
• Allow to update files via delegation by @imsdu in #5095
• Allow to reset event metrics indexing at startup by @imsdu in #5101
• Add file extension to event metrics by @imsdu in #5105
• Allow event metrics to have several actions to accomodate tagging during creation/update by @imsdu in #5106
• Delete also the former index when restarting event metrics by @imsdu in #5111
• Add an endpoint to return the history of a resource by @imsdu in #5116

Ship

• Patch content type during import by @imsdu in #5090
• Add extra padding to export file names by @imsdu in #5093
• During import, also patch the file content type in S3 by @imsdu in #5103
• Fix log when updating content type in S3 in ship by @imsdu in #5104
• Skip default composite views during import by @imsdu in #5109

Documentation

• Add missing entries in release notes by @imsdu in #5086
• Remove mentions to remote storages in docs by @imsdu in #5097

Maintenance

• Update sbt plugins version by @imsdu in #5082
• Remove kamon operation from file route by @imsdu in #5085
• Update to Postgres 16.4 by @imsdu in #5089
• Update dependencies for 1.10.0-M18 by @imsdu in #5094
• Rename old link operation as legacy by @imsdu in #5096
• Refactor linking and delegation docs by @imsdu in #5098
• Use a newer version of a JRE for Blazegraph by @imsdu in #5110

Search

• Add analysisSuitable annotation for search index by @crisely09 in #5099
• fix SynaptomeSimulation type by @bilalesi in #5100
• Add synaptome properties, examples and tests by @crisely09 in #5119

Full Changelog: v1.10.0-M17...v1.10.0-M18

v1.10.0-M17

What's Changed

Features

• Allow to add exceptions to schema enforcement by @imsdu in #5075
• Refactor linking operation to its new endpoint by @imsdu in #5078
• Allow to return annotated payload for schemas by @imsdu in #5079
• Rely on filename for incremental import by @imsdu in #5072

Bug fixes

• Return a 400 when the file content length header is missing by @imsdu in #5081

Ship

• Improve logs for import batch when incorrect rev happens by @imsdu in #5070

Maintenance

• Update dependencies for 1.10.0-M17 by @imsdu in #5071
• Update localstack to 3.6 by @imsdu in #5080

Search

• Added simulationReady property to be indexed by @crisely09 in #5073
• Add SingleNeuronSynaptome related types to whitelist of types for search by @imsdu in #5074

Full Changelog: v1.10.0-M16...v1.10.0-M17

v1.10.0-M16

What's Changed

Features

• Partition export file to have a maximum number of events by @imsdu in #5066

Bug fixes

• Make it easier to configure and to disable JWS for delegation by @imsdu in #5065
• Storage prefix as path by @olivergrabinski in #5068

Nexus ship

• Patch properly distribution including rev or tag by @imsdu in #5064
• Patch properly distribution including rev or tag by @imsdu in #5064
• Retry when S3 fails to copy the file during import by @imsdu in #5069

Full Changelog: v1.10.0-M15...v1.10.0-M16

v1.10.0-M15

What's Changed

Documentation

• Add missing fields in storage doc by @imsdu in #5051

Bug fixes

• Provision the project against the identities endpoint by @imsdu in #5063

Nexus ship

• Patch view resource types by @shinyhappydan in #5055

Maintenance

• Update dependencies for 1.10.0-M15 by @imsdu in #5054
• Update to SBT 1.10.1 by @imsdu in #5058

Full Changelog: v1.10.0-M14...v1.10.0-M15

v1.10.0-M14

What's Changed

Features

• Prohibit from using Nexus vocab types in generic resources by @imsdu in #5046
• Use a static config for the http client for blazegraph queries by @imsdu in #5037
• Add the ability to extend the suite by providing additional project as a parameter by @imsdu in #5045

Documentation

• Delegation journey documentation by @dantb in #5025

Bug fixes

• Fix delegation metadata and mediaType by @dantb in #5024
• Add purge routine for tombstones by @imsdu in #5031
• Make projects fields a list in suite json-ld context by @imsdu in #5047

Ship

• Patch project configuration and selfs in distribution by @imsdu in #5007
• Remove Nexus metadata from payloads during the import by @shinyhappydan in #5038
• Patch resource types in resolver events in the import batch by @shinyhappydan in #5040

Maintenance

• Update dependencies for 1.10.0-M14 by @imsdu in #5032
• Update Elasticsearch and Localstack versions for integration tests by @imsdu in #5036
• Update to Postgres 16.3 by @imsdu in #5044

Full Changelog: v1.10.0-M13...v1.10.0-M14

v1.10.0-M13

What's Changed

Features

• Delegate S3 file validation and creation endpoints by @dantb in #4998

Bug fixes

• Use the write db pool when fetching project context for write operations by @imsdu in #5018
• Default delegation config instead of falling back to 404 by @dantb in #5019
• Deduplicating shapes before Shacl validation by @imsdu in #5021

Ship

• Always rewrite file paths in import batch by @imsdu in #5009
• Show the same progress log as the final log by @imsdu in #5017

Maintenance

• Update dependencies for 1.10.0-M13 by @imsdu in #5014

Full Changelog: v1.10.0-M12...v1.10.0-M13

v1.10.0-M12

What's Changed

Features

• Do not update resource if the payload and the provided schema have not changed by @imsdu in #5000

S3 support

• Setting the content type on the S3 object during upload by @imsdu in #5001
• Fix S3 file download by @imsdu in #5008

Nexus ship

• Patch file path, content size and checksum in distributions during import batch by @shinyhappydan in #4999
• Patch event identifiers by @imsdu in #5002
• Patch viewIds in aggregate views by @imsdu in #5003
• Patch iris in original payloads by @imsdu in #5005
• Replace project references in ids when mapped by @imsdu in #5006

###Maintenance

• Update dependencies for 1.10.0-M12 by @imsdu in #4996
• Update SBT plugins by @imsdu in #4997
• Set read replica in aws config by @olivergrabinski in #5004

Full Changelog: v1.10.0-M11...v1.10.0-M12

v1.10.0-M11

What's Changed

S3 support

• Configure a global path prefix used when saving S3 files by @dantb in #4923
• Make S3 file prefix optional in type by @dantb in #4929
• Deal with S3 download failures by streaming files by @shinyhappydan in #4928
• Make S3 file location relative within bucket + path independent of the prefix by @dantb in #4936
• Make sha256 default for s3 storages by @olivergrabinski in #4950
• Handle S3 access error gracefully with 403 by @dantb in #4954
• Get file size from S3 after upload + fix upload by @imsdu in #4952

Nexus ship

• Patch target projects for views within an aggregated ES view by @dantb in #4930
• Remove empty ids from source when importing resources by @imsdu in #4931
• Add S3 multipart copy and use it in Nexus ship by @olivergrabinski in #4933
• Add progress logging, allow to skip file events by @imsdu in #4932
• Update multi part copy operation with checksum by @olivergrabinski in #4938
• In Nexus Ship, ignore files bigger than 5gb (temporary) by @olivergrabinski in #4939
• Use readFileMultipart in ship event streamer by @olivergrabinski in #4947
• Push files to a different location in import batch + add files suffix by @imsdu in #4951
• Pass down custom metadata for file creation and update events by @imsdu in #4953
• Temporarily ignore file with empty filenames in Nexus Ship by @olivergrabinski in #4959
• Ignore views registered as resource events in nexus ship by @olivergrabinski in #4965
• Ignore resource types by config in nexus-ship by @olivergrabinski in #4973
• Patch files with empty names + add tests in ship for files by @imsdu in #4964
• Handle FileAttributesUpdated in import batch by @imsdu in #4980
• Handle gracefully when a file can not be found in a bucket by @imsdu in #4982
• Fix bug while importing files with special characters in name by @imsdu in #4983
• Log dropped events in database by @imsdu in #4984
• Filter out directories from import batch by @imsdu in #4985
• Setting content type when copying over the file in import batch by @imsdu in #4987
• Support for s3 multipart checksums by @olivergrabinski in #4991
• Enable copying of large files (>5GB) in Nexus ship by @olivergrabinski in #4992

Maintenance

• Run actions on ubuntu-latest by @olivergrabinski in #4937
• Update Nexus dependencies by @imsdu in #4934
• Update Elasticsearch and Localstack versions by @imsdu in #4935
• Update to Scala 2.13.14 by @imsdu in #4946
• Update to SBT 1.10.0 by @imsdu in #4958
• Update to postgres 15.7 by @imsdu in #4960
• Add slow query logger based on Doobie by @imsdu in #4993

Bug fixes

• Replay the tagged state from the main node to avoid replication delays by @imsdu in #4949
• Fallback to default value when the provided filename is empty by @imsdu in #4957
• Add test to ensure filenames are encoded correctly in S3 by @shinyhappydan in #4955
• Add index on types for the tombstone table by @imsdu in #4988

Search

• Add MEModel example for tests by @crisely09 in #4990

Full Changelog: v1.10.0-M10...v1.10.0-M11

v1.10.0-M10

What's Changed

Schema validation

• Add dedicated error when there is no targeted node during schema validation by @imsdu in #4920
• Add test to validate a brain region against an ontology by @imsdu in #4918

S3

• S3 content type user supplied by @shinyhappydan in #4895
• Add endpoint to point delta S3 file to different physical file by @dantb in #4902
• Allow to use default AWS credential provider via config by @olivergrabinski in #4906
• Add configured default bucket on S3 storages by @dantb in #4917

Nexus Ship

• Patch target projects for views within an aggregated blazegraph view by @dantb in #4907
• Read events file from S3 using multipart request by @dantb in #4911
• Rewire the nexus ship resources by @olivergrabinski in #4898
• Build snapshot on ship changes by @olivergrabinski in #4899
• Fix config loading in nexus ship by @olivergrabinski in #4900
• Use correct ship config for transactors and inputbucket by @olivergrabinski in #4901
• Use update registered file in nexus ship; log import report by @olivergrabinski in #4903
• Allow disabling of resource validation in nexus ship by @olivergrabinski in #4908
• Use readFileMultipart in S3 fetch operation by @olivergrabinski in #4916

Fixes

• Limit query in export event function by @olivergrabinski in #4922

Maintenance

• Update dependencies for M10 by @imsdu in #4897

Full Changelog: v1.10.0-M9...v1.10.0-M10

v1.10.0-M9

What's Changed

Bug fixes

• Respect configured database name instead of defaulting to username by @dantb in #4894

S3 Support

• Replace alpakka S3 with fs2-aws and minio with localstack by @dantb in #4852
• Remove endpoint and region from the S3 Storage instances by @shinyhappydan in #4859
• Reduce library S3 client usage by @dantb in #4865
• Refactor file operations behind new interfaces by @dantb in #4871
• Use S3 to generate checksum by @shinyhappydan in #4873
• Register S3 files in-place by @dantb in #4878
• Remove s3 md5 by @shinyhappydan in #4882

Nexus Ship

• Add logback.xml file for nexus ship by @olivergrabinski in #4858
• Add ability to read import file/directory from S3 in nexus ship by @olivergrabinski in #4863
• Include nexus-ship in CI by @olivergrabinski in #4864
• When running nexus ship with s3 flag, read config from s3 by @olivergrabinski in #4866
• View initialization is nexus ship by @olivergrabinski in #4868
• Refactor ship before introducing save summary feature by @imsdu in #4869
• Create S3 storage on project creation during nexus ship import by @olivergrabinski in #4870
• Save summary at the end of the batch by @imsdu in #4872
• Patch cross-project resolvers when a project is renamed by @imsdu in #4874
• Patch distributions in import batch by @imsdu in #4880
• Process files in nexus ship by @olivergrabinski in #4884

Maintenance

• Update dependencies for next milestone M9 by @imsdu in #4861
• Improve message for 'ResourceShaclEngineRejection' by @imsdu in #4862
• Remove StoragesStatistics from Files by @olivergrabinski in #4879

Full Changelog: v1.10.0-M8...v1.10.0-M9