Acryl DataHub v0.8.27.1

Release Highlights

Ingestion Package

• features
  • support for lineage-file source
  • cli now supports timeline command
  • elasticsearch support for url_prefix
• fixes
  • tableau, kafka-connect

ChangeLog

• datahub-project#4216 @dexter-mh-lee feat(model): add searchable annotation for features in feature table
• datahub-project#4249 @zhoxie-cisco fix(mae-consumer): usage event transformer was using wrong aspect name.
• datahub-project#4252 @rslanka feat(platform): add timeline api for dataset entity
• datahub-project#3956 @Huyueeer feat(search): supporting chinese glossaryterm full text retrieval(datahub-project#3914)
• datahub-project#4214 @pppsunil feat(ingest): elasticsearch - add support for url_prefix in configuration
• datahub-project#4116 @eddyv feat(ingest): lineage-file - add ability to provide lineage manually through a file
• datahub-project#4243 @bskim45 fix(docs): fix reference to the credential step in okta guide
• datahub-project#4242 @anshbansal fix(docs): fix broken link
• datahub-project#4231 @maaaikoool fix(ingest): tableau - fix sheets external url ingestion
• datahub-project#4221 @zhaofengnian18 feat(docker): add multiplatform docker support for arm64 (m1)
• datahub-project#4248 @rslanka feat(model): Column level lineage model
• datahub-project#4244 @arunvasudevan fix(ingest): kafka-connect - pass the env variable as part of making dataset
• datahub-project#4247 @maggiehays docs: Add Udemy & Adevinta logos
• datahub-project#4238 @kevinhu feat(ingest): switch telemetry endpoint to Mixpanel
• datahub-project#4246 @jjoyce0510 fix(ui) Misc styling fixes (truncated filter values, updating tag color on clickaway)
• datahub-project#4132 @Ankit-Keshari-Vituity Added Drawer to show the tag profile data
• datahub-project#4239 @jjoyce0510 Remove multiple generate personal access tokens
• datahub-project#4227 @sgomezvillamor doc(adoption): adds Adevinta as DataHub adopter

Acryl DataHub 0.8.27.1rc1 (Release Candidate)

v0.8.27.1rc1

Merge branch 'linkedin:master' into master

Acryl DataHub v0.8.27

https://github.com/linkedin/datahub/releases/tag/v0.8.27

What's Changed

• datahub-project#4205 @hsheth2 fix(ingestion): enable compat with avro 1.11
• datahub-project#4210 @anshbansal fix(docs): add mention of list-runs command in CLI page

Acryl DataHub 0.8.26.8

Release Highlights

Ingestion Package

• improvements
  • kafka: support for non-default schema naming strategies
  • lib: new functions to make it easier to work with urns
• bug-fixes
  • dbt: fixes #4124 with duplicate key exception in certain scenarios
  • sql-sources: reverts change to lowercase all dataset names

Changelog

• datahub-project#4220 @jjoyce0510 Fixing word wrap for logo count cards
• datahub-project#4219 @jjoyce0510 Adding group ownership
• datahub-project#4172 @tc350981 feat(ingest): lib - add better support for working with urns
• datahub-project#4158 @MugdhaHardikar-GSLab feat(ci): add spark smoke test
• datahub-project#4199 @mmmeeedddsss feat(react): add pagination to group ownerships
• datahub-project#4218 @rslanka Revert "fix(ingest): Use lower-case dataset names in the dataset urns for all SQL-styled datasets. (datahub-project#4140)"
• datahub-project#4215 @rslanka feat(ingest): kafka - add support for non-default schema registry subject name strategies
• datahub-project#4217 @gabe-lyons fix(ingest): dbt - dont produce key aspects if the entity has no other aspects
• datahub-project#4202 @jieqiu0630 Fix config typo in stateful ingestion README

Acryl DataHub 0.8.26.8rc1 (Release Candidate)

v0.8.26.8rc1

Merge branch 'linkedin:master' into master

Acryl DataHub 0.8.26.7

Release Highlights

• new sources
  • clickhouse
• fixes
  • snowflake: external lineage
  • elasticsearch: support for http/https
  • bigquery: temp tables detection for lineage, usage in profiling

What's Changed

• datahub-project#4203 @swaroopjagadish fix(ingest): superset - adding missing greenlet dep
• datahub-project#4153 @stephenp-gr ci: update rename-namespace.sh to work on non-bash shells
• datahub-project#4057 @ne1r0n feat(ingest): clickhouse - add initial support
• datahub-project#4147 @guidoturtu feat(ingest): airflow - capture airflow task description
• datahub-project#4179 @kevinhu fix(ingest): sql-sources: add mapping for postgres types
• datahub-project#4185 @treff7es feat(ingest): sql-sources - prevent hard failure on table/view ingestion exceptions
• datahub-project#4160 @treff7es feat(ingest): bigquery - ignore temporary tables from lineage and connect edges directly
• datahub-project#4200 @xiphl docs: search - Tips on advanced searching in the search bar
• datahub-project#4068 @kevinhu feat(ingest): profiling - record bucketed profiling runtimes
• datahub-project#4161 @treff7es fix(ingest): bigquery - profiling works with limit and offset using temp tables
• datahub-project#4174 @jeffmerrick docs(website): Move company logos into tabs categorized by industry
• datahub-project#4197 @jjoyce0510 fix(delete): fixing NPE on delete urns path
• datahub-project#4142 @hsheth2 test(airflow): fix airflow version parsing
• datahub-project#4182 @pppsunil fix(ingest): elasticsearch - pinning down elasticsearch dependency to less than 8.0.0
• datahub-project#4191 @abiwill fix(ingest): elasticsearch - http/https host config support
• datahub-project#4192 @rslanka fix(ingest): snowflake - handle external S3 bucket lineage for "External Tables".
• datahub-project#4195 @jjoyce0510 Show profile image on list users
• datahub-project#4113 @MugdhaHardikar-GSLab refactor(spark-lineage): enhance logging and documentation
• datahub-project#4193 @jjoyce0510 WARN on 400 from elasticsearch
• datahub-project#4190 @jjoyce0510 minor fixes(ui): Small UI display fixes
• datahub-project#4189 @swaroopjagadish docs(model): auto-generated docs and hand-written docs for the metadata model
• datahub-project#4176 @dexter-mh-lee feat(analytics): Improve analytics page by adding more charts regarding metadata ingested
• datahub-project#4188 @treff7es fix(ci): pinning markup_safe
• datahub-project#4166 @jjoyce0510 feat(groups): Adding editable group properties in the backend
• datahub-project#4181 @ShubhamThakre minor ui fixes
• datahub-project#4175 @jjoyce0510 fixes(ui): Misc UI fixes + Adding Owners to Search Filters
• datahub-project#4171 @RyanHolstien bug(glossaryTermLabels): fix glossary term labels missing and add cypress test
• datahub-project#4173 @RyanHolstien bugfix(logging): reduce log noise from authentication chain
• datahub-project#4143 @hsheth2 chore(docs): various cleanup for docs-website
• datahub-project#4134 @ShubhamThakre Feature/users and groups UI updated as per new design

Acryl DataHub 0.8.26.7rc2 (Release Candidate)

v0.8.26.7rc2

Merge branch 'linkedin:master' into master

Acryl DataHub v0.8.26.7 - Release Candidate 1

Full Changelog: v0.8.26.6...v0.8.26.7rc1

Acryl DataHub v0.8.26.6

• datahub-project#4167 @treff7es Fix for wrong containers on Athena
• datahub-project#4168 @treff7es Removing sql_common dep from glue
• datahub-project#4083 @hsheth2 ci(ingestion): fix airflow 1 deps for tox
• datahub-project#4141 @hsheth2 chore(ingestion): upgrade mypy
• datahub-project#4140 @rslanka fix(ingest): Use lower-case dataset names in the dataset urns for all SQL-styled datasets.
• datahub-project#4164 @cuong-pham Update the doc to including options to include Views

Acryl DataHub v0.8.26.5

• datahub-project#4163 @rslanka feat(ingestion): Add support for snowflake view lineage.
• datahub-project#4152 @stephenp-gr Common ElasticsearchContainer creation
• datahub-project#4157 @buggythepirate Update querying-entities.md
• datahub-project#4156 @jjoyce0510 feat(ui): Edit glossary term descriptions via UI
• datahub-project#4155 @Ankit-Keshari-Vituity UI Fix: Modal close on Enter press, autofocus on modal, added split panel, alignment of button
• datahub-project#4162 @RyanHolstien bug(seedData): adds a key to the root user seed data and fixes corner case check for missing key aspects
• datahub-project#4118 @ngamanda feat(ui): Host platform images on datahub-web-react