Code

Dereferencer#11

Code

Merged

cedricdcc merged 90 commits intolifewatch:mainlifewatch/user-analysis-2023:mainfrom cedricdcc:dereferencerCopy head branch name to clipboardJan 17, 2024

+4,635-377

Commits

Commits on Sep 8, 2023

• Merge pull request #5 from lifewatch/fix/docker-names

  Show description for 3ce6908
  laurianvm

  authored
  3ce6908

• Merge pull request #7 from lifewatch/fix/jupyter-token

  Show description for 08ab97c
  laurianvm

  authored
  08ab97c

Commits on Sep 9, 2023

• Merge branch 'main' of github.com:lifewatch/user-analysis-2023 into task/basic-ttl-ingest

  marc-portier

  committed
  af750b2

• realized we need the data for the ingest

  Show description for 3afba5d
  marc-portier

  committed
  3afba5d

Commits on Sep 10, 2023

• docker image builds python using poetry

  Show description for 342d63e
  marc-portier

  committed
  342d63e

• apply image names

  Show description for 3a3c169
  marc-portier

  committed
  3a3c169

• getting the graphdb to work together with the sparqlwrapper

  Show description for 8d6bc1a
  marc-portier

  committed
  8d6bc1a

• minor cleanup

  marc-portier

  committed
  d39c314

Commits on Sep 11, 2023

• Merge branch 'fix/docker-names' of github.com:lifewatch/user-analysis-2023 into task/basic-ttl-ingest

  marc-portier

  committed
  1215308

• create a local graphd-db image that initializes the database

  marc-portier

  committed
  c2d53c5

• introduce the notebooks so they become available in the jupyter

  marc-portier

  committed
  97586d3

• use the new feaures of the jupyter and graphdb images

  marc-portier

  committed
  e0eefa2

• cleanup not needed test script

  marc-portier

  committed
  30bd04f

• ingest of file succeeded

  Show description for a9b85af
  marc-portier

  committed
  a9b85af

Commits on Oct 26, 2023

• prefer https for schema.org

  marc-portier

  committed
  417766c

• rename docker/info script, introducing jq and some enhancements

  marc-portier

  committed
  c71976b

• fix error in copy statement (2nd arg required)

  marc-portier

  committed
  d9f8ce1

• introduce external shared logging volume

  marc-portier

  committed
  edeb104

• updated deps

  marc-portier

  committed
  b897e68

• updated deps

  marc-portier

  committed
  2f90b6b

• ensure the log folder exists

  marc-portier

  committed
  0983c1d

• fix path to data - as it is distinct to the location inside the grpahdb container

  marc-portier

  committed
  846ec54

• use the new external logging/ folder

  marc-portier

  committed
  c31846c

• extended readme

  marc-portier

  committed
  892abd6

• room for more dependencies in ipynb context

  marc-portier

  committed
  907d87d

Commits on Nov 14, 2023

• as is current dump of progress towards autodetection

  marc-portier

  committed
  523df6e

• normalise dos2unix for /docker/**/*.sh files

  cedricdcc

  committed
  7eb3d96

• added watcher to injest

  cedricdcc

  committed
  8b93eb1

Commits on Nov 15, 2023

• deleted non essential code fr starting graphdb-database

  cedricdcc

  committed
  4378715

Commits on Nov 16, 2023

• watcher works, iri injest error on graph modifications though

  cedricdcc

  committed
  e41d322

• working injest , no auto

  cedricdcc

  committed
  e66d915

• auto injest complete

  cedricdcc

  committed
  6a83d3e

Commits on Nov 17, 2023

• small refactoring

  Show description for 4731fe7
  cedricdcc

  committed
  4731fe7

• added rdf2j and refactoring of the graph functions

  Show description for 866c1b8
  cedricdcc

  committed
  866c1b8

• Update graph_functions.py

  cedricdcc

  committed
  36d73e4

• deleted / commented out non used imports

  cedricdcc

  committed
  8fa637b

Commits on Nov 18, 2023

• performed autopep8 and black on all python files

  cedricdcc

  committed
  ee74345

Commits on Nov 21, 2023

• refactoring of watcher.py , editied templates and graphdb.py functions so that they are more clear on their purpose.

  cedricdcc

  committed
  fd4879d

• beginning of tests

  cedricdcc

  committed
  9f8cfdc

Commits on Nov 22, 2023

• changed const variables and reverted changes on update context lastmod

  cedricdcc

  committed
  c916ec5

Commits on Nov 27, 2023

• done refactoring + tests made + workflows for autopep8 and black made

  cedricdcc

  committed
  5f67142

• changed version for workflows

  cedricdcc

  committed
  f486db3

• renaming workflow file + change in python test file to check if action retriggers

  cedricdcc

  committed
  103b51c

• changed python workflow versions to work with arch x64

  cedricdcc

  committed
  3eed9b7

• attempt 4 at working linting

  cedricdcc

  committed
  a2c6cf8

• Automated code formatting

  github-actions[bot]

  committed
  c1af6c7

Commits on Nov 29, 2023

• last reforctoring mods

  cedricdcc

  committed
  d982426

• Automated code formatting

  github-actions[bot]

  committed
  c6246c8

• added beginning of dereferencer

  cedricdcc

  committed
  9375895

Commits on Nov 30, 2023

• added dereferencing config and memory

  cedricdcc

  committed
  3fa7ada

• Automated python code formatting

  github-actions[bot]

  committed
  ccc7e87

Commits on Dec 1, 2023

• small updates lwua-ingest and added deref entity runs for orcid and mr

  cedricdcc

  committed
  04803d5

• Automated python code formatting

  github-actions[bot]

  committed
  b4fcec9

• deleted metadata management for now in search for more favorable system

  cedricdcc

  committed
  29417c6

• Automated python code formatting

  github-actions[bot]

  committed
  f070d16

• working dereferencer

  cedricdcc

  committed
  1b5963d

• fixed linting workflow

  cedricdcc

  committed
  9188dcc

• Update derefEntity.py

  cedricdcc

  authored
  0f5714a

• wf-update

  cedricdcc

  committed
  dec05f6

• Automated python code formatting

  github-actions[bot]

  committed
  cc35c2b

Commits on Dec 5, 2023

• adds files directly to graph instead of via ingest

  cedricdcc

  committed
  5478e3a

• Automated python code formatting

  github-actions[bot]

  committed
  ebcffc0

• added cache life

  cedricdcc

  committed
  f5b682f

• Automated python code formatting

  github-actions[bot]

  committed
  7ed1987

• added batches to the insert for huge batches

  Show description for bfe2e18
  cedricdcc

  committed
  bfe2e18

• Automated python code formatting

  github-actions[bot]

  committed
  76d12df

Commits on Dec 6, 2023

• new bottom up property traversal

  cedricdcc

  committed
  766d0dd

• Automated python code formatting

  github-actions[bot]

  committed
  ca54add

Commits on Dec 7, 2023

• added testing

  cedricdcc

  committed
  40286bf

• Automated python code formatting

  github-actions[bot]

  committed
  4ac6e93

Commits on Dec 8, 2023

• added ability to deref fair signposting links

  cedricdcc

  committed
  d64b645

• Automated python code formatting

  github-actions[bot]

  committed
  89fdb19

• fixed json download issue and added dataset in the config folder

  cedricdcc

  committed
  c02ca4b

• Automated python code formatting

  github-actions[bot]

  committed
  f97e4cc

Commits on Dec 11, 2023

• Update test_derefEntity.py

  cedricdcc

  committed
  1521c54

• Automated python code formatting

  github-actions[bot]

  committed
  442bbc4

• added new tempate that will get the subject and one for the objects

  Show description for 72f8110
  cedricdcc

  committed
  72f8110

• Automated python code formatting

  github-actions[bot]

  committed
  4b43371

Commits on Dec 12, 2023

• revert to only object searches

  cedricdcc

  committed
  efc1ca2

• Add dereference functionality and write store to graph database

  cedricdcc

  committed
  0bc1001

• Automated python code formatting

  github-actions[bot]

  committed
  eb83248

• changed/added testing for re and script tag harvesting

  Show description for f1bdc46
  cedricdcc

  committed
  f1bdc46

• Automated python code formatting

  github-actions[bot]

  committed
  8941c10

• added more tests

  cedricdcc

  committed
  8c40cc2

• Automated python code formatting

  github-actions[bot]

  committed
  663838e

• Update test_derefEntity.py

  cedricdcc

  committed
  8defd84

• Merge branch 'dereferencer' of https://github.com/cedricdcc/user-analysis-2023 into dereferencer

  cedricdcc

  committed
  92f1f9b

• Automated python code formatting

  github-actions[bot]

  committed
  8003a97

Commits on Jan 10, 2024

• Update cache lifetime to 1 second, added context while parsing triples to store

  cedricdcc

  committed
  3080711

• Automated python code formatting

  github-actions[bot]

  committed
  077d79b