Code

Kf/eschatology processing#88

Code

Draft

KasperFyhn wants to merge 29 commits intomaincentre-for-humanities-computing/conspiracies:mainfrom kf/eschatology-processingcentre-for-humanities-computing/conspiracies:kf/eschatology-processingCopy head branch name to clipboard

+2,127-596

Commits

Commits on Nov 21, 2024

• Caching embeddings during clustering + fewer clusters by default

  KasperFyhn

  committed
  3561092

• visualizer: prettier and switching double-click and hold ops

  KasperFyhn

  committed
  4763c00

• More caching during clustering

  KasperFyhn

  committed
  0f862e7

• Removing the long tail of entities upfront and reducing cluster sizes

  KasperFyhn

  committed
  6dd1d95

Commits on Nov 25, 2024

• Without embedding-based clustering, only label overlap

  KasperFyhn

  committed
  f0578d8

Commits on Nov 26, 2024

• Better frequency slider for nodes and edges on visualizer

  KasperFyhn

  committed
  0a916da

• Also filtering edges on dates in visualizer

  KasperFyhn

  committed
  7a85b49

• Trying multiprocess offloading to GPU

  KasperFyhn

  committed
  7914226

• First steps towards storing binary files of SpaCy docs

  KasperFyhn

  committed
  9588527

• Trying fastcoref's LingMessCoref instead of AllenNLP which is sluggishly slow

  KasperFyhn

  committed
  1a0f4e7

• Adding fastcoref to dependencies

  KasperFyhn

  committed
  43c4786

• Adding a error recovering wrapper of the fastcoref component

  KasperFyhn

  committed
  3d9e4b4

• Configurable DocBin size and specified cuda for fastcoref component

  KasperFyhn

  committed
  0f2a0d6

• Fixing stream collected to list from debugging

  KasperFyhn

  committed
  65b1d9a

Commits on Nov 27, 2024

• Output path for pipeline instead of project name

  KasperFyhn

  committed
  babfc4b

• Resolving text in safe fastcoref component

  KasperFyhn

  committed
  47b4f47

• More proper continuation of already processed docs

  KasperFyhn

  committed
  28782f7

• fixing bug in SafeFastCoref which led to empty texts

  KasperFyhn

  committed
  244e18f

• Union notation instead of | for compatibility with Python 3.9

  KasperFyhn

  committed
  1f12382

Commits on Dec 4, 2024

• Fixing reading/writing DocBins, fixing safe fastcoref pipe and introducing subclustering

  KasperFyhn

  committed
  c3804e3

• Deduplicating docs in doc bins

  KasperFyhn

  committed
  004a8ed

• Big hackathon for the visualizer commenced

  KasperFyhn

  committed
  c655792

Commits on Dec 5, 2024

• Hacking away for visualizer: now showing docs in a very ugly way

  KasperFyhn

  committed
  7bb4b7c

Commits on Dec 6, 2024

• Only targeting visualizer files with prettier

  KasperFyhn

  committed
  0ea45b5

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 4a86104
  pre-commit-ci[bot]

  committed
  4a86104

• Showing documents with triplets marked up

  KasperFyhn

  committed
  a07c2cc

Commits on Dec 9, 2024

• Introducing database for entities, relations, triplets and documents

  KasperFyhn

  committed
  5854373

• Fixing failing test after last commit

  KasperFyhn

  committed
  5c44abf

• Changing DB models slightly and optimizing DB population

  KasperFyhn

  committed
  3156970