Code

Feat/data augmentation#13

Code

Open

jamnicki wants to merge 44 commits intomasterpwr-ai/JuDDGES:masterfrom feat/data-augmentationpwr-ai/JuDDGES:feat/data-augmentationCopy head branch name to clipboard

+414,393-62

Commits

Commits on Feb 28, 2024

• feat/CI (#1)

  Show description for 25fc8aa
  asawczyn

  authored
  25fc8aa

Commits on Mar 8, 2024

• Add scripts for downloading data from polish court API (#2)

  Show description for 0c912e8
  

  binkjakub

  and

  Jakub Binkowski

  authored
  0c912e8

Commits on Mar 11, 2024

• feat: add dvc (#3)

  asawczyn

  authored
  e106f62

Commits on Apr 3, 2024

• Parse pl judgements (#4)

  Show description for 249385e
  

  binkjakub

  and

  Jakub Binkowski

  authored
  249385e

Commits on Apr 4, 2024

• feat: synthetic data gen nb

  jamnicki

  committed
  d1e5e81

Commits on Apr 5, 2024

• feat: gen test qa pairs sample

  jamnicki

  committed
  201440a

Commits on Apr 9, 2024

• Instruction dataset v1 (#5)

  Show description for effd6ce
  

  3 peopleauthored
  effd6ce

• Add schema chain (#6)

  Show description for a11236f
  

  3 peopleauthored
  a11236f

Commits on Apr 10, 2024

• workshop flow and presentation (#8)

  Show description for 5ac08a8
  laugustyniak

  authored
  5ac08a8

Commits on Apr 27, 2024

• feat: qa pairs generation script

  jamnicki

  committed
  fb67d5a

• fix: mypy errors

  jamnicki

  committed
  ec89909

• Merge branch 'master' into feat/data-augmentation

  jamnicki

  authored
  c3575b1

• fix: nbdev errors

  jamnicki

  committed
  6456609

• chore: tidy up code

  jamnicki

  committed
  24f3d64

• feat: create synthetic QA LangSmith dataset

  jamnicki

  committed
  c3fb474

• chore: Add langdetect library to requirements.txt

  jamnicki

  committed
  6a5f2f5

Commits on May 8, 2024

• fix: data paths after rebase

  jamnicki

  committed
  e2025a7

• fix: hardcoded paths, missing dependencies

  jamnicki

  committed
  d24a229

• chore: enable autostage in dvc

  jamnicki

  committed
  4bf7291

Commits on May 10, 2024

• feat: add prompt option in gen synthetic script

  jamnicki

  committed
  9ac171e

Commits on May 11, 2024

• refactor: synth gen data related models and scripts

  jamnicki

  committed
  71ceb95

Commits on May 12, 2024

• feat: add local postgres url getter

  jamnicki

  committed
  50ebc8b

• feat: use metadata to generation from context; refactor

  jamnicki

  committed
  9116ed1

• fix: add missing packaging package

  jamnicki

  committed
  d927c9b

• feat: use metadata to generation from context; refactor

  jamnicki

  committed
  7251c56

• Update requirements.txt

  jamnicki

  authored
  13cf8a1

Commits on May 14, 2024

• feat: add translation of qa pairs generated in wrong language

  jamnicki

  committed
  bd1068d

• Merge branch 'feat/data-augmentation' of https://github.com/pwr-ai/JuDDGES into feat/data-augmentation

  jamnicki

  committed
  f6f910c

• chore: add setup.py as linter target

  jamnicki

  committed
  d8cce29

• feat: add packaging, setuptools and wheel as setup_requires

  jamnicki

  committed
  e639a8c

• fix: python-check ci No module packaging error

  jamnicki

  committed
  22a3403

• fix: temporarily remove flash-attn package from requirements; occurs gh workflow error

  jamnicki

  committed
  f941702

• fix: deepspeed

  jamnicki

  committed
  bf10de2

• feat: model cfg handling to gen synth qa script

  jamnicki

  committed
  92a5b4d

Commits on May 15, 2024

• Dashboard updates (#11)

  Show description for 5b66459
  laugustyniak

  authored
  5b66459

• feat: set synth qa pairs translation as optional

  jamnicki

  committed
  612942c

• test: add unittests for SyntheticQAPairs model

  jamnicki

  committed
  18f8a5a

• Merge branch 'master' into feat/data-augmentation

  jamnicki

  authored
  084a8c0

Commits on May 31, 2024

• feat: gen qa with openai api, add notebooks with synthetic data or context insights, create index with number of text tokens for judgements-pl

  jamnicki

  committed
  7b9d796

• Merge branch 'feat/data-augmentation' of https://github.com/pwr-ai/JuDDGES into feat/data-augmentation

  jamnicki

  committed
  9199842

• style: fix formatting

  jamnicki

  committed
  d4f28f2

Commits on Jun 1, 2024

• feat: add sentiment comparison to synth qa dataset analysis

  jamnicki

  committed
  c01b57d

Commits on Jun 2, 2024

• feat: add util caching, synth qa formality analysis

  jamnicki

  committed
  da4395e

Commits on Jun 3, 2024

• feat: push synth qa dataset to hub, add tokenizer util caching

  jamnicki

  committed
  b62b5c8