Code

API update (data & processing)#25

Code

Merged

percevalw merged 15 commits intomainaphp/edspdf:mainfrom api-updateaphp/edspdf:api-updateCopy head branch name to clipboardFeb 24, 2024

+3,691-1,347

Commits

Commits on Feb 17, 2024

• refacto: align data api with edsnlp

  percevalw

  committed
  11e8841

• feat: support transformer quantization and dtype change

  percevalw

  committed
  9155291

• fix: handle too large / long pdfs with hf embeddings

  percevalw

  committed
  27fa062

• fix: update pypdfium to v4

  percevalw

  committed
  3d4bf99

• chore: update changelog and bump version to v0.9.0

  percevalw

  committed
  99ee9b7

• fixes

  percevalw

  committed
  f19fa98

• fix: support empty tensors in cnn & transformer

  percevalw

  committed
  132fc3f

• feat: add batch units, sample sorting to simple/mp backends + fix error handling

  percevalw

  committed
  9ac60c2

• fix: upgrade foldedtensor to v0.3.3

  percevalw

  committed
  0d4c889

• feat: support mapping a label to multiple fields

  percevalw

  committed
  3f740b1

• ci: fix mp coverage

  percevalw

  committed
  7e5ba58

• fix: support half precision for layoutlmv3 w/ image

  percevalw

  committed
  8ea83f7

• fix: ensure mp spawn even without gpu (to avoid torch deadlock)

  percevalw

  committed
  0ab0a56

• fix: support empty tensors in cnn & transformer

  percevalw

  committed
  3175775

• test: improve coverage

  percevalw

  committed
  85b02eb