feat: add score document support in csv (#696)

* feat: add score document support in csv * refactor: add csv handlers * refactor: remove build finetuning dataset * test: add unit tests * test: fix csv reader add stringio as hints * feat: rename modality variable to col1 col2 * test: add unit test * feat: use a trial input size for mlp * feat: use a trial input size for mlp * refactor: fix task when model is mlp * chore: add changelog * feat: improve variable names and docstring * feat: rename handler to parser * feat: add docstring to csv context * test: debug experiment endpoint * test: debug experiment endpoint * chore: update changelog Co-authored-by: George Mastrapas <[email protected]> --------- Co-authored-by: George Mastrapas <[email protected]>
jina-ai · Mar 21, 2023 · a24d95e · a24d95e
1 parent 9ef750b
commit a24d95e
Show file tree

Hide file tree

Showing 7 changed files with 323 additions and 185 deletions.
diff --git a/CHANGELOG.md b/CHANGELOG.md
@@ -10,10 +10,14 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ### Added
 
+- Support pair-wise score document construction from CSV. ([#696](https://github.com/jina-ai/finetuner/pull/696))
+
 ### Removed
 
 ### Changed
 
+- Refactor `load_finetuning_dataset` into CSV handlers. ([#696](https://github.com/jina-ai/finetuner/pull/696))
+
 ### Fixed
 
 ### Docs

diff --git a/finetuner/client/client.py b/finetuner/client/client.py
@@ -70,7 +70,7 @@ def list_experiments(self, page: int = 1, size: int = 50) -> Dict[str, Any]:
  ..note:: The maximum number for `size` per page is 100.
  """
  params = {'page': page, 'size': size}
- url = self._construct_url(self._base_url, API_VERSION, EXPERIMENTS)
+ url = self._construct_url(self._base_url, API_VERSION, EXPERIMENTS) + '/'
  return self._handle_request(url=url, method=GET, params=params)
 
  def delete_experiment(self, name: str) -> Dict[str, Any]:

diff --git a/finetuner/constants.py b/finetuner/constants.py
@@ -41,6 +41,7 @@
 ARTIFACT = 'artifact'
 ARTIFACT_ID = 'artifact_id'
 DEFAULT_TAG_KEY = 'finetuner_label'
+DEFAULT_TAG_SCORE_KEY = 'finetuner_score'
 # Run status
 CREATED = 'CREATED'
 STARTED = 'STARTED'