Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[API] The filepath configuration schema needs to be updated from (raw_data, parse, chunk, qa) to (files, knowledges, qa_docs). #996

Closed
4 of 5 tasks
hongsw opened this issue Nov 25, 2024 · 1 comment
Labels
API From AutoRAG API server

Comments

@hongsw
Copy link
Collaborator

hongsw commented Nov 25, 2024

  • Celery integration completed.
  • SQLiteProjectDB migration completed.
  • trial_task.py is to be determined (TBD); assistance needed from @vkehfdl1.
  • Frontend migration completed, including changes to the waitForTask function.
  • The filepath configuration schema needs to be updated from (raw_data, parse, chunk, qa) to (files, knowledges, qa_docs).
image Figure 1: Files are initially managed in the files folder. In the knowledges folder, selected files are processed, parsed, and chunked for further use. QA documents are generated and stored in the qa_docs folder. Lastly, in the trials folder, specific knowledge and QA documents are selected to perform evaluations and generate reports.

Originally posted by @hongsw in #987 (comment)

@hongsw hongsw changed the title The filepath configuration schema needs to be updated from (raw_data, parse, chunk, qa) to (files, knowledges, qa_docs). [API] The filepath configuration schema needs to be updated from (raw_data, parse, chunk, qa) to (files, knowledges, qa_docs). Nov 25, 2024
@hongsw hongsw added the API From AutoRAG API server label Nov 25, 2024
@vkehfdl1
Copy link
Contributor

close at #1011

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
API From AutoRAG API server
Projects
None yet
Development

No branches or pull requests

2 participants