Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RAG] Agentic RAG workflow on tabular data from a PDF file #376

Merged
merged 63 commits into from
Jan 8, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
5fa3045
PDF RAG: Use unstructed io to parse a file
AgentGenie Jan 3, 2025
d96e52d
Create tabular_data_rag_workflow with groupchat
AgentGenie Jan 8, 2025
e32c81f
Update website notebook for agentchat_tabular_data_rag_workflow.ipynb
AgentGenie Jan 8, 2025
6c1ce54
update
skzhang1 Jan 4, 2025
92d25a4
add method property to reasoningagen
Hk669 Jan 5, 2025
9c1b0bb
Swarm: Restore lost auto return
marklysze Jan 5, 2025
4b17d18
Fix docs build and update navigation
harishmohanraj Jan 6, 2025
442840c
Fix broken links
harishmohanraj Jan 6, 2025
daf4370
Fix broken links
harishmohanraj Jan 6, 2025
318b117
Fix wrong import
davorrunje Jan 6, 2025
9db7bc3
Fix imports
davorrunje Jan 6, 2025
3ac3fb0
wip
davorrunje Jan 6, 2025
bbd8c90
wip
davorrunje Jan 6, 2025
3c03443
wip
davorrunje Jan 6, 2025
0905ed0
wip
davorrunje Jan 6, 2025
82daa17
wip
davorrunje Jan 6, 2025
9d35eef
Add correct URL in muffet exclusion list
harishmohanraj Jan 7, 2025
c3e04f5
WIP: autogen iostream refactor
kumaranvpl Jan 3, 2025
4ab6789
Fix pre-commit issues
kumaranvpl Jan 6, 2025
cfbbf3e
wip
davorrunje Jan 6, 2025
448bab3
Move PrintMessage to separate file and add missing tests
kumaranvpl Jan 6, 2025
38fcb39
Rename print_* method to print
kumaranvpl Jan 6, 2025
e64c04f
Rename print_* method to print in ExecuteFunction
kumaranvpl Jan 6, 2025
3f1f0d3
Rename print_* method to print in TerminationAndHumanReply
kumaranvpl Jan 6, 2025
7bcd76c
Rename print_* method to print in GenerateCodeExecutionReply
kumaranvpl Jan 6, 2025
c62db84
Rename print_* method to print in SelectSpeaker
kumaranvpl Jan 6, 2025
c601840
Move verbose if statements out of print method
kumaranvpl Jan 6, 2025
644a404
Fix misc rafactor issues
kumaranvpl Jan 6, 2025
57bc4a3
Rename variable for consistency
kumaranvpl Jan 6, 2025
f900998
Replace model.print with iostream.send
kumaranvpl Jan 6, 2025
159b215
Add test for IOConsole.send
kumaranvpl Jan 6, 2025
188540d
Refactor to remove single use variable
kumaranvpl Jan 6, 2025
e496291
Rename to UsingAutoReply
kumaranvpl Jan 6, 2025
3b4f1b6
Refactor ExecuteFunction and ExecutedFunction
kumaranvpl Jan 6, 2025
d138b47
Add call_id to ExecuteFunction and ExecutedFunction
kumaranvpl Jan 6, 2025
40c1455
Add missed tool_call_id
kumaranvpl Jan 6, 2025
43697b1
Message wrapping added
davorrunje Jan 7, 2025
75afaa3
Refactoring
davorrunje Jan 7, 2025
3188685
Rename classes to have Message suffix
kumaranvpl Jan 7, 2025
e93eccd
Fix TestToolResponseMessage
kumaranvpl Jan 7, 2025
fe483fb
Fix TestToolCallMessage
kumaranvpl Jan 7, 2025
21cdc61
Rename classes to have Message suffix
kumaranvpl Jan 7, 2025
a6dae98
Fix tests
kumaranvpl Jan 7, 2025
ed80fc5
Fix tests in test_agent_messages.py
kumaranvpl Jan 7, 2025
1653a72
Add wrap_message decorator to client_messages and fix tests
kumaranvpl Jan 7, 2025
1ab3d1a
Fix TestFunctionResponseMessage
kumaranvpl Jan 7, 2025
13f7bc3
Update tests for print_message
kumaranvpl Jan 7, 2025
1565175
Fix test_base_message
kumaranvpl Jan 7, 2025
b0b40ce
Fix websocket test
kumaranvpl Jan 7, 2025
735fcba
Break speaker attempt into 3 message classes
kumaranvpl Jan 7, 2025
3b6aafd
Break ConversableAgentUsageSummaryMessage into 2 classes
kumaranvpl Jan 7, 2025
a0e0cb6
polishing and test fix
davorrunje Jan 7, 2025
94a8ff9
Fix IOStream test in notebook
kumaranvpl Jan 7, 2025
05e3584
Do not use content as parameter in BaseMessage
kumaranvpl Jan 7, 2025
2d52026
Use stream=True in websockets tests
kumaranvpl Jan 7, 2025
d08bf4f
Move TestTextMessage to tests
kumaranvpl Jan 7, 2025
2062357
Fix tests failing because of renaming
kumaranvpl Jan 7, 2025
39c13cd
Refine Notebook
AgentGenie Jan 8, 2025
bf1bd78
Merge branch 'main' into rag_workflow
AgentGenie Jan 8, 2025
93d6ee8
Text changes
marklysze Jan 8, 2025
03b65f4
Merge remote-tracking branch 'origin/main' into rag_workflow
marklysze Jan 8, 2025
f30ed7b
Add dependency to pyproject
marklysze Jan 8, 2025
bc7efbc
Ignore LFS JSON files in pre-commit check
marklysze Jan 8, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 3 additions & 4 deletions .gitattributes
Original file line number Diff line number Diff line change
Expand Up @@ -33,10 +33,8 @@
*.tsx text
*.xml text
*.xhtml text diff=html

# Docker
Dockerfile text eol=lf

# Documentation
*.ipynb text
*.markdown text diff=markdown eol=lf
Expand All @@ -62,7 +60,6 @@ NEWS text eol=lf
readme text eol=lf
*README* text eol=lf
TODO text

# Configs
*.cnf text eol=lf
*.conf text eol=lf
Expand All @@ -84,8 +81,10 @@ yarn.lock text -diff
browserslist text
Makefile text eol=lf
makefile text eol=lf

# Images
*.png filter=lfs diff=lfs merge=lfs -text
*.jpg filter=lfs diff=lfs merge=lfs -text
*.jpeg filter=lfs diff=lfs merge=lfs -text
notebook/agentchat_pdf_rag/parsed_elements.json filter=lfs diff=lfs merge=lfs -text
notebook/agentchat_pdf_rag/input_files/nvidia_10k_2024.pdf filter=lfs diff=lfs merge=lfs -text
notebook/agentchat_pdf_rag/processed_elements.json filter=lfs diff=lfs merge=lfs -text
1 change: 1 addition & 0 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ repos:
- id: check-yaml
- id: check-toml
- id: check-json
exclude: ^notebook/agentchat_pdf_rag/(parsed_elements|processed_elements)\.json$
- id: check-byte-order-marker
exclude: .gitignore
- id: check-merge-conflict
Expand Down
Binary file not shown.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_elements.json
Git LFS file not shown
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/figure-1-1.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/figure-33-2.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/figure-92-3.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/figure-93-4.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/figure-94-5.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/figure-95-6.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-12-2.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-2-1.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-32-3.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-33-4.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-36-5.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-39-6.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-39-7.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-39-8.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-40-9.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-41-10.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-42-11.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-42-12.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-43-13.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-47-14.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-50-15.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-51-16.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-52-17.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-52-18.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-53-19.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-54-20.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-60-21.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-61-22.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-61-23.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-61-24.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-62-25.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-63-26.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-63-27.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-64-28.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-64-29.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-65-30.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-65-31.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-66-32.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-66-33.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-66-34.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-67-35.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-68-36.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-68-37.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-68-38.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-69-39.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-69-40.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-70-41.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-70-42.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-70-43.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-71-44.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-72-45.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-73-46.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-73-47.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-75-48.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-75-49.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-75-50.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-76-51.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-77-52.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-78-53.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-79-54.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-79-55.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-79-56.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-80-57.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-81-58.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-82-59.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-83-60.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-85-61.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/parsed_pdf_info/table-95-62.jpg
3 changes: 3 additions & 0 deletions notebook/agentchat_pdf_rag/processed_elements.json
Git LFS file not shown
17 changes: 17 additions & 0 deletions notebook/agentchat_pdf_rag/sample_elements.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
[
{
"element_id": "518e6f32a8c371f69e6ac8868519f570",
"text": "NVIDIA Corporation and Subsidiaries Consolidated Balance Sheets (In millions, except value)",
"type": "Title",
"page_number": 52,
"parent_id": "d972706e5fe99bae469dd5dc42202fa2"
},
{
"element_id": "7193a45c9b844e570053b3c0cc752c06",
"text": "NVIDIA Corporation and Subsidiaries Consolidated Balance Sheets (In millions, except value): Assets Current assets: Cash and cash equivalents Marketable securities Accounts receivable, net Inventories Prepaid expenses and other current assets Total current assets Property and equipment, net Operating lease assets Goodwill Intangible assets, net Deferred income tax assets Other assets Total assets Liabilities and Shareholders\u2019 Equity Current liabilities: Accounts payable Accrued and other current liabilities Short-term debt Total current liabilities Long-term debt Long-term operating lease liabilities Other long-term liabilities Total liabilities Commitments and contingencies - see Note 13 Jan 28, 2024 Jan 29, 2023 7,280 $ 3,389 18,704 9,907 9,999 3,827 5,282 5,159 3,080 791 44,345 23,073 3,014 3,807 1,346 1,038 4,430 4,372 1,112 1,676 6,081 3,396 4,500 3,820 65,728 $ 41,182 2,699 $ 1,193 6,682 4,120 1,250 1,250 10,631 6,563 8,459 9,703 1,119 902 2,541 1,913 22,750 19,081",
"type": "Table",
"page_number": 52,
"parent_id": "19874ad91c0234155cb1c5168500a767",
"image_path": "./parsed_pdf_info/table-52-17.jpg"
}
]
Loading
Loading