[New RM] Add AzureAISearch

[dfusion-dev]

Goal

Add RM support for Azure AI Search. Allows the use of custom datasets made available through Azure AI Search.

Changes

• Updated requirements.txt to include azure-search-documents. This SDK wraps Azure's AI Search functionality.
• Updated rm.py to include AzureAISearch implementation.
• Updated the example script, run_storm_wiki_gpt.py, to include AzureAISearch support.
• Updated README.md to include the new retrieval module component

Change Questions / Comments

We could do something akin to what was done for Google Search support: rather than install as part of requirements.txt, have the RM fail unless the user installs the proper pypi library.

Generated Files

I've attached a zip of the artifacts generated running the run_storm_wiki_gpt.py using the new rm. Data for the article sourced from part of dFusion's Genesis Knowledge Pool made available through Azure AI Search. Files in the zip include:

• conversation_log.json
• raw_search_results.json
• storm_gen_article.txt
• direct_gen_outline.txt
• run_config.json
• storm_gen_outline.txt
• llm_call_history.jsonl
• storm_gen_article_polished.txt
• url_to_info.json

Formal_Verification_In_Smart_Contract_Development.tar.gz

[shaoyijia]

Thank you so much for your contribution! We are happy to integrate this once you fix the nits.

[dfusion-dev]

@shaoyijia requested changes have been applied

[shaoyijia]

Thank you for contributing this!