Follow up Questions with llamaindex

[ShailendraSahu24]

So my chatbot is working with the llamaindex and azureOpenAI. How do I get follow up questions based on answer provided? Let's say I asked What is the capital of USA? Chatbot: The capital of USA is Washington DC. Now some of the follow up questions could be “What is the population of Washington DC?”
“Why was Washington DC chosen as the capital?”
“What are some famous landmarks in Washington DC?”

[dosubot[bot]]

To generate follow-up questions based on the answer provided by your chatbot using LlamaIndex and Azure OpenAI, you can use the CondensePlusContextChatEngine class. This class helps in condensing a conversation and the latest user message into a standalone question, retrieving context for that question, and generating a response using an LLM. Here's a brief overview of how you can implement this:

1. Condense the Question: Use the _condense_question method to rephrase the follow-up question into a standalone question. This involves taking the chat history and the latest user message as inputs.

2. Retrieve Context: Use the _retrieve_context method to gather context for the standalone question from a retriever. This context helps in generating more relevant follow-up questions.

3. Generate Response: Use the chat method to pass the context, system prompt, and user message to the LLM, which will generate a response.

By following these steps, you can effectively create follow-up questions based on the chatbot's responses ^[1].

To continue talking to Dosu, mention @dosu.