The CustomerSupport example is not working

[warappa]

At least with Ollama ("llama3.1" or "llama3.2"), the CustomerSupport sample is not working.

The summary works, but the issues is in the chat prompt. There is string.Join("\n", searchResults) in the prompt. The searchResults are ManualChunks. ToString of ManualChunk returns just "ManualChunk", so there is no real context.

So the message to be passed to CompleteAsync ends up being:

Using the following data sources as context, answer the user query: Summary?

## Context
ManualChunk
ManualChunk
ManualChunk
ManualChunk
ManualChunk

Response: 

Which amounts to no real context for the LLM (the LLM complains even that it only sees some "ManualChunk" texts as context).

Code

ai-samples/src/chat/CustomerSupport/Utils.cs

Lines 155 to 170 in 05a832f

	// RAG loop
	// [1] Search for relevant documents
	var searchResults = await productManualSearchService.SearchAsync(ticket.ProductId.Value, query);
	// [2] Augment prompt with search results
	var message = $"""
	Using the following data sources as context, answer the user query: {query}
	## Context
	{String.Join("\n", searchResults)}
	Response:
	""";
	// [3] Generate response
	var response = await chatClient.CompleteAsync(message);