Executing the /document command for a js file generates comments with hallucinations in it

[shivan-mohan]

Summary

I tried executing the /document command in the A4D chat window for a js file. In the received comment suggestion there is information which is not at all relevant to my code or workspace (it looks to be a lift and copy from a similar code used for training the model).

This happens with js documentation suggestions only. Generating documentation for Apex class does not produce such hallucinations.

Steps To Reproduce:

1. Open a js file in VS code or Codebuilder
2. Open the A4D chat window
3. Execute the /document prompt and enable "Use entire file?"
4. Make a note of the generated comment suggestion (esp. the top most comment)
5. You may receive something along the lines as the attached display

Expected result

It would be nice to not include such information (hallucination induced) at all. For e.g. the ideal opening documentation would be using placeholders instead of hallucinated values
/**

• @description :
• @author : <>
• @group :
• @last modified on : <>
• @last modified by : <>
• Modifications Log
• Ver Date Author Modification

**/

Actual result

Additional information

Attached above

Salesforce Extension Version in VS Code: v1.3.0

Salesforce Einstein For Developers Version in VS Code: v1.2.0

OS and version: MacOs 13.7

VS Code version:Version: 1.95.1 (Universal)

[smarvez]

Hi @shivan-mohan - Thank you for the feedback. We'll pass this on to the AI Research team.