Smart replies for mail

[hamza221]

Fixes #8505

Composer	Message

• Add caching
• Fix composer update
• unit tests
• Better prompt
• Work on email body, not preview text

For now at least one prompt is executed for every opened message

• Find a way to filter out Promotional / generated emails without the use of LLM

[ChristophWurst]

POC of #8505

What's missing for a MVP?

[hamza221]

What's missing for a MVC?

I'm still not confident about the method of detecting Personal vs non personal emails, aside from that, nothing ig

[JohannesGGE]

Is there anything to consider while testing? I dont't get any reply suggestions. Tried simple mails like in your screenshot. http://nextcloud.local/index.php/apps/mail/api/messages/3/smartreply answers with 200, but empty response.

[hamza221]

Is there anything to consider while testing? I dont't get any reply suggestions. Tried simple mails like in your screenshot. http://nextcloud.local/index.php/apps/mail/api/messages/3/smartreply answers with 200, but empty response.

If you're getting 200 that means they're getting flagged as generated mails, for some reason. Can you please add a breakpoint and check if its because of isPersonalEmail() or LLM output ?

[hamza221]

I started getting this bug, I would say a way around it would be to prompt the LLM twice, once for each reply, what do you think @ChristophWurst ?

edit/further explanation:
the prompt I'm using
$prompt = "Suggest 2 quick replies a maximum of 25 character per answer for this email seperated by | :".$messageBody."";

I don't think we can trust it to give us a reply in that format every time

[ChristophWurst]

IMO we can fine-tune the prompts as we test the feature. E.g. I tried Suggest 2 replies to the following email. Each reply should be 25 characters max. Separate the replies with "|", like for example "Yes! | No, I'm not available". Do not print anything else. The email contents are "<email>" and it gives a consistent output format.

[ChristophWurst]

Like with thread summaries we should offer a way to turn this feature off by admins

[ChristophWurst]

Tested against chatgpt3.5 & works

The suggestions are OK, some are a bit absurd. But that's fine, we can improve the prompt 👍

[ChristophWurst]

OCA\Mail\Tests\Unit\Service\AiIntegrationsServiceTest::testCached

This test did not perform any assertions