diff --git a/admin_manual/ai/app_assistant.rst b/admin_manual/ai/app_assistant.rst index 04859678741..24e93134e0f 100644 --- a/admin_manual/ai/app_assistant.rst +++ b/admin_manual/ai/app_assistant.rst @@ -38,11 +38,12 @@ Artificial intelligence at Nextcloud is built in a modular way, allowing you to **Note**: At Nextcloud we focus on creating on-premise AI apps that run fully self-hosted on your own servers in order to preserve your privacy and data sovereignty. However, you can also offload these resource-heavy tasks to an :ref:`"AI as a Service" provider`. +**Note**: When using our on-premise AI apps, make sure you have a GPU with enough VRAM that fits all the features you need. For each app documented here you will find its hardware requirements. + Machine translation ~~~~~~~~~~~~~~~~~~~ In order to make use of machine translation features in the assistant, you will need an app that provides a translation backend: - * :ref:`translate2 (ExApp)` - Runs open source AI translation models locally on your own server hardware (Customer support available upon request) * *integration_deepl* - Integrates with the deepl API to provide translation functionality from Deepl.com servers (Only community supported) diff --git a/developer_manual/digging_deeper/task_processing.rst b/developer_manual/digging_deeper/task_processing.rst index b602d78801e..3519d6f7bd3 100644 --- a/developer_manual/digging_deeper/task_processing.rst +++ b/developer_manual/digging_deeper/task_processing.rst @@ -87,6 +87,21 @@ The following built-in task types are available: * Output shape: * ``output``: ``ListOfImages`` +LLM Prompts and multilingual I/O +################################ + +When writing prompts for the TextToText task type in your apps, we recommend testing it with at least + +* OpenAI GPT-3.5 +* Llama 3.1 + +Also, make sure that you instruct the model to use the correct language in its output. By default most models will answer in English if the main prompt is in English, even though the source data is in another language. +A tweak to make sure of this is to instruct the model as follows: + +.. code-block:: php + + "Detect the language used in the text and make sure to answer in the same language without mentioning the language explicitly." + Input and output shapes ~~~~~~~~~~~~~~~~~~~~~~~