Updating docs #166
Merged
Updating docs #166
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
csansoon
reviewed
Sep 12, 2024
docs/guides/evaluations/overview.mdx
Outdated
|
|
||
| ## How do they work? | ||
|
|
||
| A Latitude project can have any number of evaluations that will be available to connect to prompts. You can create evaluations in the **Evaluations** tab of your project. Latitude comes with a set of built-in evaluations that you can use to get started, it's as simple as importing them into your project. |
There was a problem hiding this comment.
The "Evaluation" tab is not IN the project, but in the workspace.
csansoon
reviewed
Sep 12, 2024
docs/guides/logs/overview.mdx
Outdated
Comment on lines
1
to
23
| --- | ||
| title: Logs | ||
| description: Learn how to use the logs page to monitor your prompts and evaluate their performance. | ||
| --- | ||
|
|
||
| ## Overview | ||
|
|
||
| Latitude stores all the logs generated by your prompts in a database. You can use the logs page to monitor your prompts and evaluate their performance. | ||
|
|
||
| ## How it works | ||
|
|
||
| Every time you run a prompt, from the API or from the UI, a new log is created. | ||
|
|
||
| To access the logs page, navigate to a prompt and click on the "Logs" tab. You'll see a table with all the logs generated by the prompt, some metadata like the timestamp, the prompt version used, latency, tokens used, and cost. | ||
|
|
||
| Clicking on a log will display a side panel with the full details of the log, including the list of messages. | ||
|
|
||
| ## Coming soon | ||
|
|
||
| - Filtering and sorting | ||
| - Exporting logs to a CSV file | ||
| - Deleting logs | ||
| - Visualizations for certain metrics like latency, tokens used, and cost |
There was a problem hiding this comment.
Maybe add that you can manually generate new logs from a Dataset?
csansoon
approved these changes
Sep 12, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.