Skip to content

Commit

Permalink
updates matrix format, adds alternative version
Browse files Browse the repository at this point in the history
  • Loading branch information
benironside committed May 30, 2024
1 parent 24c807e commit e7c4ea1
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/serverless/assistant/llm-performance-matrix.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -9,9 +9,9 @@ status: in review

This table describes the performance of various LLMs for different use-cases in ((elastic-sec)), based on our internal testing. To learn more about these use-cases, refer to <DocLink id="attackDiscovery" text="Attack discovery"/> or <DocLink id="serverlessSecurityAIAssistant" text="AI Assistant"/>.

| | **Model** | | | | | |
| **Feature:** | **Model** | | | | | |
|-------------------------------|-----------------------|--------------------|--------------------|------------|-----------------|----------------|
| **Feature:** | **Claude 3: Opus** | **Claude 3: Sonnet** | **Claude 3: Haiku** | **GPT-4o** | **GPT-4 Turbo** | **GPT-4 32K** |
| | **Claude 3: Opus** | **Claude 3: Sonnet** | **Claude 3: Haiku** | **GPT-4o** | **GPT-4 Turbo** | **GPT-4 32K** |
| **Assistant: general** | Excellent | Excellent | Excellent | Excellent | Excellent | Excellent |
| **Assistant: ((esql)) generation** | Great | Great | Poor | Excellent | Poor | Excellent |
| **Assistant: alert questions** | Excellent | Excellent | Excellent | Excellent | Poor | Good (limited context) |
Expand Down

0 comments on commit e7c4ea1

Please sign in to comment.