Skip to content
This repository has been archived by the owner on Sep 30, 2024. It is now read-only.

Context: solidify Cody keyword context #61571

Closed
5 tasks done
Tracked by #61703
jtibshirani opened this issue Apr 3, 2024 · 1 comment
Closed
5 tasks done
Tracked by #61703

Context: solidify Cody keyword context #61571

jtibshirani opened this issue Apr 3, 2024 · 1 comment
Assignees
Labels
team/search-platform Issues owned by the search platform team

Comments

@jtibshirani
Copy link
Member

jtibshirani commented Apr 3, 2024

This issue tracks an initial round of context quality improvements based on our manual evaluation. It focuses on the core keyword retrieval algorithm, and only considers single-repo context.

Quality improvements

Bug fixes

/cc @sourcegraph/search-platform

@jtibshirani jtibshirani added the team/search-platform Issues owned by the search platform team label Apr 3, 2024
@jtibshirani jtibshirani self-assigned this Apr 3, 2024
@jtibshirani jtibshirani changed the title Context: low-hanging quality improvements Context: solidify Cody keyword context Apr 9, 2024
@jtibshirani
Copy link
Member Author

Summary of user-facing improvements:

  • Squashed bug where a query like "what's going on?" would return random results
  • Customers who use other docs formats like wiki now get docs results
  • Small improvement on golden queries evaluation before and after these improvements. The main effect is that we are now better at Ownership queries

Before

Find symbol	7/9
Find string	2/2
Explain concept	4/5
Check dependency	1/2
Find logic	16/22
Gather information	6/9
Changelog	0/2
Ownership	0/2
Combined recall	36/53

After

Find symbol	7/9
Find string	2/2
Explain concept	4/5
Check dependency	1/2
Find logic	16/22
Gather information	6/9
Changelog	0/2
Ownership	2/2
Combined recall	38/53

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
team/search-platform Issues owned by the search platform team
Projects
None yet
Development

No branches or pull requests

1 participant