Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][GitHub] Add GitHub Copilot Usage Metrics or AI Usage Data model #8151

Open
3 tasks done
dipakparmar opened this issue Oct 21, 2024 · 0 comments
Open
3 tasks done
Labels
type/feature-request This issue is a proposal for something new

Comments

@dipakparmar
Copy link

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Use case

As a tech/team lead and DevOps engineer, I want to track and analyze GitHub Copilot and other ai platform usage metrics across our organization to better understand its impact on developer productivity and code quality.

Description

propose adding support for GitHub Copilot Usage Metrics to Apache DevLake. This feature would leverage the GitHub Copilot Usage API (https://docs.github.com/en/rest/copilot/copilot-usage?apiVersion=2022-11-28) to collect and analyze Copilot usage data.

Key Points:

  1. Implement new data collection for GitHub Copilot usage metrics.
  2. Create new models to store Copilot-specific data, potentially expandable to other AI coding assistants/platforms (e.g., Anthropic, OpenAI).
  3. Add new transformations and metrics calculations related to Copilot usage.
  4. Develop dashboards to visualize Copilot usage trends and impact.

Proposed Data to Collect:

  • Total suggestions count
  • Total acceptances count
  • Total lines suggested/accepted
  • Active users
  • Chat acceptances and turns
  • Breakdown by language and editor

This feature will enable organizations to measure the effectiveness and adoption of GitHub Copilot/and another platform, aiding in cost justification and optimized usage.

Related issues

No related issues were found. Some guidance, and community alignment needed.

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@dipakparmar dipakparmar added the type/feature-request This issue is a proposal for something new label Oct 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/feature-request This issue is a proposal for something new
Projects
None yet
Development

No branches or pull requests

1 participant