Copilot AI Metrics — by Agile Analytics (Baytek)
Free · Real-time GitHub Copilot usage analytics built directly into Azure DevOps. No backend. No data leaves your browser. Works in minutes.
Overview
Copilot AI Metrics gives engineering leaders, product managers, and developers a complete picture of how GitHub Copilot is being used across their organisation — all without leaving Azure DevOps.
Connect your GitHub organisation with a single PAT token, and instantly see:
- Who is using Copilot and who isn't
- How often AI suggestions are accepted vs dismissed
- Which languages and editors are generating the most value
- How much developer time and money is being saved
- Which team members need coaching or re-engagement
- CLI and Chat usage breakdowns
- Month-over-month adoption trends
No server. No subscription. No data ever leaves your browser.
Key Features
Overview Dashboard
- 7 live KPI cards — Licensed seats, Active users, Acceptance rate, Suggestions accepted, Lines accepted, Chat users, CLI users — all with period-over-period delta arrows
- Adoption Funnel — visualise drop-off from Licensed → Ever Active → Active This Month → Active This Week → Active Today
- Daily Usage charts — smooth area charts for active users and suggestions per day with hover tooltips
- Code Acceptance — acceptance rate trend + breakdown by language (TypeScript, Python, C#, JavaScript, Go…)
- Editor Breakdown — VS Code vs Visual Studio vs JetBrains vs Neovim by active user count
- CLI Usage —
gh copilot explain, gh copilot suggest, gh copilot test command volumes and trend
- Chat Insights — total conversations, code insertions, copy events, daily chat users, outcome funnel
- ROI & Value Panel — dev hours saved, estimated value generated ($), cost per active seat, ROI multiple vs license cost
- Top 10 / Bottom 10 Users — toggle between highest adopters (🏆 gold/silver/bronze) and users needing attention (⚠ inactivity warnings)
Seats & Teams
- Per-team adoption summary tiles with colour-coded adoption bars
- Full seat table — sortable by user, team, last activity, or days inactive
- Status badges: Active / Inactive / Never Used with visual warnings
- Potential monthly cost savings for unused/inactive seats
- Search and filter by status
Trends
- Selectable multi-series smooth line charts: Suggestions Accepted, Active Users, Acceptance Rate %, Lines of Code Accepted, Chat Users
- Period summary with % delta (second half vs first half comparison)
- Full daily data table with colour-coded acceptance rates
Settings
- Connect your GitHub Organisation + Personal Access Token (stays in browser only)
- One-click Test Connection — validates token scopes, reports live seat count
- Connect & Switch to Live Data — seamlessly upgrades from demo to real metrics
- Demo mode to explore all features before connecting
- Configurable alert thresholds for acceptance rate, adoption rate, and seat inactivity
- Auto-refresh interval (15 min → manual)
- Default date range (7d / 14d / 30d / 90d)
First-Run Setup Wizard
A guided 4-step onboarding for new users:
- Welcome & feature overview with demo/connect choice
- Enter GitHub organisation slug
- Create & paste a PAT (step-by-step instructions + direct link to GitHub token settings)
- Live connection test → one-click switch to real data
Privacy & Security
| What |
Detail |
| PAT storage |
Browser localStorage only — never transmitted to Baytek |
| API calls |
Direct browser → api.github.com — no intermediate server |
| Telemetry |
None. Zero. Baytek collects no usage data from this extension. |
| Clear data |
Settings → Reset to Defaults removes everything |
Requirements
| Requirement |
Detail |
| GitHub Copilot |
Business or Enterprise licence required |
| GitHub PAT |
Scopes: manage_billing:copilot or read:org |
| Azure DevOps |
Cloud (Azure DevOps Services) |
Quick Start
- Install the extension from the Marketplace
- Open any project → Boards → Copilot AI Metrics
- The setup wizard launches automatically on first use
- Enter your GitHub org + PAT → Test Connection → Go to Dashboard
- Or click Explore with Demo Data to try all features instantly
Want Even More Insights?
Copilot AI Metrics focuses on AI tool adoption metrics. For the complete picture of your engineering organisation — sprint velocity, work item analytics, team throughput, burndown charts, cycle time, custom dashboards, and cross-team reporting — try the full suite:
Agile Analytics is the trusted analytics platform for Azure DevOps teams. Together, Copilot AI Metrics + Agile Analytics give you complete visibility into both what your team ships and how AI is helping them ship it faster.
Support
Free forever. Maintained by the Agile Analytics team at Baytek.
| |
