Agile Analytics — Sprint Intelligence for Azure DevOps

15+ analytics views built directly into Azure DevOps — Next Sprint Planning (capacity + Monte Carlo + cycle-time reality check on one screen), Flow Efficiency, cycle time with auto-discovered custom states, Service Level Expectations on the dashboard, Monte Carlo forecasting, WIP monitoring, sprint capacity, and AI adoption tracking. No infrastructure. No spreadsheets. No BI tools.

Install in 2 minutes. See health scores, delivery forecasts, and flow data for every team in your organization — live, inside ADO, from your first sprint.

Where to find it after install

Agile Analytics adds a new entry to the left sidebar of every Azure DevOps project in your organisation — directly under the project name, alongside Boards, Repos, Pipelines. If you've just installed and don't see it yet, refresh the project page once. The extension is organisation-wide, so it shows up in every project automatically — you do not need to install it per project.

Most installers never come back to this listing — they go straight to Azure DevOps. If a teammate installed Agile Analytics for your team and you're trying to find it: open any project in your organisation, then look in the left sidebar for Agile Analytics.

At a glance

• What it is. A sprint-intelligence and flow-analytics hub embedded in Azure DevOps Services. 15+ analytics views and 3 native ADO dashboard widgets, delivered as a single project hub extension.
• Built for. Engineering managers, agile coaches, scrum masters, and product owners running 1–50+ Scrum, Kanban, or SAFe teams in Azure DevOps Services. Useful from a single team to enterprise rollouts.
• Pricing. Per-seat tiers. Team — $25/month (2 seats) · Business — $100/month (6 seats) · Premium — $2,000/year (unlimited seats). Every plan includes every feature. 30-day free trial activates automatically on install — no credit card.
• Security & privacy. All analytics run in your browser against the Azure DevOps REST API using your existing ADO session. Your work-item data never leaves your Azure DevOps tenant. Baytek's backend stores only licence records and lightweight install telemetry — never work-item content.
• Compliance. WCAG 2.1 AA accessibility achieved (verified by an axe-core regression suite in CI on every release). SOC 2 Type 1 evidence collection in progress. GDPR-aligned data handling — see Privacy Policy.
• Permissions. Three read-only Azure DevOps scopes: vso.project, vso.work, vso.graph. No vso.code, no vso.analytics, no write scopes. The extension cannot modify your work items.
• Quality bar. Every release passes 500+ automated tests (vitest unit + Playwright E2E + 5-view accessibility regression baseline + visual regression baseline) before publication. TypeScript strict mode end-to-end.
• Infrastructure required. None. No Azure Function, no database, no service connection, no PAT. Install, map workflow states once, done.
• Where it runs. Azure DevOps Services (cloud). Azure DevOps Server (on-premises) is not supported in this version.
• Publisher. Baytek. Support and feature requests: ado-analytics.baytekdev.com/support

Pricing & Licensing

30-day free trial — no credit card. Paid plans from $25/month after. The Marketplace install gives you the full extension, fully unlocked, for 30 days. To keep using it past day 30, an Azure DevOps organisation admin activates a paid plan below. There is no "free forever" tier; we tell you this up front so day 31 isn't a surprise.

Three plans, every feature included on each:

• Team — $25/month · 2 seats included. Right for a small Scrum team or a pilot rollout.
• Business — $100/month · 6 seats included. Right for a full delivery team running Scrum or Kanban.
• Premium — $2,000/year · unlimited seats. Best for a whole org or multiple teams.

A seat is one Azure DevOps user who opens Agile Analytics inside your organisation. Seats are counted over the last 30 days of distinct user activity. If your team grows past your plan's allotment, you'll see a soft in-extension notice — no surprise billing.

30-day free trial activates automatically on install — no credit card required. During the trial every user in your org has full access.

Install from the Azure Marketplace and your trial starts automatically. When you are ready to subscribe, visit https://ado-analytics.baytekdev.com/pricing/. After payment, Baytek emails your licence key and an org admin activates it in Settings → License inside the extension.

Not ready to commit? Schedule a 15-min call — procurement question, security review, missing feature, pricing for an unusual team size. No slides.

Support & Feature Requests: Questions, bugs, rollout help, or missing features? Start here: https://ado-analytics.baytekdev.com/support/

The Gap It Fills

Azure DevOps has powerful raw data but no built-in answers for the questions that actually matter in sprint planning and retros:

• "When will we be done?" — Monte Carlo simulation on your actual throughput history
• "What should we commit to next sprint?" — Next Sprint Planning combines capacity, Monte Carlo on the team's last 6 sprints, cycle-time per bucket, backlog risk scan, and historical commitment reliability into a single recommendation
• "How much can we realistically commit this sprint?" — Sprint Capacity: velocity-adjusted commitment, factoring in each member's days off
• "Why is this sprint struggling?" — Commitment reliability, scope churn, and carryover rates in one view
• "Which team needs attention?" — Cross-team health grid with configurable goals and auto-generated coaching prompts
• "How long does work actually take?" — Cycle time scatterplot with P50/P85 percentile lines
• "Are we flowing or are we stuck?" — Flow efficiency, lead time, and WIP trends over rolling windows
• "Are our engineers actually using AI tools?" — Company-wide GitHub Copilot and Microsoft 365 Copilot adoption dashboard

Agile Analytics answers all of these — without leaving Azure DevOps.

Who Is This For

Views at a Glance

Sprint Health

Flow Analytics

Portfolio

Monte Carlo Forecasting

Agile Coach

AI Governance

Dashboard Widgets

Three Azure DevOps dashboard widgets — add them to any project dashboard alongside your other ADO widgets:

Tools

How It Compares

This is positioning, not a benchmark — every team's setup is different. The point is that Agile Analytics fills the analytics layer that ADO ships without, with no data-pipeline work and a flat org price.

Security, Privacy & Compliance

Where your work-item data lives. Every analytics view runs in your browser against the Azure DevOps REST API, authenticated by your existing ADO session — the same session ADO Boards uses to render your work-item list. Baytek does not see, request, or store your work-item content, sprint data, AI prompts, or any user identifiers from your tenant.

What Baytek's backend handles.

1. Licensing. When an org admin activates a paid licence, the backend issues a signed activation token. Subsequent validation calls confirm the token is still valid. Stored: organisation name, plan tier, expiry date, activation token. No work-item data.
2. Install telemetry. A lightweight ping on first install and on subsequent loads (organisation name, ADO org id, extension version, event type, timestamp) lets us count active orgs and detect outages or regressions. No work-item data.
3. Anonymous usage telemetry (added in v6.4.0, opt-out at Configuration → Privacy). A small allow-listed set of events — view navigation, configuration completion, trial-day milestones, feature use — recorded against the ADO organisation ID. Each event carries an enum-valued name and a small structured properties payload. Never includes work-item content, user names, project / team / sprint names, AI prompt content, or webhook URLs. The exact event allow-list is documented in the Privacy Policy.
4. Optional trial nurture emails. If a trial admin opts in by entering their email in the trial reminder card, Baytek sends a Day 7 onboarding email, a Day 14 mid-trial check-in, and Day 23 / Day 28 trial-end reminders. Opt-in only.

Sub-processors.

• Stripe — payment processing for licence purchases.
• Firebase Hosting — the ado-analytics.baytekdev.com marketing and licence-management site only. The extension itself does not depend on Firebase.
• Zoho Mail — transactional email (licence keys, support replies).

Sub-processors are listed in the Privacy Policy and the compliance/ working evidence record.

Compliance posture.

• Accessibility. WCAG 2.1 AA achieved as of v6.2.4. Every release runs a 5-baseline axe-core regression suite in CI; new violations fail the gate before publication. The single accepted exception is page-has-heading-one, which is structurally inappropriate for an iframe-embedded extension whose host page (Azure DevOps) owns the page-level h1 — adding our own would create competing top-level headings in the user's accessible heading tree.
• SOC 2 Type 1. Evidence collection in progress. Working documentation maintained internally; ask via support for status updates.
• GDPR. Personal data processed by Baytek is limited to the licence record and install telemetry above. Customers acting as data controllers can request deletion via support.

Settings storage. All extension configuration (workflow mapping, WIP limits, AI provider keys, access control, user preferences) is stored at organisation scope in Microsoft's Azure DevOps Extension Data Service — Microsoft-managed infrastructure that Baytek systems do not access. Configuration survives extension upgrades and is removed by Microsoft on uninstall.

Engineering quality bar. Releases are gated through 500+ automated tests:

• Unit tests (vitest) — exercise every analytics calculation against real-ADO captures and synthetic fixtures across all four Microsoft stock processes (Agile, Scrum, CMMI, Basic) plus arbitrary custom processes.
• End-to-end tests (Playwright) — validate the hub shell, navigation, configuration save persistence, trial flows, accessibility, and visual regression baselines.
• Accessibility regression suite — axe-core runs against five baseline views on every release; new WCAG 2.1 AA violations fail the gate.
• Visual regression baselines — five baseline screenshots gated for unintended UI drift.

A failure in any layer stops the release from being packaged.

What's New in Version 6.12

v6.12.1 — Restored GitHub Copilot live metrics + clearer connect-failure messages (May 2026)

Restored AI Metrics live-connect for GitHub Copilot. GitHub sunset the /copilot/usage endpoint we used to call; the AI Metrics view now uses the supported /copilot/metrics endpoint instead and renders the same daily totals — suggestions, acceptances, lines suggested, lines accepted, chat turns. Lines accepted is now genuine GitHub data rather than a modeled estimate. If your token only has read:org (no manage_billing:copilot), the org-level summary still works — per-seat detail just hides with an in-line note explaining why.

Test Connection now names the actual problem. Auth, rate-limit, network, and "no eligible activity" cases each get a specific message instead of the previous generic "connection failed." The empty case in particular — when GitHub returns no data because your org has fewer than 5 active Copilot users in the last 28 days — used to silently look like a connection issue; it now tells you exactly that and what to do next.

New "Copy diagnostic info" button on the GitHub Copilot configuration tab. Probes both Copilot endpoints, formats a one-screen PAT-free status report (HTTP code + duration per endpoint, extension version, user agent) and copies it to your clipboard. Safe to paste into a support email — your PAT, org name, and any response bodies are never included.

No new permissions, no new scopes, no new outbound endpoints beyond api.github.com.

v6.12.0 — Privacy hardening + admin visibility into pending access requests (May 2026)

Admins now see a count badge on the Configuration nav when users in their org are waiting for access. Previously this was a small red dot — you knew something was pending but not how many or how urgent. Now you see "3" or "12" right next to Configuration in the left sidebar, hidden when you're already on the Configuration page (you can see the list there). One less click between "someone needs access" and "I can approve it."

We now honour the Global Privacy Control browser signal. If your browser advertises GPC — increasingly common in EU and US consumer browsers — Agile Analytics treats it the same as opening Configuration → Privacy and switching off "Anonymous usage telemetry." Nothing leaves your browser. This is in addition to the existing per-organisation toggle, not instead of it; either signal is enough.

Queued telemetry now survives tab-close. A small subset of events fire during the half-second between the extension loading and your licence resolving. Previously, if you closed the tab inside that window, those events were dropped silently. They now flush via navigator.sendBeacon on the same signals modern browsers use for analytics unload — visibilitychange and pagehide. Same payload, same opt-out gates, just a more reliable transport at the exact moment everything else in the page is shutting down.

No new permissions. No new outbound endpoints. The pending-request badge only renders for admins and only when there's actually something to act on.

What's New in Version 6.11

v6.11.2 — Feature Analytics scope filter + Linked PRs in User Metrics (May 2026)

Feature Analytics now respects your saved team scope end-to-end. When you save a team scope in Configuration → Feature Filters, the feature list itself trims to that scope — not just the per-team aggregate table and Completed-SP totals. The list now shows only features whose own area/iteration path belongs to a scoped team, or that have at least one child story in a scoped team. If you've saved a scope and were puzzled why the list still showed every Feature in the project, this is the fix.

New "Linked PRs" column in User Metrics. Counts pull requests attached to each user's assigned work items in the sprint range — a strong proxy for PR authorship that's accurate in the vast majority of teams (can drift by one in pair-programming, mid-sprint reassignment, or PR-on-behalf-of scenarios). The header tooltip explains the data source so reviewers know what they're looking at. PR comment counts remain unavailable in this build and render as "—" rather than a misleading 0.

Pricing reminder. Three per-seat plans — every feature included on each: Team — $25/month (2 seats), Business — $100/month (6 seats), Premium — $2,000/year (unlimited seats). 30-day free trial activates automatically on install, no credit card. If you're evaluating, see pricing or schedule a 15-min call — no slides.

What's New in Version 6.9

v6.9.0 — Day 3 trial milestone + nurture-copy refresh (May 2026)

The first in-product nurture moment moves up to Day 3 — a short, low-pressure card that says "you've explored, here's how to keep this going" with the entry-tier price up front ($25/mo Team, 2 seats). Self-gated by behavior: only renders if a trial user opens the hub on Day 3, so silent-trial orgs never see it. Day 22 and Day 28 cards refreshed to name the current Team / Business / Premium tiers (the old "Founding Partner pricing" reference is gone). A new "Talk to us first — 15 minutes, no slides" section on the pricing page gives hesitant buyers a lower-commitment path before Stripe checkout.

Why Teams Choose Agile Analytics

No infrastructure — ever Everything runs in the browser against your live ADO data. No Azure Function, no database, no service connection to configure. Install, claim admin access, map your workflow states once, and it works across your entire organization.

Sprint Capacity + Monte Carlo together Plan with capacity-adjusted commitments, then validate with a 10,000-run Monte Carlo forecast. The two views are designed to be used together before every sprint.

WIP alerts that actually reach you Set WIP limits per team, connect a Teams or Slack webhook, and get notified the moment a team goes over — with a direct link to their active sprint taskboard.

Background Monitor — alerts without the browser open Configuration generates the Azure Pipeline YAML for you. Your admin adds it to a repo, sets a cron schedule, and WIP alerts run automatically — even when nobody has ADO open. Zero external infrastructure, runs entirely within your tenant.

Retro-ready in one click Export any sprint summary to a branded PowerPoint slide deck. Paste it into your retro without formatting work.

AI that uses your actual data When the AI Assistant is enabled, it reads your live sprint report before answering. Not generic advice — answers grounded in your team's actual numbers. Connect Claude, OpenAI, or GitHub Copilot using your own API key.

Role-based access control Built-in Admin/User role system with ADO directory search. Keep it open to all project users, or switch to assigned-users-only mode for controlled rollouts.

Dark mode Full dark theme — persisted per user, toggled with one click.

Getting Started in Under 2 Minutes

Step 1 — Install Open the Marketplace listing and install the extension into your Azure DevOps Services organization.

Step 2 — Open Navigate to any project → find Agile Analytics in the left navigation bar under your project name.

Step 3 — Claim Admin Access (Required) An Azure DevOps Project Administrator or Organization Administrator must go to Tools → Configuration → Access Control and click Claim Admin Access.

Step 4 — Configure Workflow Mapping (Required) Go to Tools → Configuration → Workflow Mapping and map your board states to analytics flow stages. This is what makes cycle time and flow metrics accurate for your process.

Step 5 — Select your team and explore Use the team selector in the top-left corner, then browse views using the top navigation.

Optional Visit Tools → Configuration to set WIP limits, add Teams/Slack webhook alerts, configure the Background Monitor, and run Readiness checks.

Complete Access Control claim and Workflow Mapping before broad rollout for correct analytics behavior.

Access Control

Agile Analytics includes a lightweight built-in role system — no Azure DevOps group configuration required.

1. An Azure DevOps Project Administrator or Organization Administrator visits Configuration → Access Control and clicks Claim Admin Access
2. Admin chooses whether the extension is open to All project users or restricted to Assigned users only
3. Admin adds users by searching the ADO directory and assigning them Admin or User roles
4. Admin configures which views are visible to User-role members
5. Admins always see every view regardless of settings

Settings are stored at organization scope in Azure DevOps Extension Data Service — one configuration shared across all users in the org.

AI Assistant (Optional)

Disabled by default. When enabled:

• Ask natural language questions: "How did Team Alpha perform this sprint?"
• Reads your live sprint data before answering
• Connect Anthropic Claude, OpenAI, or GitHub Copilot with your own organization-managed API key
• Configure provider, model, per-session request limits, and output token limits
• Admins can disable it org-wide via Configuration → Access Control

Data sent when AI is active: your prompt + sprint name + team name + aggregated metrics (point counts, percentages). Work item titles and user names are never included automatically.

Notification Alerts

Connect to Microsoft Teams or Slack to receive automatic alerts. Seven configurable triggers:

Sprint Health

• Commitment Reliability Low — fires when reliability drops below your threshold
• Scope Churn Exceeded — fires when mid-sprint scope changes exceed your churn threshold
• Carryover Risk — fires when carry-over share is too high
• Sprint End Summary — one-time digest at sprint end

Flow & WIP

• WIP Over Limit — fires when any team exceeds its WIP limit; links directly to their active sprint taskboard
• Stale In-Progress Items — fires when items have been in-progress for more than 5 days

Digest

• Weekly Sprint Digest — once-per-week summary of sprint health and flow status

Configure in Tools → Configuration → Notifications. Paste your webhook URL, select triggers, and save.

In-session vs Background: Alerts above fire when a user has the extension open. For automated alerts without the browser open, use the Background Monitor.

Background Monitor — Alerts Without the Browser Open

Configuration → WIP Settings generates a YAML file for your Azure Pipeline. After your admin adds that file to a repo and creates the pipeline, it runs on your chosen cron schedule, checks WIP limits, and posts to Teams or Slack automatically.

• Zero external infrastructure — runs entirely within your ADO organization
• No PAT required — uses Azure Pipeline's built-in service account
• Fully auditable — YAML file is committed to your repo; inspect or modify anytime

Permissions Explained

We request only what we use. No vso.code, no vso.analytics, no write permissions.

Requirements

• Azure DevOps Services (cloud) — any tier
• Project Contributor access or higher
• Modern browser (Edge, Chrome, Firefox)
• Azure DevOps Server (on-premises) — not supported in this version

FAQ

Does this extension store my data anywhere? Your Azure DevOps work item content, sprint data, and AI prompts stay in your browser and your ADO tenant — Baytek never sees them. The only data on Baytek systems is your licence record (organisation name, plan, expiry, activation token) and a lightweight install/heartbeat ping (organisation name, extension version, timestamp) so we can count active installs and detect outages. Settings, workflow mappings, AI API keys, and access control are stored in your org's Azure DevOps Extension Data Service — Microsoft-managed infrastructure that Baytek does not access. Full details in the Privacy Policy.

Will my settings be lost when the extension updates? No. All settings (WIP limits, workflow mappings, notification webhooks, AI configuration, access control, user preferences) are stored using the ADO Extension Data Service key-value API, which is version-agnostic. Upgrading never resets your configuration.

Does it slow down Azure DevOps? No. The extension makes the same REST API calls you would make manually — one view at a time, only when you navigate to it. No background polling, no persistent connections.

Why do I see no data on Cycle Time, Flow Metrics, or Flow Efficiency? These views require completed sprints with items in a Done/Closed/Resolved state. As of v6.1.0 your project's custom state names are auto-discovered — open Configuration → Workflow Mapping and assign each of your states to a stage (In Progress / Test / Review / Done). The Cycle Time preview panel under each mapping shows exactly which states will count.

How does Sprint Capacity work? Sprint Capacity reads the capacity your team sets in Azure DevOps Boards (the days/hours per member per sprint). It calculates each member's available working days after personal and team-wide days off, computes effective team capacity as a percentage, and multiplies your average velocity by that percentage to suggest a realistic sprint commitment. If capacity hasn't been set in ADO Boards, the view will prompt you to add it there first.

Do I need to configure anything before rollout? Yes. An admin should claim admin access (Configuration → Access Control) and complete workflow mapping (Configuration → Workflow Mapping) before rolling out to the team.

How do I set up the AI Assistant? Go to Configuration → AI Settings. Select Claude, OpenAI, or GitHub Copilot, enter your API key, set usage guardrails, then enable and save.

Can I control who sees what? Yes — through the built-in Access Control. Admins can choose open access for all project users or restrict to assigned users only, and control which views regular users can see.

Does it work across multiple projects? Yes. The extension installs at organization level and is available in every project. The current plan includes unlimited teams and projects across your organization.

Is dark mode supported? Yes. Click the theme toggle in the top-right of the navigation bar. Preference is saved per user.

What happens if I uninstall? Your ADO work items, sprints, and boards are completely unaffected — this extension only reads data, never writes to work items. Extension Data (settings, preferences, access control) is deleted on uninstall.

What is AI Metrics and who can use it? AI Metrics is a company-wide AI adoption dashboard. It is included in the 30-day trial and every paid subscription. When no live AI source is connected, it shows realistic demo data so you can explore the layout. To connect a live source, go to AI Metrics → Settings (admin required) and enter credentials for GitHub Copilot, Microsoft 365 Copilot, or a Custom API endpoint.

What is AIIP? AIIP (AI Improvement & Intervention Panel) is an admin-only companion to AI Metrics. It surfaces automated alerts when users are at risk of disengagement (low usage, high rejection rate, sudden drop), lets admins log interventions and mark them done, celebrates milestones, and can send Teams webhook notifications per team. All actions are written to an audit log.

What are the dashboard widgets? Three Azure DevOps dashboard widgets: Team Health, Cycle Time, and Throughput. Add them to any project dashboard from the widget catalog — they appear under the "Agile Analytics" category. Each widget uses the same team selector and data as the main hub views.

Data & Privacy

What stays in your tenant: Azure DevOps work item content, sprint data, AI prompts and responses, and any AI provider API keys you enter. Baytek never sees any of this.

What Baytek's backend receives: licence records (organisation name, plan, expiry, activation tokens), a lightweight install/heartbeat ping (organisation name, extension version, event type, timestamp), and anonymous usage events (view navigation, configuration completion, trial-day milestones — opt out at Configuration → Privacy). Plus an optional admin email if a trial admin chooses to opt in to milestone reminders.

Optional integrations: when you enable the AI Assistant or webhook notifications, requests go from your browser directly to the AI provider (Anthropic / OpenAI / GitHub Copilot) or webhook URL (Microsoft Teams / Slack) — never via Baytek.

Privacy Policy  |  Terms of Service  |  Support & Feature Requests  |  Getting Started Guide