TestPilot AI

AI-powered test case generation, automation scaffolding, self-healing, and JIRA integration — right inside VS Code.

Features

Sidebar UI

TestPilot AI adds a dedicated panel in the VS Code Activity Bar with a React-based interface:

• Input tabs — switch between URL, Source code, Guidelines (acceptance criteria / user stories), and JIRA ticket input
• Add Related Files — provide a path to an existing spec or test file for context-aware generation
• One-click generation — buttons for Test Cases, Selectors, Mock Data, Test Files, or Generate All
• Self-Heal — paste a failing test error and click Heal to auto-fix it in agent mode
• Progress bar — real-time feedback while generation is running
• Output panel — view generated test cases and JIRA ticket details side by side in an editor panel

Chat Participant — @test-pilot-qa

Use TestPilot AI directly in GitHub Copilot Chat:

All commands that produce code run in agent mode so Copilot can write files directly to your workspace.

Multi-Stack Support

Choose your target framework at generation time:

• Default Web — Playwright + Cucumber (TypeScript)
• Default Mobile — WDIO + Cucumber (TypeScript)

Project Scaffolding

The Setup Playwright + Cucumber button (and Test Pilot: Setup Project command) detects your workspace and scaffolds a complete, production-ready framework including:

• Playwright & WDIO driver adapters
• Page Object base classes (BaseActions, BaseSelectors, BaseIdentifiers)
• Cucumber config, tsconfig, and playwright.config.ts
• Allure reporting setup (web + mobile)
• Mobile mock server (json-server + step definitions)
• All required package.json scripts

JIRA Integration

Connect TestPilot AI to your Atlassian JIRA instance to fetch ticket details (summary, description, acceptance criteria) and use them as test generation input — no copy-pasting required.

Requirements

• VS Code 1.103.0 or higher
• GitHub Copilot Chat extension (required)

Getting Started

1. Open the Sidebar

Click the TestPilot AI icon in the VS Code Activity Bar (left sidebar).

2. Generate Test Cases

Via the sidebar:

1. Select an input tab: URL, Source, Guidelines, or JIRA
2. Enter your input (paste a URL, source code, acceptance criteria, or a JIRA ticket ID)
3. Optionally add a related file path in step 2
4. Click Test Cases — test cases appear in the output panel

Via Copilot Chat:

@test-pilot-qa /testcases <your feature spec, source code, or URL>

Attach files with the paperclip button for additional context.

3. Review & Approve Test Cases

Generated test cases appear in the Test Cases tab. Select the ones you want to proceed with.

4. Generate Automation Code

Via the sidebar: Click Test Files or Generate All

Via Copilot Chat:

@test-pilot-qa /lazy-automate

Select Default Web (Playwright + Cucumber) or Default Mobile (WDIO + Cucumber) when prompted. Copilot agent will create the Actions, Feature, and Step files in your workspace.

5. Generate Selectors

@test-pilot-qa /selectors <page URL or component description>

6. Generate Mock Data

@test-pilot-qa /mockdata

Runs against the currently approved test cases.

7. Self-Heal Failing Tests

Via the sidebar:

1. Paste the test error output in the Self Heal section
2. Click Heal

Via Copilot Chat:

@test-pilot-qa /heal <paste your error here>

8. Set Up a New Test Project

Click Setup Playwright + Cucumber in the sidebar, or open the Command Palette and run:

Test Pilot: Setup Project (Playwright + Cucumber)

Select a target folder — TestPilot AI will scaffold the full framework and run npm install automatically.

JIRA Configuration

Open VS Code Settings (Ctrl+, / Cmd+,) and search test-pilot:

Commands

Extension Settings

Known Issues

None at this time. Please report issues on the GitHub repository.

Release Notes

0.0.1

Initial release:

• Sidebar UI with URL / Source / Guidelines / JIRA input tabs
• One-click generation of test cases, selectors, mock data, and test files
• Self-heal section for auto-fixing failing tests
• Output panel with test case review and JIRA detail tabs
• @test-pilot-qa chat participant with /testcases, /lazy-automate, /selectors, /mockdata, /codegen, and /heal commands
• Multi-stack support: Playwright + Cucumber (Web) and WDIO + Cucumber (Mobile)
• Project scaffolding (Test Pilot: Setup Project) with full framework structure
• JIRA integration with configurable credentials

Enjoy testing with TestPilot AI! 🧪✈️