TestNeo VS Code Extension
Write NLP test cases in .testneo files and run them from VS Code. Real-time pass/fail results in your editor.
Start in under 2 minutes
- app.testneo.ai → Sign up or log in → create a Project → User (top right) → Profile → Generate API Key → copy the key.
- VS Code → Install the TestNeo extension (Marketplace).
- Settings (Ctrl+, / Cmd+,) → search TestNeo → set API Token (paste key) and API URL =
https://app.testneo.ai.
- Command Palette (Ctrl+Shift+P / Cmd+Shift+P) → TestNeo: Select Project → pick your project by name.
- Open or create a
.testneo file → press Ctrl+Shift+T (or Cmd+Shift+T on Mac) to run. Done.
Dashboard is always app.testneo.ai.
Features
- ✨ AI Test Generation (NEW) — Upload requirements, designs, screenshots → AI generates ready-to-run tests (no other VS Code testing extension has this)
- Natural Language Testing — Write tests in plain English, no code required
- Syntax Highlighting —
.testneo files get full color-coded highlighting
- One-Click Execution — Press
Cmd+Shift+T (Mac) or Ctrl+Shift+T (Windows/Linux) to run
- Real-Time Results — Watch step-by-step execution progress in the output panel
- Cloud & Agent Modes — Run on TestNeo cloud or self-hosted agents for VPN testing
- Dashboard Integration — Click through to full results, screenshots, and video in TestNeo dashboard
- Variables & Metadata — Define reusable variables and test metadata in file headers
🆕 AI Test Generation (NEW)
Upload docs → AI generates tests → Run in VS Code. World-class feature — no competitor has this.
How to Use
Open AI Assistant
Ctrl+Shift+P (or Cmd+Shift+P) → TestNeo: Open AI Assistant
Upload Files (Upload tab)
Click upload zone or drag files: PDFs, screenshots, requirements, designs
Name your context: "Login Requirements" → Upload
Generate Tests (Generate tab)
Select context → Number of tests: 10 → Click Generate Tests
AI analyzes your docs and creates NLP test cases
Save & Run (Generate tab)
Select tests (checkboxes) → Save Selected Tests → Opens in editor
Press Ctrl+Shift+T → Test runs!
What Can You Upload?
- Requirements (PDF, TXT, MD, DOC)
- Screenshots (PNG, JPG, WEBP)
- Design files (Figma exports, mockups)
- API docs, user stories, feature specs
AI understands context across all files and generates production-quality tests with:
- Clear names and descriptions
- Complete NLP steps (Navigate, Click, Type, Verify)
- Smart tags (ai-generated, feature area)
- Proper metadata (priority, generated date)
Generated Tests Example
# Test: Login Flow
# Tags: ai-generated, authentication
# Priority: high
# Generated: 2026-02-07
Navigate to https://app.testneo.ai
Click on "Sign In" button
Type "user@example.com" into email field
Type "password123" into password field
Click "Login" button
Verify "Dashboard" text is visible
Saved to generated-tests/ folder. Run with Ctrl+Shift+T — same as manual tests.
Quick Start
Follow Start in under 2 minutes above. Then use this sample in a .testneo file and run it (Ctrl+Shift+T / Cmd+Shift+T):
Navigate to https://www.saucedemo.com
Type "standard_user" into username field
Type "secret_sauce" into password field
Click login button
Verify "Products" text is visible
Results show in the TestNeo output panel and on app.testneo.ai.
Basic Commands
Navigate to https://example.com
Click login button
Type "hello" into search field
Verify "Welcome" text is visible
Wait 2 seconds
With Variables
@baseUrl = https://example.com
@username = admin
Navigate to {{baseUrl}}
Type "{{username}}" into username field
# Test: My Test Name
# Tags: smoke, regression
# Priority: high
# Agent: my-agent-uuid
Navigate to https://example.com
// This is a comment
# This is also a comment (when not a metadata key)
Settings
| Setting |
Description |
Default |
testneo.apiUrl |
TestNeo API URL (production: https://app.testneo.ai). |
https://app.testneo.ai |
testneo.apiToken |
Your API key from app.testneo.ai → User (top right) → Profile → Generate API Key |
(empty) |
testneo.projectId |
Don't manually set — it's automatic. Click "TestNeo: Select project" in the status bar or run TestNeo: Select Project to pick by name. You never need to look up a project ID. |
0 |
testneo.frontendUrl |
Dashboard URL for "View in dashboard" links. Production: https://app.testneo.ai. |
https://app.testneo.ai |
testneo.defaultAgentId |
Agent UUID for VPN testing (optional) |
(empty) |
testneo.autoShowOutput |
Show output panel on test run |
true |
Commands
| Command |
Shortcut |
Description |
| TestNeo: Run Test |
Cmd+Shift+T |
Run current .testneo file |
| TestNeo: Run Test with Agent |
— |
Run with agent selection |
| TestNeo: Open AI Assistant |
— |
✨ Open AI-powered test generation panel |
| TestNeo: Validate Connection |
— |
Test API token |
| TestNeo: Select Project |
— |
Pick your project by name (recommended) — no need to look up project ID |
How to select a project: Click "TestNeo: Select project" in the status bar (bottom left) or run TestNeo: Select Project from the Command Palette. You'll see a list of all your projects by name — pick one and the extension remembers it. You never need to look up a project ID or type a number. The status bar always shows the current project (e.g. TestNeo: My Project) — click it anytime to switch projects.
Project vs suite: Suites in the dashboard are for organizing tests; the extension runs tests under the selected project.
How It Works
VS Code Extension (Thin Client)
│
│ HTTPS (REST API + SSE)
│
▼
TestNeo Backend (Cloud)
│
├── Cloud Execution (browser on TestNeo infrastructure)
└── Agent Execution (browser on your machine/VPN)
The extension is a thin client — all test intelligence (NLP parsing, element location, visual AI) runs on the TestNeo backend. Tests created from VS Code appear in your TestNeo dashboard alongside tests created from the web UI.
Requirements
License
MIT
