TestFox 🦊

The Final Quality Gate in Your SDLC

TestFox is a comprehensive VS Code extension that serves as the end-of-lifecycle testing solution for your applications. It automatically detects your project type, generates tests across multiple categories following ISTQB standards, and produces detailed interactive test reports with AI-powered insights.

Features

🔍 Automatic Project Detection

• Detects project type (Node.js, Python, Java, Go, .NET, PHP, Ruby)
• Identifies frameworks (React, Vue, Angular, Express, Django, Spring, etc.)
• Reads package.json, requirements.txt, pom.xml, and other config files
• Auto-configures run commands

🧪 Comprehensive Test Categories (18 Types)

TestFox covers the complete testing spectrum aligned with industry standards:

Quick Validation

Functional Testing

Non-Functional Testing

Edge Cases & Special Testing

Manual & Exploratory Testing

🛡️ Security Testing (OWASP/WASP)

• SQL Injection detection
• Cross-Site Scripting (XSS) testing
• CSRF protection verification
• Authentication bypass attempts
• Security headers validation
• Sensitive data exposure checks
• Session management testing
• Broken access control testing

📊 ISTQB-Aligned Testing Techniques

• Boundary Value Analysis (BVA)
• Equivalence Partitioning
• Decision Table Testing
• State Transition Testing
• Use Case Testing
• Error Guessing
• Exploratory Testing

🤖 AI-Powered Features

• Smart Test Generation: AI suggests comprehensive test cases
• Report Summaries: Executive summaries with AI insights
• Risk Assessment: Automatic release readiness evaluation
• Recommendations: Prioritized action items from AI analysis
• Multiple AI Providers: OpenRouter (Grok, Claude, GPT, Llama), OpenAI, Anthropic

📝 Manual Test Support

• Track tests that cannot be automated
• Save and load manual test results
• Mark tests as Pass/Fail/Skip with notes
• Evidence attachment support

📈 Interactive Web Reports

• Beautiful dark-themed dashboard
• Real-time test execution progress
• Category-wise breakdown with charts
• Security findings with severity levels
• Performance metrics visualization
• AI-generated recommendations
• Export to HTML for sharing
• Print-friendly view

SDLC Integration

TestFox is designed to be the final quality gate before release:

┌─────────────────────────────────────────────────────────────────────────┐
│                        Software Development Lifecycle                   │
├─────────────────────────────────────────────────────────────────────────┤
│                                                                         │
│   📋 Requirements    Development    Unit Tests    Code Review           │
│        │                │              │              │                 │
│        ▼                ▼              ▼              ▼                 │
│   ┌─────────────────────────────────────────────────────────────────┐   │
│   │                                                                 │   │
│   │                    🦊 TestFox Quality Gate                      │   │
│   │                                                                 │   │
│   │   ┌─────────────────────────────────────────────────────────┐   │   │
│   │   │  Smoke → Functional → Security → Performance → UAT     │   │   │
│   │   └─────────────────────────────────────────────────────────┘   │   │
│   │                                                                 │   │
│   │   ✓ Automated Testing    ✓ Manual Testing    ✓ AI Analysis    │   │
│   │   ✓ Security Scanning    ✓ Performance Check ✓ Accessibility  │   │
│   │                                                                 │   │
│   └─────────────────────────────────────────────────────────────────┘   │
│                                │                                        │
│                                ▼                                        │
│                          🚀 Release                                     │
│                                                                         │
└─────────────────────────────────────────────────────────────────────────┘

Where TestFox Fits

TestFox is not a unit testing framework - it's the comprehensive system testing phase that validates your entire application before release.

Installation

From VS Code Marketplace

1. Open VS Code
2. Go to Extensions (Ctrl+Shift+X)
3. Search for "TestFox"
4. Click Install

Dependencies

Playwright browsers are automatically installed on first use. If needed, you can install manually:

npx playwright install chromium

Quick Start

1. Open your project in VS Code
2. Click the TestFox icon (🦊) in the Activity Bar
3. Analyze Project: Detects your project type automatically
4. Generate Tests: Creates comprehensive test cases
5. Run Tests: Executes automated tests
6. View Report: Interactive web report with AI insights

Commands

Configuration

Configure TestFox in VS Code settings:

{
  "testfox.autoDetectProject": true,
  "testfox.autoAnalyze": true,
  "testfox.defaultTimeout": 30000,
  "testfox.browserHeadless": true,
  "testfox.reportFormat": "html",
  "testfox.securityTestLevel": "standard",
  "testfox.performanceThreshold": 3000,
  "testfox.loadTestConcurrency": 10,
  "testfox.ai.enabled": true,
  "testfox.ai.provider": "openrouter",
  "testfox.ai.model": "x-ai/grok-beta"
}

AI Configuration

1. Get an API Key: Visit OpenRouter (free tier available)
2. Configure in TestFox:
   • Run command: TestFox: Configure AI Settings
   • Or set testfox.ai.apiKey in settings

Available models include:

• Grok Beta (x-ai/grok-beta) - Fast, capable model Enjoy as long as Mr Musk gives it for free.
• Claude 3.5 Sonnet - Best for complex analysis
• GPT-4o Mini - Fast and affordable
• Llama 3.1 8B (FREE) - Open source option
• Gemma 2 9B (FREE) - Google's efficient model
• Amazon / Qwen / Deepseek / GLP (FREE) - I will plan this soon

Supported Project Types

Requirements

• VS Code 1.85.0 or higher
• Node.js 18+ (for extension development)
• Internet connection (for AI features)
• If you already have an API Key use it or else get it from OpenRouter. Upto 239 Models and 31 of them are free. So just by using a OpenRouter Key you will be able to access all this.

Author

Developed by @senthazalravi

Contributing

Contributions are welcome! Please read our contributing guidelines before submitting PRs.

License

MIT License - see LICENSE file for details.

TestFox - The Final Quality Gate 🦊