TestFox 🦊

🌟 What is TestFox?

TestFox is a comprehensive VS Code extension that automatically generates and executes tests across 20+ test categories for applications written in any programming language. It combines rule-based test generation with AI-powered intelligence to ensure your code is production-ready.

✨ Key Highlights

• 🌍 Multi-Language Support: JavaScript, TypeScript, Python, Java, C, C++, Rust, Go, .NET, PHP, Ruby
• 🤖 AI-Powered: Use FREE or PAID AI models from 15+ providers
• 🧪 20+ Test Categories: Smoke, Functional, Security, Performance, Accessibility, Backend, Payment, and more
• 💳 Payment Testing: Stripe, PayPal, Braintree integration tests
• ⚙️ Backend Testing: State Integrity, Concurrency, Reliability, Idempotency, Webhooks
• 📊 Interactive Reports: Beautiful web-based dashboard with real-time results
• 🔒 Security Testing: OWASP Top 10 vulnerability detection
• ♿ Accessibility: WCAG 2.1 compliance checking
• ⚡ Performance Optimized: Fast extension activation and instant UI loading

🚀 Supported Languages & Frameworks

TestFox automatically detects your project type and generates appropriate tests:

AI Providers & Models - Comprehensive Support

TestFox integrates with 8 AI providers, giving you access to 300+ AI models from major providers. Choose FREE models or paid options based on your needs.

Quick Setup

Free AI Models (No Credit Card Required!)

OpenRouter Models (239+ Available)

Direct Provider Models

Local Models (Self-Hosted)

Premium AI Models

Authentication Methods

API Key Authentication

• OpenRouter: Get free key at OpenRouter.ai/keys
• Google Gemini: Get key at Google AI Studio
• DeepSeek: Get key at DeepSeek Platform
• Amazon Nova: Get key at AWS Console OR use NOVA_API_KEY environment variable
• Nvidia NIM: Get key from your Nvidia NIM deployment
• BYO API: Use your custom OpenAI-compatible endpoint

Local Authentication

• Ollama: No authentication required (local)
• LM Studio: No authentication required (local)

Environment Variable Support

Getting Started with AI

1. Choose Your Provider: Select from 8 supported providers in TestFox settings
2. Free Models Available: OpenRouter, Google Gemini, DeepSeek offer free tiers
3. Local Options: Ollama, LM Studio for offline privacy
4. Enterprise Options: Amazon Nova, Nvidia NIM for corporate environments
5. Configure in TestFox: Click "AI Config" in Test Control Center
6. Select Model: Choose from 300+ available models
7. Start Generating: Begin AI-powered test creation immediately!

Provider Recommendations

Test Categories (20+ Types)

TestFox covers the complete testing spectrum aligned with ISTQB standards:

🚦 Quick Validation

⚙️ Functional Testing

🛡️ Non-Functional Testing

🔧 Backend Testing (10 Categories)

💳 Payment Testing (4 Categories)

🎯 Edge Cases & Boundaries

👤 User Account Testing

🛡️ Security Testing (OWASP Top 10)

TestFox performs comprehensive security analysis:

• ✅ SQL Injection - Detects database vulnerabilities
• ✅ Cross-Site Scripting (XSS) - Input/output sanitization
• ✅ CSRF Protection - Token verification
• ✅ Authentication Bypass - Login security
• ✅ Security Headers - CSP, HSTS, X-Frame-Options
• ✅ Sensitive Data Exposure - API key leaks, passwords
• ✅ Session Management - Cookie security
• ✅ Broken Access Control - Authorization checks

� Backend Testing Suite

Comprehensive backend validation for distributed systems and APIs:

Test Coverage

💳 Payment Testing Suite

Complete payment integration testing for e-commerce applications:

Supported Providers

• Stripe - 3D Secure, webhooks, idempotency
• PayPal - Checkout, subscriptions, disputes
• Braintree - Hosted fields, vault, fraud protection

Test Coverage

� Interactive Reports Dashboard

Generate beautiful, interactive web reports with:

• 📈 Real-time Progress - Live test execution updates
• 📊 Category Breakdown - Pie charts and statistics
• 🔴 Security Findings - Severity levels and recommendations
• ⚡ Performance Metrics - Response times visualization
• 🤖 AI Insights - Intelligent recommendations
• 📄 Export Options - HTML, PDF-ready printing

🔧 Quick Start

Installation

1. Open VS Code
2. Go to Extensions (Ctrl+Shift+X)
3. Search for "TestFox"
4. Click Install

First Run

1. Click the 🦊 TestFox icon in the Activity Bar
2. Click "AI Config" to set up your API key (optional)
3. Click "Analyze Project" to detect your project
4. Click "Generate Tests" to create test cases
5. Click "Run Tests" to execute
6. Click "View Report" for results

💻 Commands

⚙️ Configuration

Configure TestFox in VS Code settings (Ctrl+,):

🤖 AI Provider Configuration

{
  "testfox.ai.enabled": true,
  "testfox.ai.provider": "openrouter",
  "testfox.ai.model": "google/gemini-2.0-flash-exp:free",
  "testfox.ai.apiKey": "",
  "testfox.ai.baseUrl": "https://openrouter.ai/api/v1"
}

📋 Available AI Providers

🔧 Environment Variables

🎯 Model Selection Examples

// OpenRouter (239+ models)
{
  "testfox.ai.provider": "openrouter",
  "testfox.ai.model": "google/gemini-2.0-flash-exp:free"
}

// Amazon Nova
{
  "testfox.ai.provider": "amazon-nova",
  "testfox.ai.baseUrl": "https://api.nova.amazon.com/v1",
  "testfox.ai.model": "nova-2-lite-v1"
}

// Local Ollama
{
  "testfox.ai.provider": "ollama",
  "testfox.ai.baseUrl": "http://localhost:11434",
  "testfox.ai.model": "llama3.1:8b"
}

🚪 Full Configuration Example

{
  "testfox.ai.enabled": true,
  "testfox.ai.provider": "openrouter",
  "testfox.ai.model": "google/gemini-2.0-flash-exp:free",
  "testfox.ai.apiKey": "your-api-key-here",
  "testfox.ai.baseUrl": "https://openrouter.ai/api/v1",
  "testfox.ai.fallbackModel": "meta-llama/llama-3.1-8b-instruct:free",
  "testfox.browserHeadless": true,
  "testfox.defaultTimeout": 30000,
  "testfox.securityTestLevel": "standard",
  "testfox.performanceThreshold": 3000,
  "testfox.automation.enabled": true,
  "testfox.automation.interval": "1h"
}

📚 ISTQB-Aligned Testing Techniques

TestFox implements industry-standard testing methodologies:

• ✅ Boundary Value Analysis (BVA)
• ✅ Equivalence Partitioning
• ✅ Decision Table Testing
• ✅ State Transition Testing
• ✅ Use Case Testing
• ✅ Error Guessing
• ✅ Exploratory Testing

🏗️ SDLC Integration

TestFox serves as the final quality gate before release:

┌─────────────────────────────────────────────────────────────────┐
│                    Software Development Lifecycle               │
├─────────────────────────────────────────────────────────────────┤
│                                                                 │
│  📋 Requirements → 💻 Development → 🧪 Unit Tests → 👀 Review │
│                                                                 │
│                            ↓                                    │
│  ┌────────────────────────────────────────────────────────────┐ │
│  │                                                            │ │
│  │              🦊 TestFox Quality Gate                      │ │
│  │                                                            │ │
│  │  ✓ Smoke → Functional → Security → Performance → UAT       │ │
│  │  ✓ Backend → Payment → AI-Powered Analysis                │ │
│  │  ✓ 20+ Test Categories    ✓ Multi-Language Support        │ │
│  │  ✓ MCP Servers            ✓ Interactive Reports            │ │
│  └────────────────────────────────────────────────────────────┘  │
│                            ↓                                     │
│                      🚀 Release                                 │
│                                                                 │
└─────────────────────────────────────────────────────────────────┘

🔌 MCP Servers (Model Context Protocol)

TestFox integrates with MCP Servers for AI-powered test automation:

Available MCP Servers

MCP Features

• 🤖 AI-Powered Test Generation - Generate tests using natural language
• 🎭 Playwright Integration - Automated browser testing
• 📮 API Testing - REST/GraphQL endpoint validation
• 🔧 DevTools Analysis - Performance and network insights
• 🚀 One-Click Execution - Run all MCP tests from control panel

📋 Requirements

• VS Code 1.85.0 or higher
• Node.js 18+ (for test execution)
• Internet (for AI features - optional)

🤝 Contributing

Contributions are welcome! Please visit our GitHub repository.

GitHub: github.com/senthazalravi/TestFox

👨‍💻 Author

Developed with ❤️ in Stockholm, Sweden

• Twitter/X: @senthazalravi
• Email: ravi.antone@gmail.com

🙏 Support the Project

• ⭐ Star us on GitHub
• 📝 Write a review on the VS Code Marketplace
• 💬 Share with your developer friends
• 💰 Sponsor our LLM credits and infrastructure

📄 License

MIT License - see LICENSE file for details.