Skip to content
| Marketplace
Sign in
Visual Studio Code>Machine Learning>AnyLLM GatewayNew to Visual Studio Code? Get it now.
AnyLLM Gateway

AnyLLM Gateway

Gius.Marci

|
9 installs
| (0) | Free
Universal LLM gateway for Factory Droid with multiple model support
Installation
Launch VS Code Quick Open (Ctrl+P), paste the following command, and press enter.
Copied to clipboard
More Info

AnyLLM Gateway

Universal LLM gateway for Factory Droid with multi-model support

A VS Code extension that provides a unified interface for managing and routing LLM requests across multiple AI providers through custom endpoints.

Access 700+ AI models from various providers including OpenAI, Anthropic, Google, Meta, Mistral, and more. Special thanks to models.dev by OpenCode for making their comprehensive model directory freely available to everyone.

What is AnyLLM Gateway?

AnyLLM Gateway acts as a local API server that routes requests to any LLM provider you configure. Perfect for Factory Droid integration, it allows you to:

  • Browse 700+ models from top AI providers in the integrated Providers tab
  • Connect to any LLM API (OpenAI, Anthropic, Claude, custom endpoints)
  • Switch between models with a single click
  • Store API keys securely using VS Code's encrypted storage
  • Create custom Droid Flow for tool-specific model routing
  • Run a local server that Factory Droids can connect to

Key Features

🌐 700+ AI Models Directory

  • Browse and explore 700+ models from top providers (OpenAI, Anthropic, Google, Meta, Mistral, and more)
  • Real-time model information including pricing, context limits, and capabilities
  • Integrated search and filtering to find the perfect model
  • Bookmark your favorite models for quick access
  • Powered by models.dv by OpenCode - freely available model directory for everyone

🌊 Droid Flow (Advanced)

  • Route specific Factory tools like write, read, list, web search and more to specific models
  • Create multiple flow configurations
  • Activate/deactivate flows on demand
  • Perfect for optimizing cost and performance

🔐 Secure API Key Management

  • Store multiple API keys with friendly names
  • Encrypted storage using VS Code Secrets API
  • All data stored locally on your machine
  • Reference stored keys when creating endpoints

🤖 Custom Endpoints

  • Add any OpenAI-compatible or Anthropic API endpoint
  • Configure base URLs, models, and providers
  • Quick edit and delete options
  • Bookmark favorite models

🔧 Factory Droid Integration

  • One-click config generation
  • Copy-paste setup for .factory/config.json
  • Local API server on configurable port
  • Auto-route requests to your selected model

🎨 Clean, Modern UI

  • Dark-themed dashboard
  • Model search and filtering
  • Bookmark system
  • Visual model selection

Quick Start

  1. Add your first API key

    • Open the dashboard sidebar (routing icon)
    • Go to Settings tab
    • Add your API key from any of the providers you'll use
  2. Create a custom endpoint

    • Go to Models tab or select one from the providers
    • Click "Add Endpoint"
    • Enter your model details and select your stored API key or add a new one
    • Save the endpoint
  3. Select your model

    • Click on any model card to select it
    • The "active" badge appears on selected models, Droid will now use that model.
  4. Integrate with Factory Droid

    • Go to Settings tab
    • Click "Copy Droid Config to Clipboard"
    • Paste into your .factory/config.json
    • Start Factory Droid

Use Cases

  • Multi-Model Development: Quickly switch between models for testing
  • Cost Optimization: Route different tools to cost-effective models
  • Provider Flexibility: Not locked into a single provider
  • Local Testing: Test AI workflows locally before deployment
  • Secure Key Management: Keep all credentials local and encrypted

Support

  • Issues: Report bugs or request features on my X account https://x.com/GiusMarci
  • Community: Built as a free community project

Made with ❤️ for the Factory Droid community

  • Contact us
  • Jobs
  • Privacy
  • Manage cookies
  • Terms of use
  • Trademarks
© 2025 Microsoft