LiteLLM Chat Provider for Visual Studio

Use 100+ LLMs in Visual Studio with a built-in chat window powered by LiteLLM. Multi-server support, streaming SSE, function calling, reasoning tokens, multimodal input, dashboard, status-bar context indicator.

Features

• 100+ LLMs through a unified OpenAI-compatible API (OpenAI, Anthropic, Google, AWS, Azure, Ollama, vLLM, sglang, and any OpenAI-compatible endpoint)
• Multi-server support — connect to multiple LiteLLM servers simultaneously and aggregate models across all of them
• Streaming chat completions via Server-Sent Events (SSE)
• Tool / function calling support, including a fallback parser for backends that stream raw tool-call syntax as plain text (Hermes/Qwen chat templates)
• Reasoning / thinking tokens (GLM / DeepSeek-R1 / o1-style reasoning_content)
• Automatic retry with smaller chunks when a response is truncated by the token limit
• Dashboard tool window for servers, models, and per-model enable/disable
• Status bar showing live server + model counts and a context-window indicator
• Per-model request parameter overrides (glob pattern → params, e.g. { "zai-org/GLM-5.2-FP8*": { "max_tokens": 50000 } })
• API key encryption via Windows DPAPI

Differences from the VS Code extension

This is the Visual Studio port of the litellm-vscode-chat VS Code extension.

Visual Studio (unlike VS Code) exposes no API for third-party extensions to register custom language model providers into the Copilot Chat panel. So instead of plugging into Copilot Chat, this extension ships its own WPF chat window that talks directly to LiteLLM — same streaming, tool-calling, reasoning, and retry behavior.

Requirements

• Visual Studio 2022 (17.0+) or Visual Studio 2026
• .NET Framework 4.8
• Visual Studio SDK workload component
• A running LiteLLM proxy (self-hosted or cloud)

Quick Start

1. Open View → Other Windows → LiteLLM Chat.
2. Open View → Other Windows → LiteLLM Dashboard and add a server (label, base URL, API key).
3. Pick a model in the chat window's model dropdown and start chatting.

Privacy

Your prompts and completions travel only between Visual Studio and the LiteLLM servers you configure. No telemetry, no third-party calls.