NVIDIA NIM Agent for VS Code

Direct access to NVIDIA NIM reasoning models inside GitHub Copilot Chat. No proxy servers in between.

Install • Documentation • Contributing • Supported Models • Quick Start • FAQ • Commands

NVIDIA provides free API on build.nvidia.com. You can run DeepSeek V4, Nemotron, GLM, and Kimi directly inside Copilot without any monthly provider subscription.

Why NVIDIA NIM Agent?

The extension routes Copilot Chat to NVIDIA NIM models with automatic failover, reasoning controls, agent-mode tool support, and a status bar that shows live token use.

Key Features

Reasoning controls. Collapsible thinking blocks via VS Code's LanguageModelThinkingPart, plus per-turn effort control from None to Max in the Copilot model dropdown.

Failover. When the active model returns 429, 404, 410, an empty stream, or a timeout, the same prompt is rerouted to a backup. A configurable fallback.priorityList is tried first; text requests fall back to Nemotron 3 Super 120B and image requests to Muse Glimmer by default. The next turn retries the original model.

Repetition guard. Detects degenerate "Let me fix..." output loops mid-stream and ends the turn cleanly instead of spinning forever.

Tool calls. A single streaming tag-stack XML scanner handles OpenAI JSON, XML control blocks, and Hermes/Anthropic-style tags. Malformed arguments are auto-repaired through jsonrepair, and consecutive duplicate read-only calls are suppressed.

Context auto-compaction. Long sessions get compacted in the background by a dedicated model so you don't hit HTTP 400 Context Window Exceeded.

Status bar & diagnostics. Token utilization in the status bar, prompt/completion counts in Copilot's context window widget, and millisecond TTFT logs when debug logging is on.

Supported Models

The extension connects to official NVIDIA NIM endpoints (https://integrate.api.nvidia.com/v1) and ships per-model adapters.

Intelligence Index values are from the Artificial Analysis Intelligence Index (v4.3.2 verified; see CHANGELOG.md).

Documentation & Settings

The full settings.json reference, failover policies, network parameters, and agentic tool configuration live in the dedicated guide:

Full Documentation & Configuration Guide (docs/README.md)

Quick Start

1. Install

• Install from the VS Code Marketplace, or
• Quick Open (Ctrl + P / Cmd + P): ext install neuraldock.nvidia-nim-agent

2. Requirements

• VS Code 1.125.0 or later
• GitHub Copilot, installed and signed in
• An NVIDIA NIM API key (free credits at build.nvidia.com)

3. Configure Your API Key

1. Open Copilot Chat (Ctrl + Alt + I / Cmd + Alt + I).
2. Click the model selector dropdown, then Manage Models, then NVIDIA NIM.
3. Paste your key (nvapi-...).

Alternatively, run NVIDIA NIM: Manage NVIDIA NIM API Key from the Command Palette.

4. Start Chatting

Pick any NVIDIA NIM model in Copilot Chat or Copilot Agent Mode.

5. Autonomous Workflows (VS Code Agents Window)

NVIDIA NIM models work natively in VS Code's dedicated Agents window (chat.agentHost) for autonomous multi-step coding sessions, file editing, and terminal tasks.

To enable BYOK models for the agent host:

1. Open settings.json (Preferences: Open User Settings (JSON) in Command Palette).
2. Add:

   "chat.agentHost.byokModels.enabled": true
   

3. Recommended settings for heavy agent sessions:
   • Recommended Models: z-ai/glm-5.3 or moonshotai/kimi-k3 for multi-step reasoning and deep codebase context.
   • TTFT Timeout: Set "nvidia-nim.fallback.firstTokenTimeoutSeconds": 120 (or 180) to allow NVIDIA NIM time for KV-cache prefill on large prompts with multiple MCP tools.
   • Idle Watchdog: "nvidia-nim.network.streamIdleTimeout": 120 (or 180) ensures stalled streams are cleanly aborted and failed over.
   • Failover Restarts: "nvidia-nim.fallback.maxChainRestarts": 2 automatically retries the model chain with backoff if upstream endpoints hit transient 503/529 overload.

Extension Commands

Open the Command Palette (Ctrl + Shift + P / Cmd + Shift + P).

Privacy & Security

All requests go directly from your VS Code client to the official NVIDIA NIM API at https://integrate.api.nvidia.com/v1. There are no third-party telemetry endpoints or proxy gateways. The API key is encrypted in VS Code's OS-level SecretStorage. The extension stores no chat logs, file contents, or personal credentials.

Frequently Asked Questions

Q: Do I need a paid NVIDIA subscription?

A: No. NVIDIA provides free API on build.nvidia.com for developers.

Q: Does it work with Copilot Agent Mode and Tools?

A: Yes. The supported chat models are tool-capable and support autonomous file editing, terminal execution, and MCP tools with automatic JSON repair.

Development

Prerequisites

• Node.js (>=20) and npm

Install dependencies

npm install

Build the extension

npm run compile   # produces the compiled output in ./out

Run the test suite

npm test          # runs Jest; all tests should pass

Create a VSIX package (for local installation)

npm run package:vsix   # compiles then packages the extension

The resulting .vsix file can be installed via Extensions → Install from VSIX… in VS Code.

Support

If this extension saves you time and makes working with NVIDIA NIM in Copilot Chat smoother, you can support its maintenance on Ko-fi.

License

MIT