AnythingLLM for VS Code
This extension integrates a locally installed AnythingLLM instance with Visual Studio Code. It offers a lightweight and secure alternative to cloud-based assistants like GitHub Copilot.
The benefit of using this is to save $$ on a chat-bot like ChatGPT's paid version, as well as GitHub Copilot subscription fees and pay as-you-go.
⚙️ Prerequisites
To use this extension, you must:
- Install AnythingLLM and run it locally.
- Set up an LLM provider inside AnythingLLM (e.g., OpenAI GPT-4o).
- Generate your personal AnythingLLM API key.
- Note the local API URL (default:
http://localhost:3001/api
).
- Install this extension in VS Code.
🔧 Configuration
After installation, go to:
Settings > Extensions > Chat UI
Set the following fields:
- API Base URL: (e.g.
http://localhost:3001/api
)
- API Key: Paste your AnythingLLM API token
💬 Usage
- Press
Cmd+Shift+P
or Ctrl+Shift+P
- Search for:
Open AnythingLLM Chat Viewer
- View your workspaces, threads, and chat history in a secure webview
🔐 Security & Privacy
- Your API key is stored locally and never sent externally
- No cloud backend — communication stays between VS Code and your local AnythingLLM instance
🧠 Features
- Visualize all local workspaces and threads from AnythingLLM
- View and scroll chat history with proper formatting and syntax highlighting
- Responsive and clean user interface
- to use agentic mode, configure your agent in anythingllm local application and call the agent in your threads with: @agent (anythingllm hasn't made agents available through APIs yet)
- Supports dark/light themes
📦 Requirements
- AnythingLLM must be installed and running locally
- A valid API key configured with a working LLM provider in AnythingLLM
New version changes:
Workspaces & Thread Management
✅ Support for creating/deleting workspaces and threads.
✅ T+ button added for creating threads directly from UI.
✅ Thread rename and delete options via contextual menu (⋮).
🧪 Development
For contributors:
- Clone the repo: https://github.com/mehrdad-zade/anythingllm-vscode-extension
- Run
npm install
- Launch VS Code Extension host with F5
- Make sure AnythingLLM is running locally on
http://localhost:3001/api
- Test with a valid API key from your AnythingLLM dashboard
📜 License
This project is distributed under a private license and is not intended for commercial redistribution or resale.
👤 Developer
Developed by Mehrdad Alemzadeh
📧 zade.mehrdad@gmail.com