Sentinel Coder One Studio
Autonomous, multi-provider AI coding for VS Code with a free local Ornith 9B agent, native GPU .npk runtime, 340+ BYO-key cloud/local models, real tools, RAG/Foundry IQ grounding, MCP, inline completions, AI review/PR summaries, media generation, and auditable multi-agent orchestration.
This README is the Marketplace-facing overview. The exhaustive reconciled source of truth is docs/MARKETPLACE_CANONICAL_RECORD.md.
Current Release: 3.24.14
3.24.14 migrates existing installs away from the retired api.qubitpage.com gateway:
- Existing
sentinelCoder.cloud.gatewayUrl=https://api.qubitpage.com settings are automatically migrated to https://qubitpage.com during activation.
- Fixes
getaddrinfo ENOTFOUND api.qubitpage.com for users who installed before the path-based qubitpage.com auth default.
- Keeps the 3.24.13 visible
Sign in / Account Sentinel Cloud buttons and the GitHub Copilot-style browser PKCE login flow.
Previous Release: 3.24.13
3.24.13 adds a visible Sentinel Cloud login path in the chat UI and aligns the web platform auth default with qubitpage.com:
- Added top-bar
Sign in and Account buttons that call the existing GitHub Copilot-style VS Code AuthenticationProvider flow.
- Verified
https://qubitpage.com/sentinel-auth/login returns the Authorize VS Code page.
- Verified
POST https://qubitpage.com/sentinel-auth/start returns { "ok": true } for a PKCE start request.
- Corrected
sentinelCoder.cloud.gatewayUrl default from the stale api.qubitpage.com host to https://qubitpage.com.
Previous Release: 3.24.12
3.24.12 fixes UI mojibake in the Sentinel chat shell and publishes the cleaned Marketplace overview:
- Fixed corrupted Media Studio / Project Studio separator text (
image * video * audio * transcript, checkpoints/tasks/generated assets/file paths).
- Cleaned remaining mojibake from
src/sidebarProvider.ts UI/system strings before compiling the packaged out files.
- Keeps the 3.24.11 canonical Marketplace record and deduplicated overview.
Previous Release: 3.24.11
3.24.11 consolidates the Marketplace description and local package metadata into one deduplicated canonical record:
- Removed the old stacked release-history overview from the Marketplace README.
- Reconciled the live Marketplace 3.24.8-era text with the local 3.24.10 source/manifest state.
- Scanned the extension manifest, source files, media webview files, docs, README, and changelog.
- Normalized provider/tool/setting/command terminology.
- Preserved all unique capabilities while correcting stale or duplicated wording.
- Added docs/MARKETPLACE_CANONICAL_RECORD.md as the master Marketplace/product record.
Production Local Agent
The default local path is ollama:ornith-9b-classic:latest.
- Free, local, private coding agent on a 12 GB GPU class workstation.
- Production runtime settings:
num_ctx=40960, num_batch=512, num_gpu=999, keep_alive=60m.
- VS Code activation can auto-start
ollama serve and warm the model.
- Windows login recovery is supported by
scripts/install-ollama-autostart.ps1.
- Tested by
tests/ornith-9b-production-e2e.cjs: service health, warmup, streaming, long-context recall, function calling, provider tool bridge, RAG fallback, multi-turn coherence, latency, and GPU/RAM snapshots.
Evidence summary: docs/MARKETPLACE_CANONICAL_RECORD.md
Native NeuroPack / NPK Runtime
Sentinel can run .npk models inside VS Code on the GPU without Ollama or an external server.
- Provider:
npk / NeuroPack (native).
- Runtime:
node-llama-cpp, Vulkan GPU backend, NPK2 payload extraction/cache, flash attention, context ladder, RAM/VRAM guards.
- NPK Q8 and Q4 Ornith 9B paths use the same agentic/tool/RAG loop as cloud/Ollama models through a text tool bridge.
- Local model compaction protects NPK from huge persisted chat sessions.
- Tested by
tests/npk-production-e2e.cjs: real huge-session compaction, Q8/Q4 tool engagement, and Q8 coding/reasoning/tool-call behavior.
Evidence summary: docs/MARKETPLACE_CANONICAL_RECORD.md
Core Capabilities
- Agent, Ask, and Plan modes.
- Tool-using autonomous agent loop with file, editor, terminal, git, Docker, SSH, HTTP, browser, RAG, media, and security tools.
- Approval modes: default, bypass, autopilot.
- Plan tracking, checkpoints/undo, diagnostics verification, repeat-call guard, and forced finalization for stuck loops.
- Configurable Agentic Profiles with boss/worker/reviewer pools and cost policies.
- Intelligent orchestration router: direct, delegate, swarm, review, escalate.
- Native Inter-Agent Protocol (NHP-1) with compact handoffs and shared context ledger; measured about 48.6% fewer orchestration tokens.
- Orchestration trace panel with timing, token attribution, escalation, verification, synthesis, and savings events.
- Persistent sessions and live partial-output persistence across switches/reloads.
- Dynamic context injection: active file, open tabs, diagnostics, git state, model/provider metadata.
- Inline completions, AI code review, and PR summary commands.
- Media & Document Studio for Azure Sora 2 video generation,
azure:MAI-Image-2e image generation, Azure gpt-image-2 images, speech, transcripts, screenshots/OCR, Office files, and generated assets.
- RAG plus Microsoft Foundry IQ grounding, with local fallback memory when the RAG server is unavailable.
- MCP servers: filesystem, memory, Brave Search, Postgres, and imported VS Code MCP configs.
- VS Code Web/remote bridge support for browser workspaces with a trusted remote tool host.
- Sentinel Cloud sign-in/account/credits plus bring-your-own-key provider support.
Providers
Sentinel supports local, hosted, and OpenAI-compatible providers:
- Local: Ollama, native NPK.
- Microsoft/Azure: Azure OpenAI / Azure AI Foundry, Azure Foundry Sora 2, Azure Speech, Foundry IQ.
- Cloud APIs: OpenAI, Anthropic, Google/Gemini, Groq, OpenRouter, DeepSeek, Mistral, Together AI, Vultr Inference, Hugging Face, Featherless, Moonshot/Kimi.
- Custom/self-hosted: custom OpenAI-compatible endpoints, QubGPU endpoint, experimental NeuroPack endpoint.
The tool registry includes filesystem, editor, terminal, git, search, web, network, RAG, workspace/media, and security tools. Representative examples:
- Files:
createFile, readFile, inspectFile, editFile, appendFile, deleteFile, listDirectory.
- Editor/workspace:
getActiveFile, getSelection, insertText, getDiagnostics, getOpenTabs, getWorkspaceInfo.
- Terminal/remote:
runCommand, remoteWorkspaceCommand, dockerCommand, sshCommand.
- Search/git:
searchFiles, searchText, codebaseSearch, gitStatus, gitDiff, gitLog, gitCommit, gitPush.
- Web/RAG/MCP-adjacent:
webSearch, httpRequest, queryRAG, ingestRAG.
- Media/documents:
prepareGeneratedWorkspace, discoverMediaModels, generateImage, generateVideo, generateSpeech, transcribeAudio, captureScreenshot, ocrImage, analyzeImage, createOfficeDocument.
- Safety:
firewallScan.
See docs/MARKETPLACE_CANONICAL_RECORD.md for the full deduplicated table with category and danger level.
Commands
Sentinel Coder: Set Ollama Endpoint
Sentinel Coder: Clear Chat History
Sentinel Coder: Refresh Media & Document Studio
Sentinel Coder: Open Media & Document Studio
Sentinel Coder: Review Changes (AI Code Review)
Sentinel Coder: Generate PR Summary
Sentinel Coder: Toggle Inline Completions
Sentinel Coder: Add NeuroPack (.npk) Model from Folder
- Sentinel Cloud sign-in/sign-out/account commands
- Atlas Voice Bridge status/send commands
- VS Code Web/Remote Tool Bridge status/help/configure/test commands
Settings Summary
Important setting groups:
- Local models:
sentinelCoder.ollamaUrl, npkModelsDir, model, ollamaAutoStart, ollamaWarmModelOnStartup, ollamaKeepAlive, ollamaContextWindow, ollamaNumBatch, ollamaGpuLayers.
- Generation/context:
maxTokens, contextBudgetTokens, temperature, defaultMode, approvalMode.
- Providers/secrets:
providers, apiKeysFile, Azure OpenAI resource group/account.
- Inline/GitHub:
inlineCompletions.*, github.reviewModel.
- Terminal safety:
terminalMaxSessions, terminalMinFreeMemoryMb, terminalIdleCleanupSeconds.
- MCP:
mcpServers.
- Dynamic context:
dynamicContext.* plus legacy flat keys for compatibility.
- Web remote bridge:
webRemoteBridgeEnabled, webRemoteBridgeUrl.
- Microsoft IQ / Foundry IQ:
microsoftIq.*.
Quick Start
Local Ornith via Ollama
- Install Ollama from https://ollama.com/.
- Install/link
ornith-9b-classic:latest from the Ornith 9B GGUF package: https://huggingface.co/qubitpage/ornith-9b-classic-gguf.
- Open Sentinel Coder One Studio. The extension can start/warm Ollama automatically when configured.
- Use Agent mode for tool-using local coding.
Native NPK
- Convert or download an
.npk model.
- Run
Sentinel Coder: Add NeuroPack (.npk) Model from Folder.
- Select the NPK model in the picker.
- Use Agent mode for tool/RAG/SSH/file workflows without Ollama.
Converter: https://github.com/msrusu87/npk-converter
Cloud Providers
- Open the Sentinel settings/provider panel.
- Add provider keys; secrets are stored in VS Code SecretStorage where applicable.
- Select Azure/OpenRouter/Groq/OpenAI/etc. models from the live model picker.
Security and Privacy
- Bring your own keys; no provider keys are committed to source.
- Local models keep code on-device.
- Cloud providers receive prompt/tool context only when selected.
- Foundry IQ credentials are read from environment variables and preflighted for bearer/JWT freshness.
- Tool operations carry danger levels and are mediated by approval mode.
- Full terminal/SSH/Docker/MCP/local model tools require a trusted desktop or remote extension host.
Honest Limitations
- Ollama Ornith Q8 uses about 10 GB VRAM after warmup on RTX 3060; one large local model at a time is the safe rule.
- The default production local context is 40K even when model metadata advertises more, because VRAM/RAM safety matters.
- NPK Q8 runtime context is about 16K on this 12 GB GPU.
- Q4 NPK Windows/Vulkan explicit teardown can be unstable; production runtime guards unload and isolated tests avoid crashing the main VS Code host.
- Live vector RAG requires
training/rag_server.py; otherwise local fallback memory is used.
- Pure browser VS Code workspaces need a trusted remote bridge for terminal/SSH/Docker/MCP/local-model tools.
- Hosted cloud agents are not included.
- Ornith 35B NPK-TQ on 12 GB is research-only; measured TQ2 quality is too lossy without new packed-code GPU kernels and layer eval.
Evidence and Reports
Development
npm --prefix d:\QubitDev\vscode-ext run compile
npm --prefix d:\QubitDev\vscode-ext run package
node d:\QubitDev\vscode-ext\tests\ornith-9b-production-e2e.cjs
node d:\QubitDev\vscode-ext\tests\npk-production-e2e.cjs
For isolated extension-host testing without restarting the main VS Code window:
powershell -NoProfile -ExecutionPolicy Bypass -File d:\QubitDev\vscode-ext\scripts\run-extension-devhost.ps1 -Workspace d:\QubitDev
| |