SOFEE VS Code Extension
IDE companion for Sofee-Eye in VS Code, Cursor, and IBM Bob (including Remote-SSH). Sidebar dashboard tabs: Login · Setup · Evals · Tasks · MCP Trace.
Features
Login
- Sign in to Sofee-Eye (username/password or auth token in Secret Storage)
- Pick the project to work with (internal name /
project_uid, industries, eval-run status)
- Sticky project selector on Setup, Evals, Tasks, and MCP Trace
Setup
- Search 2.0 / 3.0 orchestration for the active project (workspace rules + Cline MCP
X-Sofee-Search-Orchestration header)
- Test search in use against the project MCP URL (
investigate, instructions, Cline header, workspace rules)
- SOFEE MCP: Traefik
/mcp URL follows the selected project; Test connection; sync into cline_mcp_settings.json
- IDE profile auto-detect (VS Code / Cursor / IBM Bob / Cline)
- Agent skills & rules: materialized vs deployed status; Install / Refresh into the open workspace
Evals
- Pending / running / completed eval runs for the selected project
- Execute next / all (eval-host guard, git worktree, MCP ON/OFF, agent-pack deploy, trace upload)
- Take over
AWAITING_HUMAN runs (vscode://sofeei.sofee-evals-vscode/takeover?runId=…)
- Cline/Bob automated adapters; Cursor/VS Code clipboard + agent-chat adapters
Tasks
- List Sofee Task Manager tasks for the selected project (default: Show in IDE (VS Code); optional show-all)
- Execute here: inject the task into the active coding agent (Plan or Act), optional Submit immediately
- Open Task Manager in Sofee-Eye
MCP Trace
- Optional Agent job (MCP Trace only — not a Task, eval, or IDE agent task): snapshot workspace rules/skills, Start / Stop, ingest to Sofee-Eye
- Session timeline of MCP tool calls; refresh latest; ingest session to Allcode
- Search Trace: refresh latest plan, View MCP Search Trace panel (lanes, timings, call graph), ingest to Sofee-Eye
- Toolbar command SOFEE: View MCP Search Trace (
sofeeEvals.searchTraceEnabled)
Also
- Flashing SOFEE MCP NOT AVAILABLE warning when the project MCP is down or Cline is disconnected
- Reload Window prompt after a local VSIX install so the new build actually loads
Release history
Newest first. Each version lists what was added (and any important fix) so Marketplace Details stay scannable.
Fixed
- Activity bar icon no longer renders as a solid white circle (transparent background; Korben mascot silhouette)
- Login tab shows logged in again — connection check uses
/projects instead of the retired unbounded eval-runs list
Added
- Install / Refresh enabled for VS Code profile; skills deploy to both
.cline/skills/ and .cursor/skills/
- Re-check status opens a markdown inventory beside the dashboard: each rule/skill in Sofee, install state, and paths
- Marketplace icon (
sofee-mascot-128.png) restored from the Sofee app logo
v0.2.58 — ADHD skill + Cursor Agent skills deploy
Added
- Core pack skill adhd (parallel divergent ideation) deploys with the rest of the agent skills
- Install / Refresh also writes
.cursor/skills/<name>/SKILL.md so Cursor Agent can invoke /adhd (and the other pack skills)
- Dashboard lists Cursor skills on disk; Install / Refresh is enabled for the Cursor IDE profile
v0.2.57 — MCP Trace no longer fakes investigate→search pipelines
Fixed
- Unrelated searches close in time (e.g. Test
investigate on invoicing, then Cline search_code on waybill) are split into separate requests instead of one misleading call graph
- Orphan trace clustering uses query relatedness + a tighter idle window
v0.2.56 — MCP Trace shows original request query
Added
- Request picker and request card show the original query (e.g. “where is invoicing”, “what is a waybill?”) immediately
- MCP calls table includes a Query column; selected call highlights query at the top
v0.2.55 — Search 3.0 Test / config alignment
Fixed
- Test search in use uses a soft
investigate deadline + smaller top_k so heavy stacks no longer time out as “MCP unreachable”
- Effective Search version prefers Eye project setting over a stale global default (override still wins)
- Apply Search 2.0/3.0 also updates the Eye project setting and adds
investigate to Cline autoApprove for 3.0
- Diagnostics include
project_id, Eye/effective/MCP-reported versions
Related (MCP)
- Initialize instructions follow
X-Sofee-Search-Orchestration per request (no MCP restart to switch 2.0↔3.0)
investigate gathers module context for conceptual/business/definition questions; pattern searches respect a time budget
v0.2.54 — Marketplace Features lists all dashboard capabilities
Changed
- Readme Features section now covers Login, Setup, Evals, Tasks, and MCP Trace (plus Search 2.0/3.0, MCP warning, takeover)
- Marketplace short description includes Tasks and MCP Trace (were missing from the previous eval-centric blurb)
v0.2.53 — Test search in use uses project MCP URL
Fixed
- Test search in use now probes the effective project MCP URL (same as Setup / Refresh), not only the raw setting
- Timeout / unreachable errors include the URL that was probed
- No longer reports “investigate tool missing” when MCP never answered
- Cline settings discovery also checks
~/.cline/data and /data/vscode-server/data
v0.2.52 — Agent job labeled as MCP Trace–only
Changed
- MCP Trace tab: heading is bold Agent job (optional); copy clarifies an agent job is strictly an MCP Trace concept (not a Task, eval, or IDE agent task)
v0.2.51 — MCP Trace times in local timezone
Fixed
- MCP Trace / Search Trace timestamps (session opened, request When, call When, agent job started) now show in the user’s local time, not raw server UTC
v0.2.50 — Search “Test search in use” always visible
Fixed
- Setup → Search button sat in a crowded wrap row and the dashboard webview could keep pre-0.2.49 HTML after a plugin restart
- Toolbar Refresh and showing the SOFEE view now rewrite the dashboard shell when that button is missing
v0.2.48 — Test actual Search in use
Added
- Setup → Search: Test search in use (next to Open in Sofee-Eye) probes live MCP instructions,
investigate, Cline header, and workspace rules vs the selector
v0.2.47 — Search 3.0 actually reaches Cline
Fixed
- Switching Search 3.0 now applies immediately (workspace
.clinerules + Cline MCP X-Sofee-Search-Orchestration header)
- Dashboard Refresh / project switch keep that header on the matching Cline server (e.g. Sofee 10xOne)
- Setup shows a warning when the open folder still has Search 2.0 rules (
always-routing.md / missing always-search-orchestration.md)
v0.2.46 — Red MCP warning when Cline is disconnected
Fixed
- Flashing SOFEE MCP NOT AVAILABLE tab now opens in the active editor and steals focus (it was created beside the current file without focus, so it was easy to miss)
- Warning returns on the next health check if you close it while MCP is still down
- Cline fetch failed is treated as MCP unavailable even when SOFEE’s own HTTP initialize still succeeds (dashboard was showing MCP OK)
v0.2.40 — MCP Session / Agent Job timeline (vertical slice)
Added
- MCP Trace tab: Start/Stop job (workspace rules snapshot), latest session timeline, ingest job/session to Sofee-Eye
- Design:
sofee-eye/docs/Sofee_MCP_Agent_Job_Session.md
- Allcode → MCP Sessions catalog + pull-from-MCP
v0.2.39 — MCP Trace empty-buffer handling
Fixed
- Refresh latest MCP Trace no longer shows a hard error when the project MCP has no traces yet (empty buffer)
- Prefer Traefik
…/mcp/search-traces… URL (sibling /search-traces is not routed on typical project stacks)
v0.2.38 — Release history catch-up
Changed
- Documented v0.2.33–v0.2.37 in this release history (Search Trace / MCP Trace, reload-after-install)
v0.2.37 — MCP Trace tab
Changed
- Moved Search Trace UI out of Setup into a dedicated last tab: MCP Trace (after Tasks)
- Dashboard tabs are now Login · Setup · Evals · Tasks · MCP Trace
- Tab labels use MCP Trace (extension setting key remains
sofeeEvals.searchTraceEnabled)
v0.2.36 — Reload after VSIX install
Added
- After a local VSIX install, prompt Reload Window when extension files on disk are newer than the running build (stamp file + package mtime watch)
- Webview
dashboard.js cache-bust (?v=…) so reload picks up UI script changes
- Sidebar dashboard keeps context when hidden (
retainContextWhenHidden)
Fixed
- Installing a new VSIX no longer looks like a no-op while the old extension host stays in memory — toolbar Refresh only reloads Sofee-Eye data, not extension code
v0.2.35 — View MCP Search Trace panel
Added
- View MCP Trace opens a dedicated webview (lanes, timings, hit summary) for the latest MCP search plan
- Toolbar command SOFEE: View MCP Search Trace
- Dashboard toggle Search Trace ON (extension) (
sofeeEvals.searchTraceEnabled) — controls Refresh / Ingest / eval harvest without stopping MCP server capture
- Ingest from the View panel into Sofee-Eye Allcode Search Trace
v0.2.34 — Search Trace in dashboard + eval harvest
Added
- Setup section: Refresh latest Search Trace / Ingest to Sofee-Eye against the project MCP
searchTraceClient: fetch latest plans from MCP, format summary, POST into Sofee-Eye
- After MCP ON eval runs, harvest Search Traces when the matrix create search traces flag is set
v0.2.33 — Release history refresh
Changed
- Readme release notes reorganized (newest first, scannable Marketplace Details)
v0.2.32 — Tabbed dashboard + Tasks “Execute here”
Added
- Dashboard tabs: Login · Setup · Evals · Tasks (replaces the single long scroll of sections 1–6)
- Sticky project to work with selector on Setup, Evals, and Tasks (full picker stays on Login)
- Tasks tab: lists tasks for the selected project (default: only those with Show in IDE (VS Code))
- Execute here on each task: confirm Plan/Act mode, inject task description into the active agent input, optional Submit (execute) immediately
v0.2.31 — Clearer project tile + Jump to Evals
Added
- Jump to Evals on the selected project tile
- Separate Industry/ies and Eval runs status lines on the project tile
Changed
- Simplified sign-in UI (removed the multi-step sign-in details panel)
v0.2.30 — Reachable MCP host + Cline path fix
Added
- Loopback rewrite for MCP URLs (
localhost / 127.0.0.1 → LAN host from Sofee-Eye web URL or existing Cline entries)
- Broader discovery of
cline_mcp_settings.json across VS Code and Cursor data roots
Fixed
- Auto MCP server-name when SOFEE runs in Cursor but Cline storage is under VS Code
- Clearer Test MCP errors (underlying fetch cause codes)
v0.2.29 — Project UID + auto Cline server name
Added
- Project tile Internal name (
project_uid, e.g. pjtxrlvgrcojwqh)
- Auto-resolve MCP Server Name from
cline_mcp_settings.json (by Traefik runtime URL, then project name) into sofeeEvals.sofeeMcpServerName
- Targeted Cline sync for that server’s URL (and related Sofee entries for the same runtime) without rewriting other projects’ MCP servers
v0.2.28 — Sync MCP URL into Cline settings
Added
- On Save MCP / project change: write the active project Traefik MCP URL into Cline’s global
cline_mcp_settings.json
- Targeted updates for preferred server name, same-runtime Sofee entries, and stale previous URLs
- Cline storage path resolution via extension
globalStorage (Remote-SSH / Cursor / VS Code)
v0.2.27 — MCP URL follows selected project
Added
- Selected project’s Traefik
/mcp URL drives the dashboard and MCP ON (instead of a stale global sofeeEvals.sofeeMcpUrl)
- Auto-heal on refresh / project change when the global MCP URL points at another runtime
- MCP section shows selected project + active project MCP URL (source:
project)
v0.2.26 — MCP test connection hardening
Fixed
- Test MCP tolerates a failed Sofee-Eye API connection when resolving / probing the MCP endpoint (no longer throws when the API client is unavailable)
v0.2.25 — Eval-host guard + run takeover
Added
- Eval-host guard: automated run execution only on the Sofee eval host (Remote-SSH + repo path); otherwise directs you to queue runs in Sofee-Eye
- Takeover URI:
vscode://sofeei.sofee-evals-vscode/takeover?runId=… opens a running eval for monitoring/takeover on the eval host
- Takeover and host-check wiring in the trace / run executor path
v0.2.24 — Marketplace branding as “SOFEE”
Added / Changed
- Marketplace / Extensions display name SOFEE (was “SOFEE Evals”)
- Product naming aligned across commands, dashboard, and docs
v0.2.23 — Cline slash-skills deploy layout
Added
- Flattened skill deploy path:
.cline/skills/<name>/SKILL.md (layout Cline expects for / slash skills)
- Post-deploy discovery + hint to Refresh Skills in the Cline UI
v0.2.22 — Projects root from Sofee-Eye
Added
sofeeEvals.projectsRoot auto-detect from Sofee-Eye installation-info / agent-files API (leave empty)
- Dashboard action to Save the server-reported projects root locally
- Agent pack uses resolved projects root for local copy when the folder exists on this machine
v0.2.21 — Agent pack status via Sofee-Eye API
Added
- Server-side materialization check via Sofee-Eye project agent-files API (works when
projects/ is only on the eval server)
- Refresh re-queries materialization + workspace deploy state
- Clearer status labels: materialized / deploy to workspace / partial
v0.2.20 — MCP URL resolve + connection test
Added
- MCP URL resolver: Traefik public URL from active project runtime; warns when URL looks like Sofee-Eye
:8000 / :5173
- Dashboard Test MCP connection (streamable-HTTP
initialize)
- Effective URL for MCP ON / toggle prefers resolved project URL when configured URL is empty or mis-set
v0.2.19 — Agent pack status in dashboard
Added
- Dashboard section 5: whether Cline rules and skills are materialized in the project and deployed in the open workspace, with counts and Install / Refresh
- Sofee-Eye agent pack status table (rules, skills, project path, central pack reference)
Earlier releases (before v0.2.19)
v0.2.18 — Matrix-level agent pack opt-out
- Per-matrix Skip agent skills & rules deploy in Sofee-Eye; runs inherit
skip_agent_pack_deploy
- Global
sofeeEvals.skipAgentPackDeploy still skips deploy for all runs
v0.2.17 — Agent skills & rules deploy
- Install / Refresh Agent Skills & Rules into the open Cline workspace
- Eval auto-deploy after worktree creation (opt out: matrix setting or
sofeeEvals.skipAgentPackDeploy)
- Optional
sofeeEvals.projectsRoot
v0.2.16 — Reliable Cline MCP toggle
- MCP ON/OFF against Cline
cline_mcp_settings.json with backup/restore; path auto-detection; apply deferred until eval worktree is open
v0.2.0 — Dashboard + multi-IDE
- SOFEE sidebar, IDE auto-detect, MCP toggle per IDE, Cline/Bob automated + Cursor/VS Code clipboard agent adapters
Install
From Marketplace (recommended): Extensions → search SOFEE → Install.
From VSIX (eval host / offline):
code --install-extension sofee-evals-vscode-0.2.5.vsix
On a Sofee-Eye dev or deploy host, prefer the automated script (also run by hot-load-for-dev.sh and build-deploy-all.sh):
bash /home/aiadmin/sofeei/sofee-eye/scripts/build-install-sofee-evals-vscode.sh
Then Developer → Reload Window in VS Code/Cursor.
Quick setup
- Open SOFEE in the activity bar (left sidebar)
- Login tab: sign in to Sofee-Eye and select a project
- Setup tab: confirm MCP (Test connection) and Search 2.0/3.0
- Use Evals, Tasks, or MCP Trace as needed
Settings
| Setting |
Description |
sofeeEvals.apiBaseUrl |
Sofee-Eye backend (e.g. http://10.127.12.108:8000) |
sofeeEvals.authToken |
JWT from Sofee-Eye login |
sofeeEvals.ideProfile |
auto, vscode, cursor, bob, or cline |
sofeeEvals.sofeeMcpUrl |
Fallback MCP URL when no project is selected; with an active project the Traefik /mcp URL for that project is used and the setting is synced on project change |
sofeeEvals.sofeeMcpServerName |
Cline MCP server key; auto-resolved from cline_mcp_settings.json when you select a project |
sofeeEvals.autoQueue |
Poll and execute pending runs automatically |
sofeeEvals.searchTraceEnabled |
Enable MCP Trace / Search Trace refresh, ingest, and eval harvest |
sofeeEvals.searchOrchestrationDefault |
Default Search 2.0 (v2) or 3.0 (v3) when the project does not override it |
Build
cd extensions/sofee-evals-vscode
npm install
npm run compile
npm run package
From the Sofee-Eye repo, build + install in one step:
bash scripts/build-install-sofee-evals-vscode.sh
This is also invoked automatically by scripts/hot-load-for-dev.sh and scripts/build-deploy-all.sh.
See MARKETPLACE_PUBLISH.md for Marketplace release tagging and CI.
| |