SOFEE VS Code Extension
Execute SOFEE benchmark eval runs from VS Code, Cursor, or IBM Bob (Remote-SSH on the eval host). Also manage project setup (MCP, agent skills/rules) and run Sofee Task Manager tasks in the active coding agent.
Release history
Newest first. Each version lists what was added (and any important fix) so Marketplace Details stay scannable.
v0.2.40 — MCP Session / Agent Job timeline (vertical slice)
Added
- MCP Trace tab: Start/Stop job (workspace rules snapshot), latest session timeline, ingest job/session to Sofee-Eye
- Design:
sofee-eye/docs/Sofee_MCP_Agent_Job_Session.md
- Allcode → MCP Sessions catalog + pull-from-MCP
v0.2.39 — MCP Trace empty-buffer handling
Fixed
- Refresh latest MCP Trace no longer shows a hard error when the project MCP has no traces yet (empty buffer)
- Prefer Traefik
…/mcp/search-traces… URL (sibling /search-traces is not routed on typical project stacks)
v0.2.38 — Release history catch-up
Changed
- Documented v0.2.33–v0.2.37 in this release history (Search Trace / MCP Trace, reload-after-install)
v0.2.37 — MCP Trace tab
Changed
- Moved Search Trace UI out of Setup into a dedicated last tab: MCP Trace (after Tasks)
- Dashboard tabs are now Login · Setup · Evals · Tasks · MCP Trace
- Tab labels use MCP Trace (extension setting key remains
sofeeEvals.searchTraceEnabled)
v0.2.36 — Reload after VSIX install
Added
- After a local VSIX install, prompt Reload Window when extension files on disk are newer than the running build (stamp file + package mtime watch)
- Webview
dashboard.js cache-bust (?v=…) so reload picks up UI script changes
- Sidebar dashboard keeps context when hidden (
retainContextWhenHidden)
Fixed
- Installing a new VSIX no longer looks like a no-op while the old extension host stays in memory — toolbar Refresh only reloads Sofee-Eye data, not extension code
v0.2.35 — View MCP Search Trace panel
Added
- View MCP Trace opens a dedicated webview (lanes, timings, hit summary) for the latest MCP search plan
- Toolbar command SOFEE: View MCP Search Trace
- Dashboard toggle Search Trace ON (extension) (
sofeeEvals.searchTraceEnabled) — controls Refresh / Ingest / eval harvest without stopping MCP server capture
- Ingest from the View panel into Sofee-Eye Allcode Search Trace
v0.2.34 — Search Trace in dashboard + eval harvest
Added
- Setup section: Refresh latest Search Trace / Ingest to Sofee-Eye against the project MCP
searchTraceClient: fetch latest plans from MCP, format summary, POST into Sofee-Eye- After MCP ON eval runs, harvest Search Traces when the matrix create search traces flag is set
v0.2.33 — Release history refresh
Changed
- Readme release notes reorganized (newest first, scannable Marketplace Details)
v0.2.32 — Tabbed dashboard + Tasks “Execute here”
Added
- Dashboard tabs: Login · Setup · Evals · Tasks (replaces the single long scroll of sections 1–6)
- Sticky project to work with selector on Setup, Evals, and Tasks (full picker stays on Login)
- Tasks tab: lists tasks for the selected project (default: only those with Show in IDE (VS Code))
- Execute here on each task: confirm Plan/Act mode, inject task description into the active agent input, optional Submit (execute) immediately
v0.2.31 — Clearer project tile + Jump to Evals
Added
- Jump to Evals on the selected project tile
- Separate Industry/ies and Eval runs status lines on the project tile
Changed
- Simplified sign-in UI (removed the multi-step sign-in details panel)
v0.2.30 — Reachable MCP host + Cline path fix
Added
- Loopback rewrite for MCP URLs (
localhost / 127.0.0.1 → LAN host from Sofee-Eye web URL or existing Cline entries)
- Broader discovery of
cline_mcp_settings.json across VS Code and Cursor data roots
Fixed
- Auto MCP server-name when SOFEE runs in Cursor but Cline storage is under VS Code
- Clearer Test MCP errors (underlying fetch cause codes)
v0.2.29 — Project UID + auto Cline server name
Added
- Project tile Internal name (
project_uid, e.g. pjtxrlvgrcojwqh)
- Auto-resolve MCP Server Name from
cline_mcp_settings.json (by Traefik runtime URL, then project name) into sofeeEvals.sofeeMcpServerName
- Targeted Cline sync for that server’s URL (and related Sofee entries for the same runtime) without rewriting other projects’ MCP servers
v0.2.28 — Sync MCP URL into Cline settings
Added
- On Save MCP / project change: write the active project Traefik MCP URL into Cline’s global
cline_mcp_settings.json
- Targeted updates for preferred server name, same-runtime Sofee entries, and stale previous URLs
- Cline storage path resolution via extension
globalStorage (Remote-SSH / Cursor / VS Code)
v0.2.27 — MCP URL follows selected project
Added
- Selected project’s Traefik
/mcp URL drives the dashboard and MCP ON (instead of a stale global sofeeEvals.sofeeMcpUrl)
- Auto-heal on refresh / project change when the global MCP URL points at another runtime
- MCP section shows selected project + active project MCP URL (source:
project)
v0.2.26 — MCP test connection hardening
Fixed
- Test MCP tolerates a failed Sofee-Eye API connection when resolving / probing the MCP endpoint (no longer throws when the API client is unavailable)
v0.2.25 — Eval-host guard + run takeover
Added
- Eval-host guard: automated run execution only on the Sofee eval host (Remote-SSH + repo path); otherwise directs you to queue runs in Sofee-Eye
- Takeover URI:
vscode://sofeei.sofee-evals-vscode/takeover?runId=… opens a running eval for monitoring/takeover on the eval host
- Takeover and host-check wiring in the trace / run executor path
v0.2.24 — Marketplace branding as “SOFEE”
Added / Changed
- Marketplace / Extensions display name SOFEE (was “SOFEE Evals”)
- Product naming aligned across commands, dashboard, and docs
v0.2.23 — Cline slash-skills deploy layout
Added
- Flattened skill deploy path:
.cline/skills/<name>/SKILL.md (layout Cline expects for / slash skills)
- Post-deploy discovery + hint to Refresh Skills in the Cline UI
v0.2.22 — Projects root from Sofee-Eye
Added
sofeeEvals.projectsRoot auto-detect from Sofee-Eye installation-info / agent-files API (leave empty)- Dashboard action to Save the server-reported projects root locally
- Agent pack uses resolved projects root for local copy when the folder exists on this machine
v0.2.21 — Agent pack status via Sofee-Eye API
Added
- Server-side materialization check via Sofee-Eye project agent-files API (works when
projects/ is only on the eval server)
- Refresh re-queries materialization + workspace deploy state
- Clearer status labels: materialized / deploy to workspace / partial
v0.2.20 — MCP URL resolve + connection test
Added
- MCP URL resolver: Traefik public URL from active project runtime; warns when URL looks like Sofee-Eye
:8000 / :5173
- Dashboard Test MCP connection (streamable-HTTP
initialize)
- Effective URL for MCP ON / toggle prefers resolved project URL when configured URL is empty or mis-set
v0.2.19 — Agent pack status in dashboard
Added
- Dashboard section 5: whether Cline rules and skills are materialized in the project and deployed in the open workspace, with counts and Install / Refresh
- Sofee-Eye agent pack status table (rules, skills, project path, central pack reference)
Earlier releases (before v0.2.19)
v0.2.18 — Matrix-level agent pack opt-out
- Per-matrix Skip agent skills & rules deploy in Sofee-Eye; runs inherit
skip_agent_pack_deploy
- Global
sofeeEvals.skipAgentPackDeploy still skips deploy for all runs
v0.2.17 — Agent skills & rules deploy
- Install / Refresh Agent Skills & Rules into the open Cline workspace
- Eval auto-deploy after worktree creation (opt out: matrix setting or
sofeeEvals.skipAgentPackDeploy)
- Optional
sofeeEvals.projectsRoot
v0.2.16 — Reliable Cline MCP toggle
- MCP ON/OFF against Cline
cline_mcp_settings.json with backup/restore; path auto-detection; apply deferred until eval worktree is open
v0.2.0 — Dashboard + multi-IDE
- SOFEE sidebar, IDE auto-detect, MCP toggle per IDE, Cline/Bob automated + Cursor/VS Code clipboard agent adapters
Install
From Marketplace (recommended): Extensions → search SOFEE → Install.
From VSIX (eval host / offline):
code --install-extension sofee-evals-vscode-0.2.5.vsix
On a Sofee-Eye dev or deploy host, prefer the automated script (also run by hot-load-for-dev.sh and build-deploy-all.sh):
bash /home/aiadmin/sofeei/sofee-eye/scripts/build-install-sofee-evals-vscode.sh
Then Developer → Reload Window in VS Code/Cursor.
Quick setup
- Open SOFEE in the activity bar (left sidebar)
- Paste Auth Token from Sofee-Eye browser login → Save & connect
- Confirm green Connected status
- Click Run on a pending eval run (or enable auto-queue)
Settings
| Setting |
Description |
sofeeEvals.apiBaseUrl |
Sofee-Eye backend (e.g. http://10.127.12.108:8000) |
sofeeEvals.authToken |
JWT from Sofee-Eye login |
sofeeEvals.ideProfile |
auto, vscode, cursor, bob, or cline |
sofeeEvals.sofeeMcpUrl |
Fallback MCP URL when no project is selected; with an active project the Traefik /mcp URL for that project is used and the setting is synced on project change |
sofeeEvals.sofeeMcpServerName |
Cline MCP server key; auto-resolved from cline_mcp_settings.json when you select a project |
sofeeEvals.autoQueue |
Poll and execute pending runs automatically |
Build
cd extensions/sofee-evals-vscode
npm install
npm run compile
npm run package
From the Sofee-Eye repo, build + install in one step:
bash scripts/build-install-sofee-evals-vscode.sh
This is also invoked automatically by scripts/hot-load-for-dev.sh and scripts/build-deploy-all.sh.
See MARKETPLACE_PUBLISH.md for Marketplace release tagging and CI.
