SOFEE Evals VS Code Extension
Execute SOFEE benchmark eval runs from VS Code, Cursor, or IBM Bob (Remote-SSH on the eval host).
v0.2.0 — Dashboard + multi-IDE
- SOFEE Evals sidebar (activity bar) — connection status, settings, projects, pending runs
- Auto-detect IDE — Cursor, IBM Bob, Cline, or VS Code
- MCP toggle writes to
.vscode/mcp.json, .cursor/mcp.json, or .bob/mcp.json as appropriate
- Agent adapters — Cline/Bob automated test server; Cursor/Bob/VS Code manual clipboard mode
Quick setup
- Install extension from VSIX (Remote-SSH on eval host)
- Open SOFEE Evals in the activity bar (left sidebar)
- Paste Auth Token from Sofee-Eye browser login → Save settings
- Confirm Connected status
- Click Run on a pending eval run (or enable auto-queue)
Settings
| Setting |
Description |
sofeeEvals.apiBaseUrl |
Sofee-Eye backend (e.g. http://10.127.12.108:8000) |
sofeeEvals.authToken |
JWT from Sofee-Eye login |
sofeeEvals.ideProfile |
auto, vscode, cursor, bob, or cline |
sofeeEvals.autoQueue |
Poll and execute pending runs automatically |
Build
cd extensions/sofee-evals-vscode
npm install
npm run compile
npm run package
Install sofee-evals-vscode-0.2.0.vsix via Extensions: Install from VSIX…
| |
