SkillFoundry Assessment for VS Code

Complete a SkillFoundry assessment in your own VS Code: download the task, work with your own tools, run the tests, and submit. The hiring team that invited you sees your submitted code, the test results and a summary of how you worked.

Getting started

Accept your invitation. Open the link in the invitation email and sign in to SkillFoundry. The assessment appears on your dashboard. Choose Start Task.
Choose VS Code. On the task page choose Use VS Code IDE, then Generate Session Token, then Open in VS Code. Allow VS Code to open the link when it asks. (Without the link: run SkillFoundry: Activate Assessment from the Command Palette and paste the token.)
Download the task files. Choose Download Files and pick a folder. The files are saved in a new folder (a Git repository whose first commit is the starter code) and VS Code opens it.
Trust the folder. VS Code opens new folders in Restricted Mode. The assessment needs a trusted folder to run tests and record your work; SkillFoundry asks you to trust it.
Work on the task. The task brief is in the SkillFoundry panel (SkillFoundry: Open Assessment Panel) and the README.md/docs of the task. The status bar shows the time left.
Run the tests. Run Tests in the panel (or SkillFoundry: Run Tests) runs the tests on your computer and also on the SkillFoundry server, which runs hidden tests as well (you see only how many ran). One server run at a time; the panel shows its result.
Submit. SkillFoundry: Submit Assessment shows what will be sent (changed files, test status). Confirm to submit. Your result appears on your SkillFoundry dashboard.

You can close VS Code and come back: reopen the task folder and the assessment resumes, with the timer counting from when you started.

Requirements

VS Code 1.80 or newer, and Git.
The language the task is graded with. The task page and the panel say which one, for example Requires Python 3.11 or newer. If pytest is missing, Run Tests offers to set up a virtual environment (.venv) in the task folder with the task's requirements.

What is recorded

While your assessment is active, the status bar shows SkillFoundry: activity capture on. Click it, or run SkillFoundry: Show Activity Capture Details, for the exact list. In short:

Recorded: which task files you open and for how long, the size and position of your edits (not their text), saves, test runs and their results, commands you run in the terminal (with emails, tokens, IP addresses and your user name removed), debugging and Git branch changes, and your use of the SkillFoundry pair engineer.
Uploaded: your task files, when you run tests and when you submit.
Never recorded: keystrokes, clipboard contents, terminal output, anything outside the task folder, other applications.

SkillFoundry: View Collected Events and the panel's Behavioral Data tab show what has been captured. Recording stops when you submit.

Troubleshooting

What you see	What to do
Nothing happens after the folder opens, the status bar says Restricted Mode	Trust the folder (Workspaces: Manage Workspace Trust → Trust).
This SkillFoundry session link has expired or was replaced	On the task page choose Use VS Code IDE → Generate Session Token for a new link.
This folder holds the files of …	You opened the link of another task in this task's window. Download that task into its own folder.
pytest is not installed	Choose Set Up .venv, or install the task's `requirements.txt` yourself.
Your assessment was not submitted	Your work is still on your computer. Check your connection and choose Submit Again.
Time limit reached	Submit your work now.

Questions about an assessment: support@skillfoundry.dev.

Commands

Command	What it does
SkillFoundry: Activate Assessment	Start a session with a token from the task page
SkillFoundry: Open Assessment Panel	Task brief, tests, chat, pair engineer and captured data
SkillFoundry: Run Tests	Local and server test run
SkillFoundry: Submit Assessment	Review and submit your work
SkillFoundry: Show Task Details	The task brief in an editor tab
SkillFoundry: View Collected Events (Transparency)	What has been captured so far
SkillFoundry: Show Activity Capture Details	What is and is not recorded
SkillFoundry: Start Timer	Resume recording and the timer for the open task (normally automatic)
SkillFoundry: Clone task repository	For tasks hosted in a Git repository instead of downloaded files

The SkillFoundry Workforce commands are for employers' internal use and are off by default.

Settings

Setting	Default	Effect
`skillfoundry.apiBaseUrl`	`https://api.skillfoundry.dev`	Backend API base URL (read at activation)
`skillfoundry.eventBatchSize`	`50`	Assessment telemetry: events per upload
`skillfoundry.eventBatchIntervalMs`	`30000`	Assessment telemetry: interval between uploads
`skillfoundry.debugMode`	`false`	Debug logging
`skillfoundry.transportOwner`	`auto`	Who sends telemetry when a SkillFoundry desktop agent is installed
`skillfoundry.desktopIpc.enabled`	`true`	Forward events to the desktop agent over localhost IPC (`macosIpc.enabled` is the deprecated alias)
`skillfoundry.behaviorV2.enabled`	`true`	Behavioral evidence v2, used by SkillFoundry scoring (see below)
`skillfoundry.workforce.*`	off	Passive workforce capture (`enabled`, `teamId`, `allowedRepos`, `autoStart`)

Behavioral evidence v2 (skillfoundry.behaviorV2.enabled). When on, and the backend issues an evidence token for the active assessment attempt, the extension also sends v2 evidence straight to the SkillFoundry analytics service. If the backend does not offer a token, v2 stays off quietly. Changing the setting takes effect immediately. Unsent evidence is kept in the extension's storage folder and sent later.