inspect-vscodeVS Code extension for the Inspect framework for large language model evaluations. This extension provides support for developing evaluations using Inspect, including:
Log ViewerThe Task NavigationThe Tasks panel displays a listing of all the Inspect tasks within your workspace. Selecting the source file or task within the listing will open the task source code in the source editor (or Notebook viewer). You can display a tree of tasks including folders and hierarchy or a flat list of tasks sorted alphabetically. Configuration PanelUse the Configuration (.env) panel to edit common settings in your Task PanelUse the Task panel to edit CLI options for a task, set task args, and run or debug a task. Values will be saved for each task and used whenever the task is run or debugged from within the Inspect VS Code extension. Running and DebuggingThe Inspect VS Code extension includes commands and keyboard shortcuts for running or debugging tasks. After the task has been completed, Use the run or debug commands to execute the current task. You can alternatively use the Ctrl+Shift+U keyboard shortcut to run a task, or the Ctrl+Shift+T keyboard shortcut to debug a task.
|