Genpact Skills Test Suite

Word-first business task authoring and model-agnostic, RAG, and local SLM evaluation inside VS Code.

Test what happened and what was allowed—never how the agent thought about it.

Designed for business teams

Employees fill out friendly Microsoft Word tables covering goals, inputs, required and forbidden actions, approvals, business rules, budgets, and test examples. The extension validates the form and produces a canonical task without requiring YAML, JSON, Python, prompts, or model APIs.

Included workflow

• Create a Word task from the guided template.
• Compile and validate the current task.
• Discover approved SKILL.md capabilities automatically.
• Run scenarios and model matrices through VS Code Test Explorer.
• Save known-good snapshots and detect quality, cost, latency, or token regressions.
• Inspect plain-English Markdown and machine-readable JSON reports.
• Explain every inherited client, department, and task setting.
• Enforce sensitive-data, provider, cost, latency, model-call, and tool limits.
• Configure approved RAG sources and allowlisted owned local SLM endpoints.
• Score outcome, tool contract, trajectory, side effects, policy, and efficiency separately.
• Inject safe mock failures and verify bounded, idempotent retry behavior.

Every agent or framework is normalized through one neutral adapter/result contract. Exact answer wording and hidden reasoning are never acceptance gates.

Getting started

1. Open a Genpact Skills Test Suite workbench repository.
2. Select the outlined Genpact logo in the Activity Bar.
3. Choose Create task from Word.
4. Fill out and save the document in Microsoft Word.
5. Run Compile Word Task, then Test Current Task.

The Python engine must be installed in the workspace. Complete installation, department examples, security guidance, and CLI documentation are available in the GitHub repository.

Privacy

Hidden chain-of-thought is never requested or displayed. Standard tests use mock skills/providers and make no paid external calls. API keys stay in local environment variables, VS Code SecretStorage, or CI secrets.

Created by Justin Monzingo.