Ultra Coder

Introducing Ultra Coder – an AI-powered development assistant that seamlessly integrates with your CLI and code editor.

Ultra Coder is designed to manage complex software development tasks step by step. Equipped with tools to create and edit files, navigate large projects, execute terminal commands, and access the web (all with your explicit permission), Ultra Coder goes far beyond standard code completion or technical support. Using the Model Context Protocol (MCP), Ultra Coder can even extend its capabilities by creating new tools as needed. Unlike traditional autonomous AI scripts that run in sandboxed environments, this extension provides a human-in-the-loop interface, allowing you to approve every file change and command, ensuring safety and transparency.

You can assign tasks such as converting mockups into functional applications or debugging code from screenshots and images. Ultra Coder begins by analyzing your project’s file structure and source code ASTs, performing regex searches, and reading relevant files to quickly understand the project context. By carefully managing the information added to context, Ultra Coder provides effective assistance even for large, complex projects without overwhelming the environment.

Once Ultra Coder has the necessary context, it can:

• Create and edit files while monitoring linter/compiler feedback, proactively resolving issues like missing imports or syntax errors.
• Execute terminal commands and track their output, allowing it to respond to runtime errors, dev server issues, and other command-line events.
• Assist with web development tasks by launching sites in a headless browser, performing interactions such as clicks, typing, scrolling, and capturing screenshots and console logs to troubleshoot runtime and visual errors.
• Upon task completion, Ultra Coder presents results and suggests commands—such as open -a "Google Chrome" index.html—for you to execute with a single click.

[!TIP] Use CMD/CTRL + Shift + P to open the command palette and select "Ultra Coder: Open In New Tab" to launch the extension in a side-by-side tab within your editor. This enables you to view workspace changes in real time while navigating your file explorer.

Connect to Any API or Model

Ultra Coder is compatible with a wide range of API providers, including OpenRouter, Anthropic, OpenAI, Google Gemini, AWS Bedrock, Azure, GCP Vertex, Cerebras, and Groq. You can also configure any OpenAI-compatible API or leverage a local model via LM Studio or Ollama. For OpenRouter users, the extension automatically retrieves the latest model list, ensuring access to the newest models as soon as they are released.

Additionally, Ultra Coder tracks total token usage and API costs for both the overall task loop and individual requests, providing real-time insights into your usage and spending throughout the development process.

Execute Terminal Commands

With the latest shell integration updates in VSCode v1.93, Ultra Coder can execute commands directly in your terminal and capture their output. This capability enables him to handle a wide range of tasks, including installing packages, running build scripts, deploying applications, managing databases, and executing tests—all while adapting to your development environment and toolchain to ensure accurate results.

For long-running processes, such as development servers, the “Proceed While Running” option allows Ultra Coder to continue the task while the command runs in the background. As he works, he continuously monitors terminal output, enabling him to respond to issues in real time, such as compile-time errors that may arise during file edits.

Manage and Edit Files

Ultra Coder can create and edit files directly within your editor, displaying a diff view of all changes. You can modify or revert these changes in the diff view, or provide feedback via chat until the result meets your expectations. Ultra Coder also monitors linter and compiler errors—such as missing imports or syntax issues—allowing him to proactively fix problems as they arise.

All edits are logged in your file’s Timeline, making it easy to track and revert modifications when needed.

Launch the Browser

With Claude 3.5 Sonnet’s new Computer Use capability, Ultra Coder can interact with web pages by launching a browser, clicking elements, typing text, scrolling, and capturing screenshots and console logs at each step. This enables interactive debugging, end-to-end testing, and general web automation, allowing him to fix visual bugs and runtime issues autonomously—without requiring you to copy and paste error logs manually.

For example, you can ask Ultra Coder to “test the app”, and he will run a command like npm run dev, open your local development server in a browser, and perform a series of automated tests to verify that everything works as expected.

Integrate Tools

Leveraging the Model Context Protocol, Ultra Coder can extend his functionality with custom tools. While you can use community-made servers, Ultra Coder can also create and install tools tailored to your specific workflow. Simply ask him to “add a tool”, and he will handle everything—from creating a new MCP server to installing it in the extension. Once added, these custom tools become part of Ultra Coder’s toolkit, ready for use in future tasks.

Examples include:

• “Add a tool that fetches Jira tickets” – Retrieve ticket acceptance criteria and automate tasks.
• “Add a tool that manages AWS EC2s” – Monitor server metrics and scale instances up or down.
• “Add a tool that pulls the latest PagerDuty incidents” – Access incident details and direct Ultra Coder to resolve issues.

Provide Context

@url: Provide a URL for the extension to fetch and convert into markdown, ideal for giving Ultra Coder the latest documentation.

@problems: Include workspace errors and warnings from the Problems panel for Ultra Coder to address.

@file: Add a file’s contents directly, saving API requests by avoiding manual approval of read operations (you can also type to search files).

@folder: Add all files from a folder at once, streamlining your workflow and improving efficiency.

Workspace Checkpoints: Compare & Restore

As Ultra Coder progresses through a task, the extension captures snapshots of your workspace at each step. You can click ‘Compare’ to view a diff between the snapshot and your current workspace, or ‘Restore’ to revert to that point.

For instance, when working with a local web server, ‘Restore Workspace Only’ lets you quickly test different app versions, while ‘Restore Task and Workspace’ allows you to continue building from the version you choose. This enables safe experimentation without losing progress.