Karate Runner

This extension will enable you to Open/Run/Debug Karate Tests and Build Reports by leveraging Codelens, Activity Bar, Debugger and much more.

Features

Codelens

A Karate: Run Codelens will be added above each Feature:, Scenario: and Scenario Outline: keyword within each feature file. Clicking on a Feature Codelens will run all Scenario and Scenario Outlines within its feature file. Clicking on a Scenario or Scenario Outline Codelens will run only that Scenario or Scenario Outline.

A Karate: Debug Codelens will be added above each Feature:, Scenario: and Scenario Outline: keyword within each feature file. Clicking on a Feature Codelens will debug all Scenario and Scenario Outlines within its feature file. Clicking on a Scenario or Scenario Outline Codelens will debug only that Scenario or Scenario Outline.

A Karate: Run | Karate: Debug Codelens will be shown when hovering over any row within a Scenario Outline: Examples: table to enable running/debugging a single row.

Activity Bar

A Karate Activity Bar will be added to VSCode. Clicking on the Activity Bar will reveal a Build Reports and a Tests view. Clicking on a report will open it within the default program defined for its file type. Clicking on a Feature will run all Scenario and Scenario Outlines within its feature file. Clicking on a Scenario or Scenario Outline will run only that Scenario or Scenario Outline.

Note Karate Features and Scenarios marked with exclusions such as @KarateOptions(tags = {"~@ignore"}) will not be run.

Debugger

Karate Debug Configurations will be added to Debug/Run Activity Bar. See Setup > Debugger section below for setup details. Following setup starting the debugger will enable you to use all debug controls to step through and debug your feature files.

Smart Paste

A Smart Paste option will be added to detect paste operations into feature files. If a curl command is detected it will be transformed into Karate syntax and pasted into the VSCode Editor.

Status Bar

A Karate Status Bar will be added to VSCode showing results for the last execution. Clicking Karate Status Bar will reveal historical results executed from Codelens or Karate Activity Bar. Clicking historical results will re-execute the command which produced those results.

Note this feature is dependent on Karate providing a results file under the root of your project. For Karate Version < 1.0 a file called results-json.txt For Karate Version >= 1.0 a file called karate-summary-json.txt

Test Results (Karate 1.0 or greater)

Test Results will be shown next to each Feature:, Scenario:, Scenario Outline: and parent folder in the Tests view. Test Results will be shown next to each Feature:, Scenario:, Scenario Outline: within each Feature file. Test Results are rolling results meaning they will accumulate and reset only when you click the Clear Results. Test Results are represented by Karate icons showing a green dot (pass) or red dot (fail). Test Results are additionally represented by a failure count showing how many failures are below each folder or file.

Note this feature is dependent on Karate Version >= 1.0 and Karate providing result files under the root of your project within a /karate-reports directory. Each file must end with a format of .karate-json.txt.

Editor Menu Bar

A Karate Menu will be added to the VSCode Editor Menu Bar for feature files. A menu option will be added to open Karate Runner settings, clear test results from Tests view and the gutter for feature files and finally to toggle showing test results within the gutter for feature files.

Peek

A Peek option will be added to the Control-Click or Right-Click context menu in the VSCode Editor. Clicking Peek > Peek Definition on a string or reference (or any combination of if concat'd) which equates to an existing file will display the contents of that file within an Inline Peek Editor.

Note if the path being peeked starts with classpath: this extension will search recursively within the target project to find the file, searching first within <project root>/src/test, followed by <project root>/src and ending with <project root>/

Key Bindings

Key Bindings will be added to enable running Karate tests and Smart Paste from the keyboard.

Smart Paste

• Requirement: Open any file in VSCode Editor and ensure editor has focus.
• Windows: Ctrl+V
• Linux: Ctrl+Shift+V
• Mac: Cmd+V

Run Karate Test

• Requirement: Open a feature file in VSCode Editor and ensure a line associated with a test has cursor focus.
• Windows: Ctrl+R+1
• Linux: Ctrl+Shift+R+1
• Mac: Cmd+R+1

Run All Karate Tests

• Requirement: Open a feature file in VSCode Editor and ensure editor has focus.
• Windows: Ctrl+R+A
• Linux: Ctrl+Shift+R+A
• Mac: Cmd+R+A

Note key bindings can be changed if desired by going to Menu > Preferences > Keyboard Shortcuts

Syntax Highlighting

Syntax Highlighting will be added to enable bracket pairing and coloring for the Karate language within .feature files. Additionally coloring will be enhanced within .js files to support Karate language integration.

Note this is a work in progress as the Karate language evolves and custom IDE themes come to market.

Intellisense

Intellisense will be added to the Karate read() command to enumerate all files in the same directory. Additionally if <project root>/src/test/java, <project root>/src/test/resources exist, all files within those directories will be enumerated.

Setup

Versions

• VSCode Version 1.44.0 or greater. (Required)
• Karate Version 0.9.3 or greater in your Karate projects. (Required)
• Karate Version 0.9.5 or greater in your Karate projects. (Required for Debugger or Karate Cli)
• Karate Version 1.0.0 or greater in your Karate projects. (Required for Tests View results)

This Extension

• Goto the following path to configure all settings for this extension Preferences > Settings > Search for Karate Runner or click the gear icon in the header of the Tests View.

Execution

• Ensure an execution option (karate.jar, pom.xml (Maven), build.gradle (Gradle Groovy), build.gradle.kts (Gradle Kotlin)) exists at the root of your project.
• This extension will detect which execution option exists at your project root and execute the appropriate command.
• Note if multiple execution options exist karate.jar will be favored and used first, followed by pom.xml (Maven), then build.gradle (Gradle Groovy) and lastly build.gradle.kts (Gradle Kotlin).

Debugger

• To setup from a feature file's Codelens...
• Click Karate: Debug Codelens in any feature file.
• Click Karate (debug) option from popup.
• Click Add Configurations in launch.json to edit configurations if needed.
  • Click Karate (debug): Gradle to add Gradle debug.
  • Click Karate (debug): Maven to add Maven debug.
• Edit debug configurations as needed.
  • Note feature property is always used to find project root if multiple projects are loaded in IDE.
  • Note feature property is also used by Karate Debug Server if karateOptions property is not set.
  • Recommend default value for feature property which dynamically finds opened feature files.
  • Note karateOptions is used by Karate Debug Server to enable advanced debugging and specify all Karate Options.
• Click Debug icon in Activity Bar to open debugger.
• Next to Gear/Cog icon expand dropdown and select debug configuration to use.
• See ### Gradle section at the bottom if applicable.

• To setup from VSCode Debug/Run Activity...
• Click Debug/Run icon in Activity Bar to open debugger.
• Click Gear/Cog icon at the top.
• Follow same steps above for setting up from a feature file except for first Codelens step.

Karate Cli

• Note Karate Cli is a work in progress feature to eliminate the need for Java files as runners.
• Open Preferences > Settings > Search for Karate Runner.
• Enable by adding check mark to Karate Runner > Karate Cli: Override Karate Runner.
• Configure by setting Karate Runner > Karate Cli: Command Line Args.
• Note this extension will handle all Maven and Gradle commands and specifying the feature file(and line number if needed).
• See ### Gradle section at the bottom if applicable.

Karate Jar

• Open Preferences > Settings > Search for Karate Runner.
• Configure the Karate Standalone Jar by setting Karate Runner > Karate Jar: Command Line Args.

Gradle (If Applicable)

• Required for Debugger and Karate Cli.
• If using Groovy DSL:
  • Open build.gradle for target project.
  • Add the following task to build.gradle:

    task karateExecute(type: JavaExec) {
        classpath = sourceSets.test.runtimeClasspath
        main = System.properties.getProperty('mainClass')
    }
    

• If using Kotlin DSL:
  • Open build.gradle.kts for target project.
  • Add the following task to build.gradle.kts:

    tasks.register<JavaExec>("karateExecute") {
        classpath = sourceSets.test.get().runtimeClasspath
        main = System.getProperty("mainClass")
    }