VP test runner

English | 简体中文

An internal tool of running visualparity test

Config

Features

1. CodeLens of run VP test of spec and single case with int env and online(support buildNumber) env.
2. Run VP test in right click menu with int env and online(support buildNumber) env.
3. Add spec file to VP test template and create spec file from added template.
4. Batch adding flight, localStorage and sessionStorage.
5. Check the requests that haven't been intercepted on hovering the Interceotions.
6. Decoration before the spec, test case and step for test result.

CodeLens

CodeLens in spec file

For spec

There are 2 types of testing methods.

• Run Local is run the vp test with local server env.

  Equivalent to executing

npm run test:vp -- -- --local --input "suites/xxx"

• Run Online is run the vp test with online build.

  Equivalent to executing

npm run test:vp -- -- --input "suites/xxx"

After click the Run Online, there will show an input.

You can input your buildNumber into this input. If you want to use online build, please leave the input box blank and click the Enter button directly.

Right-click menu

Right-click menu of folder and *.spec.json file.

This feature is same with run VP test in spec file. And it supports running all spec files in current folder.

Report notification

Due to the long running time of VP test, I am accustomed to doing other things during runtime, which often leads to forgetting the VP test report that has ended. So I add a notification to notice me the VP has ended

If the vp test is run by a spec file or a singel case, you can open the report in noticaition.

If the vp test is run by a folder, you can open this folder in noticaition.

If you get the error seems like: File xxx cannot be loaded because running scripts is disabled on this system. For more information, see about_Execution_Policies at https:/go.microsoft.com/fwlink/?LinkID=135170, you need to change the PowerShell Execution Policy by follow steps.

1. Open the Powershell as Administrator

2. Run this Command

Set-ExecutionPolicy RemoteSigned

3. Select "A" and press Enter

4. Rerun the VP test

VP test template

1. Create a new template

To make it easier to create a new spec file, you can right click a exist spec file and add it to spec template. You can customize a name for it that you find convenient.

2. Use template

Right click a folder, and click the Create a new VP spec file

Select a template

Input a file name and press the Enter

3. Delete template Considering that deleting a template is a low-frequency operation, I did not set this feature to the right menu. You can press the F1 and input the Delete a VP test template, you can select a template and it will be deleted.

Add Key by right-click menu

This tool supports 3 fields contains: Flight, LocalStorage and SessionStorage. But it does not support deleting fields, you can delete any fields by find-and-replace

Interceptions hoverable

This feature is for checking the requests interceptions situation easier.

Sometimes, it is very difficult to find requests that have not been intercepted. So I add a hoverable icon before the Interceptions to show these requests.

These requests are only include XHR requests. If you want to check others, you can use the debug feature and find them in Network

Decoration in spec.json file

If this feature has a significant impact on your VScode performance, you can close this feature by add this config into your settings.json file

"vp.enableDecoration": false

Show the VP result status before the spec/case/step

Fast accept the baseline and open the report.

Fast check diff and error message on hovering the step.