Have you wasted countless clicks on this popup too?
No more! Terminator allows you to run tasks without any mercy for any potentially still running predecessor. Just add something like this to your keybindings.json:
args contains a regex that matches against the task name, in this case the test (active configuration) task (extension prefixes like lime: are not part of the string that is matched against).
If you're using the Lime extension, you may also want to add the following when condition to your keybinding: