The vscode-kubernetes-tools extension leaves kubectl proxy --port=0 processes around (See Issue). This prevents deletion or renaming of folders from which the kubectl process was run from. This extension takes care of this by reaping these leftover processes (with command line kubectl proxy --port=0) if they are around for more than 5 seconds. Please use this extension carefully.
Reap kubectl --proxy --port=0 after 5 seconds. The message about the killed kubectl PIDs is logged in the kubectl-reaper output channel. If no kubectl --proxy --port=0 processes are found then check every 2 minute (120000 milliseconds i.e. backoff).