You can install this extension with
This extension adds TOC into the sidebar whose contents are made from the file content.
You can move by clicking the content in TOC such like Jupyter TOC extension.
Now you can edit config about comment out / header symbols per language! (added in v1.0.0 on 2023-11-03)
You can check languageId to specify the file types on https://code.visualstudio.com/docs/languages/identifiers#_known-language-identifiers .