This extension, based on the Windows font preview, allows you to get an idea of what fonts look like directly in VS Code. It has been tested on otf and woff files, and is set to work on eot, ttf, and woff2 files as well. Below is a screenshot showing the preview. (The repository for Monocraft can be found here.)
Install the extension from the Extensions sidebar panel
If you would like another type of font file to be supported, please submit an issue.