Som's professional utility tool to calculate precise input word tokens for large language models. This extension provides an interactive dashboard inside Visual Studio Code to track real-time token usage, word counts, and character counts across popular tokenizer architectures.
Features
📊 Dual Tokenizer Model Support: Toggle seamlessly between cl100k_base (GPT-4 / GPT-3.5) and o200k_base (GPT-4o) rules.
📥 Active Selection Capture: Extract highlighted text from your active editor window with a single click.
📈 Granular Text Metrics: Real-time character counters and accurate word value breakdowns.
🎨 Native Theme Integration: Beautiful, modern visual layout that scales automatically to match your VS Code color palette.
How to Use
Open the Command Palette using the keyboard shortcut (Ctrl+Shift+P on Windows/Linux or Cmd+Shift+P on macOS).
Type and run the command: LLM Tokens Counter: Count Tokens.
Use the open dashboard panel to type, paste your text layout, or click Grab Highlighted Text to instantly pull code selections from your active workspace!
