Optify AI — Token OptimizerCut your AI inference costs automatically. Zero configuration. Zero data collection. Runs entirely on your machine. Optify AI compresses your prompts before they reach the model — silently removing filler words, redundant phrasing, and low-signal tokens — so you send fewer tokens without losing meaning. The result: lower costs and faster responses, every session. How it worksWhen you chat with Compression runs locally using a neural model (LLMLingua-2, MIT licensed, by Microsoft Research) that runs entirely on your CPU. No prompt ever leaves your machine before being sent to Copilot. Quick start
That's it. Optify AI handles the rest automatically. Status barThe ⚡ Optify AI item in the bottom status bar shows your current session stats (tokens saved, estimated cost reduction). Click it to toggle optimization on or off. Commands
Compatibility
Requirements:
Privacy — your prompts stay on your machineOptify AI is built with privacy as the first principle:
Session stats (tokens saved, estimated savings) are calculated locally and exist only in your current VS Code session. First-run model downloadOn first install, Optify AI silently downloads the neural compression model (~178MB) from HuggingFace and saves it to your VS Code extension storage folder. This happens once in the background and requires an internet connection. After that, everything runs fully offline. You can watch the download progress in the Optify AI output panel ( Settings
LicenseMIT — see LICENSE. Third-party attributions (including LLMLingua-2 by Microsoft Research) are listed in NOTICES. |