column-80local · offline · ast driven · compiler checked dumb model + right context + compiler == smart harnesscolumn-80 is a vscode extension that runs local models on your box. keeps you in your flow state. no chat window. no changes the model can't fit on a single monitor. you are in control. This page is written by a human. Say no to letting LLMs write on your behalf. 01 Why this extensionCLI tools like Claude Code take spec files and implement autonomously. For complex, high-risk software this is overreach. Software engineers still need to be in the loop, because code is the design, a vague spec file is not enough. Agentic tooling also requires large, expensive frontier models to work well. For those who work in air-gapped environments or in orgs with IP concerns, or students in low-income regions of the world, using cloud-based frontier models is impossible. Use frontier models for low-risk dark-factory stuff, when you can afford it, and it's not IP sensitive. For high risk, hardcore engineering and learning to code on the cheap, use column-80. 02 How it worksUsing small models to write code works if the model gets the right context and the right feedback loop. And it keeps us close to the code, which is where the real software design is. AST based context injection Small models hallucinate fields and method names. Column-80 uses the abstract syntax tree to mine your code for real data structures and methods, recursively. It injects them automatically into the prompt. No grepping. The compiler is the reviewer On an accepted generation the language's own toolchain checks it. No broken autocomplete output. Function generation gets a repair round. A closed prompt The prompt is your doc comment, your signature, and the context you picked. Nothing else, the same bytes every time. No repo scraping, no hidden window. Actually useful autocomplete Constrained, intelligent autocomplete that avoids getting in your way. Small model, sub 200ms on most machines. Works with Ctrl+Space, as you up/down through members. 03 No chat, manual context managementNo chat panel. Either generate fresh, or repair one function or structure at a time. Chat windows take devs away from the code. Don't negotiate with the model. Stay in your flow state. You hold the design and intent, the model just speeds up the typing. For context outside of AST injected members and methods, you must add it yourself. Add a block (eg. a function, a struct) or include specific code by line or by file. Manually add your skill.md files and anything else the model needs. 04 Two models, one GPUFunction generation runs Autocomplete runs a separate 1.5B FIM model so it stays sub 200ms. Both models can fit on a 16GB card at the same time. Run it on a MacBook Pro with 36GB RAM no problems. On a RTX 5080 (16GB VRAM) you'll get autocomplete latency around 100ms, and the 30b MoE model generates at 35 tokens a second. Remember to install ollama on your box. You can still use frontier models via an API key if your machine is under-spec'd. Just remember you sacrifice your privacy and might leak your company's IP. 05 LanguagesColumn-80 relies heavily on language toolchains to make these dumb models actually work smart. Column-80 supports Rust, .Net/C#, Python, Typescript and Go. If your language of choice is not supported it can be added. If you want to build it and submit a PR you can, but please follow contributor guidelines. 06 How to use it1. Set up once
2. Autocomplete
3. Add context
4. Generate a body
5. Repair
6. Decide what correct means
7. Let your own tests drive the repair
8. Get told what is wrong with it
That is the whole tool. No chat thread, no history, no agent to babysit. Every model write goes through a diff you accept. The user manual covers the rest, including every setting, every command, and the known limits. 9. Say itCursor where the next statement goes, 07 Get itReleased under Apache-2.0. No sign-up, no data exfiltration. Get it from the VS Code marketplace or clone it down, npm install and hit F5 to run. https://github.com/utilitydelta/column-80 Reach me on LinkedIn. 08 AI Provenance StatementInitial 1.0 version built in ~30 sessions, over two weeks with Opus & Fable models using my build-method:implementation-loop skill. Full vscode+ollama e2e test harness, Ubuntu x86 with RTX 5080. I read the code :) // Understand every line you ship. // Code is the design. // Your code is not their training data. // Your editor should not have a bill. Local by architecture. No account, no telemetry, no bill. Apache-2.0 |