Yellorn — Universal Data Doctor, 22+ Format Viewer & Edge Mock API

Fix broken data, inspect opaque binary/AI files locally, and publish dynamic mock APIs in seconds.
Available as a Web Workstation (yellorn.com) and a Native VS Code Extension.

⚡ Quick Feature Overview

Capability	What It Does	Web	VS Code	Trigger / Shortcut
🩺 Data Doctor	48 auto-fix passes with zero data loss for broken JSON, XML, YAML, CSV, SQL & Python dicts	✅	✅	`Cmd+Alt+F` / `Ctrl+Alt+F`
⚖️ Visual Diff	Side-by-side diff comparing broken data vs Data Doctor repair	✅	✅	Editor Context Menu
🗂️ Universal Viewer	Decode Parquet, Arrow, Excel, Safetensors, GGUF, MessagePack, PKI locally	✅	✅	Drag & drop / Custom Editor
⚡ Dynamic Tokens	Render live `{{ uuid4() }}`, `{{ now() }}`, `{{ randint() }}` at serve time	✅	✅	Autocomplete on `{{`
🌐 Mock Webhook API	Publish any payload to global 300+ POP Cloudflare Edge endpoint	✅	✅	`yellorn.publishWebhook`
🔄 Format Converter	Convert across JSON ↔ XML ↔ YAML ↔ CSV ↔ TOML ↔ Python Dict	✅	✅	Format Menu / Context Menu
🔍 JMESPath Query	Real-time structured query filtering (`jmespath.search`)	✅	✅	`Cmd+F` / `yellorn.queryJMESPath`
🗄️ SQL Formatter	Multi-dialect formatting (Postgres, MySQL, SQLite, BigQuery, Snowflake, etc.)	✅	✅	`yellorn.formatSql`
📬 Request Sender	In-app REST client & cURL importer to TypeScript/Python code	✅	✅	`yellorn.parseCurl`
📊 Visualizer	Interactive React Flow Graph, Virtualized Tree, and Sortable Table	✅	✅	`Cmd+Shift+T` / Webview

💡 How to Use in VS Code

Using Yellorn in VS Code is seamless and non-intrusive:

Highlight / Select: Select any broken data, raw logs, SQL, or payload in your editor (or select nothing to automatically target the whole file).
Right-Click $\to$ Yellorn: Open the context menu and hover over the Yellorn submenu group (cleanly organized like Share >).
Choose Your Feature:
- 🩺 Smart Format — Instant multi-tier recovery for broken syntax, unquoted keys, Python dicts, trailing commas, and escaped log dumps.
- ⚖️ Compare & Diff Repair — Side-by-side visual diff showing exact changes before accepting.
- 🔤 Sort Object Keys... / 📦 Minify / Compact Data / 🔓 Unwrap Escaped JSON / 🧹 Clean / Prune Empty Fields — In-place transformations.
- 🗄️ Format SQL Query... — Multi-dialect SQL beautifier (Postgres, MySQL, BigQuery, Snowflake, etc.).
- 🔍 Query with JMESPath... — Live JSON data filtering & projection.
- 🔄 Convert Format... — Cross-convert between JSON ↔ XML ↔ YAML ↔ CSV ↔ TOML ↔ Python.
- ⚡ Generate TypeScript Interfaces — Generate strongly typed TypeScript interfaces directly from JSON or API responses.
- 📬 Convert cURL Command... — Convert cURL into JSON, TypeScript fetch, or Python requests.
- 🌐 Publish Mock Webhook API... — Deploy payload to a live Cloudflare Edge mock endpoint.
📁 File Explorer Right-Click: Right-click any file in the VS Code File Explorer sidebar to access the complete Yellorn > toolset!
⚡ Global Shortcut: Press Cmd+Alt+F (macOS) / Ctrl+Alt+F (Windows/Linux) anytime for instant 1-click Smart Format repair!

🎯 Why Yellorn?

Developer Persona	Primary Problem Solved	Key Benefit & Time Saved
🤖 AI / LLM Engineers	Malformed JSON dumps, unquoted keys, markdown fences	Instant auto-fix; inspect Safetensors & GGUF tensor maps without loading weights
🛠️ Backend & API Devs	Simulating external APIs & testing failure cases	Deploy dynamic mock webhooks with live `{{ uuid4() }}` / `{{ now() }}` in 60 seconds
📊 Data Engineers	Previewing columnar & binary datasets	Inspect Parquet, Arrow, BSON, and multi-sheet Excel files locally with zero uploads
🔐 DevOps & Security	Decoding X.509 cert chains and PFX bundles	View expiry, fingerprint, and weak-key warnings client-side with 0 private key leaks

🧩 Core Architecture & Components

1. 🩺 Data Doctor (Recovery Engine) — Click to expand

Responsibility: Detects and fixes syntax errors without silent data reshaping.
4-Tier Recovery:
1. Strict Parser: Native high-speed parsing.
2. Best-Effort Auto-Fix: 37 documented repair passes (quarantined syntax errors, unescaped quotes, missing colons, unquoted keys, unquoted values, trailing commas, markdown fences, smart quotes, unclosed tags, tabbed YAML, CSV single-pass quote balancing & ragged row auto-padding).
3. Python Dict AST Bridge: Safely converts Python pprint, sets, tuples, and dataclass reprs without eval.
4. Smart Format Catch Path: Heals concatenated log lines ("response": "{...) and escaped envelopes.
Full Transparency: Every applied repair is tagged in fixesApplied and shown in the status bar.
📖 See src/engine/parser/bestEffortParser.ts for implementation details.

2. 🗂️ Universal Local-First Viewer (Zero-Uploads) — Click to expand

Responsibility: Decodes binary files, AI model headers, and PKI certificates into browsable JSON/Table previews.
Privacy & Security: 100% Client-Side. Decoded in local Web Workers; zero bytes leave your machine.
Supported Formats:
- Data Containers: Apache Parquet (hyparquet), Apache Arrow / Feather (apache-arrow), Excel (xlsx), MessagePack, CBOR, BSON, Protobuf (decode_raw), gzip (fflate).
- AI / ML Models: Safetensors (reads metadata header without weights), GGUF (llama.cpp metadata + tensor map), ComfyUI (extracts workflow & prompt graphs from PNGs).
- PKI & Certificates: PEM, DER, PKCS#12 / PFX (.pfx / .p12 with browser password prompt), PKCS#7, CSR. Generates __insight__ summaries; private keys are never decoded.
📖 See docs/cert-mapping.md & src/engine/formats/binaryImport.ts.

3. ⚡ Dynamic Tokens Template Engine — Click to expand

Responsibility: Lightweight, sandboxed Python-flavoured expression evaluator for live mock responses and request templates.
Builtins: {{ now() }}, {{ uuid4() }}, {{ randint(min, max) }}, {{ choice('A', 'B') }}, {{ objectId() }}, {{ snowflake() }}, plus webhook request echoes ({{ request.ip }}, {{ request.header('Authorization') }}).
Isomorphic: Runs identically in browser autocomplete, Cloudflare Edge Worker serve paths, and VS Code.
📖 See docs/dynamic-tokens.md for full syntax and examples.

4. 🌐 Cloudflare Edge Mock Webhook Platform — Click to expand

Responsibility: Publish any payload to a global HTTPS REST endpoint in 60 seconds.
Global Edge: Deployed on Cloudflare Workers across 300+ global POPs.
Owner-Only Security: Endpoint URLs are public for external webhook traffic (Stripe, GitHub, Slack), while inspection portals (/webhook/<slug>) and request logs are strictly authenticated and fail-closed (401/403/404).
📖 See worker/webhook.ts.

5. 🔄 Cross-Format Converter & SQL Formatter — Click to expand

Responsibility: Lossless/lossy format conversion with structural boundary warnings and atomic undo (Cmd+Z).
SQL Multi-Dialect Formatter: Dedicated formatting rules for PostgreSQL, MySQL, SQLite, BigQuery, Snowflake, Trino / Athena, SQL Server (T-SQL), and Oracle PL/SQL.
📖 See docs/format-conversion.md.

📊 Supported Formats (22+)

Group	Supported Formats & Extensions	Capabilities
Structured Text	JSON, JSON Lines (NDJSON), XML, YAML, TOML, CSV, ASCII Table, SQL, Python Dict, Raw Text	Edit · Fix · Convert · Visualize
Binary Data	Parquet (`.parquet`), Arrow / Feather (`.arrow`), Excel (`.xlsx`, `.xls`), MessagePack (`.msgpack`), CBOR (`.cbor`), BSON (`.bson`), Protobuf (`.pb`), gzip (`.gz`)	Local Decode · Table / Tree View · JSON Export
AI / ML Artifacts	Safetensors (`.safetensors`), GGUF (`.gguf`), ComfyUI PNG (`.png`)	Header Inspect · Tensor Geometry · Graph Export
PKI & Certificates	PEM, DER, PKCS#12 / PFX (`.pfx`, `.p12`), PKCS#7 (`.p7b`), PKCS#10 CSR (`.csr`), Keys	`__insight__` Summary · Expiry · Fingerprint

💻 VS Code Extension Quick Start

Install via VS Code Extensions view (Cmd+Shift+X) searching for Yellorn or run:

code --install-extension hoangyell.yellorn

Essential Shortcuts

Shortcut	Command	Action
`Cmd+Alt+F` / `Ctrl+Alt+F`	Yellorn: Smart Format	Runs Smart Format data doctor recovery on active file or selection
`{{` in any file	Dynamic Token Autocomplete	Suggests `uuid4()`, `now()`, `randint()`, `choice()` with live docs
Click `.parquet` / `.safetensors`	Custom Editor Provider	Decodes binary file directly into interactive viewer tab
Right-click editor	Yellorn Submenu	Access Smart Format, Diff Repair, Sort Keys, Format SQL, JMESPath, Convert Format

🚀 Local Development & Self-Hosting

# 1. Clone and install
git clone https://github.com/hoangyell/yellorn-com.git
cd yellorn-com
pnpm install

# 2. Run local dev server (port 3001)
pnpm run dev

# 3. Run test suite (3,390+ unit tests)
pnpm test

# 4. Package VS Code extension (.vsix)
pnpm run publish:vscode

📚 Documentation & Deep Dives

📄 License

Licensed under the MIT License — see LICENSE.txt.

Developed with ❤️ by Hoang Yell · Deployed globally to Cloudflare Workers

Yellorn: Data Doctor & Universal Viewer

HoangYell