Cloud LM Provider

🚀 The [#1](https://github.com/suddhu-iith2004/cloud-lm-provider/issues/1) Extension for AWS Bedrock & Azure OpenAI in VS Code

Bring Claude 4.5, GPT-4o, Nova, DeepSeek, Llama, and 50+ enterprise AI models directly into GitHub Copilot Chat — with intelligent token compression that saves you up to 40% on API costs.

Quick Start • Features • Headroom AI • Models • Configuration • FAQ

🎯 Why Cloud LM Provider?

⚡ Quick Start

Installation

1. Install from VS Code Marketplace

   ext install suddhu-iith2004.cloud-lm-provider
   

   Or search "Cloud LM Provider" in the Extensions sidebar.

2. Run the Configuration Wizard

   Ctrl+Shift+P → "Cloud LM: Manage Provider Configuration"
   

3. Choose Your Provider

   • AWS Bedrock: Enter credentials or use AWS CLI profile
   • Azure OpenAI: Enter endpoint URL and API key

4. Start Chatting

   • Open GitHub Copilot Chat (Ctrl+Alt+I)
   • Select your preferred model from the dropdown
   • Experience enterprise AI in your IDE!

✨ Features

🌐 Multi-Cloud AI Access

Access 50+ enterprise AI models from a single extension:

🧠 Headroom AI — Intelligent Token Compression

Save 30-45% on every API call with our proprietary compression engine:

┌─────────────────────────────────────────────────────────────┐
│                    BEFORE HEADROOM                         │
│  ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━  21,000 tokens    │
│  (Messages + System Prompts + Tool Schemas)                │
├─────────────────────────────────────────────────────────────┤
│                    AFTER HEADROOM                          │
│  ━━━━━━━━━━━━━━━━━━━━━━━━━  12,600 tokens (-40%)          │
│  (Deduplicated + Compressed + Optimized)                   │
└─────────────────────────────────────────────────────────────┘

How It Works

1. Tool Schema Deduplication — VS Code injects ~15,000 tokens of tool definitions on every request. Headroom caches and references them efficiently.

2. Conversation History Compression — Older messages are intelligently summarized while preserving key context.

3. Code-Aware Chunking — Understands AST boundaries to compress code blocks without breaking syntax.

4. Semantic Deduplication — Removes repetitive patterns that waste model attention.

Real Savings Dashboard

Track your savings in real-time:

• 💰 Cost Avoided — Exact dollar amounts saved
• 📊 Token Reduction — Session, daily, and lifetime metrics
• 📈 Compression History — Visual trends over time
• 🎯 Accuracy Index — Model attention improvement score

"Headroom saved us $2,400/month across our 50-person engineering team." — Senior Platform Engineer, Fortune 500 Company

📊 Real-Time Status Bar Telemetry

Always know exactly what you're spending:

$(graph) Tokens: 8,542 In / 1,247 Out | $(zap) Headroom: ON | $(dashboard) $0.0234

• Live token counts from actual AWS/Azure API responses
• Per-request cost calculation using real-time pricing
• Cumulative session tracking for budget management
• One-click dashboard access for detailed analytics

🔧 Advanced Capabilities

🎛️ Configuration

AWS Bedrock Setup

Option 1: AWS CLI Profile (Recommended)

{
  "cloudLmProvider.aws.defaultRegion": "us-east-1",
  "cloudLmProvider.aws.modelRouting": "auto"
}

The extension automatically uses your configured AWS CLI profile.

Option 2: Access Keys

Run the configuration wizard and enter:

• AWS Access Key ID
• AWS Secret Access Key
• (Optional) Session Token for temporary credentials

Option 3: IAM Role / Instance Profile

For EC2 or ECS environments, credentials are automatically discovered.

Azure OpenAI Setup

{
  "cloudLmProvider.azure.defaultDeployment": "gpt-4o",
  "cloudLmProvider.azure.apiVersion": "2025-01-01-preview"
}

Run the wizard and enter:

• Azure OpenAI Endpoint URL
• API Key or use Azure AD authentication

All Settings

🤖 Supported Models

AWS Bedrock

Azure OpenAI

🔒 Security & Compliance

Cloud LM Provider is built for enterprise environments:

• ✅ No Data Collection — We don't collect, store, or transmit your conversations
• ✅ Local Credential Storage — All secrets stored in VS Code's encrypted keychain
• ✅ Your Cloud, Your Data — Direct API calls to your AWS/Azure accounts
• ✅ SOC 2 / HIPAA Compatible — Works within your existing compliance framework
• ✅ Open Source — Audit the code yourself on GitHub

📈 Performance Benchmarks

Tested on a MacBook Pro M3 with VS Code 1.104:

❓ FAQ

🛠️ Commands

🗺️ Roadmap

• [ ] Prompt Library — Save and reuse effective prompts
• [ ] Team Sharing — Share configurations across your organization
• [ ] Cost Alerts — Configurable spending notifications
• [ ] Google Vertex AI — Support for Gemini models
• [ ] Local Models — Ollama and LM Studio integration
• [ ] Custom Endpoints — OpenAI-compatible API support

🤝 Contributing

We welcome contributions! See CONTRIBUTING.md for guidelines.

# Clone the repository
git clone https://github.com/suddhu-iith2004/cloud-lm-provider.git

# Install dependencies
npm install

# Compile and watch
npm run watch

# Launch Extension Development Host
F5 in VS Code

📄 License

This project is licensed under the MIT License — see the LICENSE file for details.

🙏 Acknowledgments

• AWS SDK for JavaScript — AWS Bedrock integration
• Azure SDK for JavaScript — Azure OpenAI integration
• Headroom AI — Token compression engine
• The VS Code team for the excellent Language Model API

⭐ If Cloud LM Provider saves you time and money, please star this repo! ⭐

Made with ❤️ by @suddhu-iith2004

📊 Keywords

aws bedrock azure openai github copilot claude gpt-4 llm language model ai assistant code generation token compression enterprise ai vscode extension copilot chat anthropic openai amazon nova deepseek llama mistral cost optimization api cost token tracking headroom context compression